Jul 10 13:48:14.983583 ip-10-0-137-35 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 13:48:14.983593 ip-10-0-137-35 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 13:48:14.983600 ip-10-0-137-35 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 13:48:14.983814 ip-10-0-137-35 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 13:48:23.835101 ip-10-0-137-35 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 10 13:48:23.835117 ip-10-0-137-35 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6dbe142e0a024a4bbb65e6c8cac7f22b --
Jul 10 13:49:49.849887 ip-10-0-137-35 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.284396    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292846    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292858    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292862    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292866    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292869    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292872    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292875    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:49:50.336934 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292878    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292881    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292884    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292886    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292890    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292892    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292895    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292897    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292900    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292902    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292905    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292907    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292915    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292918    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292921    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292924    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292926    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292929    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292931    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292934    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:49:50.610698 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292936    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:49:50.370793 ip-10-0-137-35 systemd[1]: Started Kubernetes Kubelet.
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292941    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292944    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292948    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292951    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292955    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292958    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292960    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292963    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292966    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292968    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292971    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292973    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292976    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292979    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292982    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292984    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292987    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292989    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292992    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:49:50.618539 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292994    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.292997    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293000    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293004    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293008    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293010    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293013    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293016    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293018    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293021    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293024    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293026    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293029    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293031    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293034    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293037    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293039    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293042    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293044    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:49:50.620441 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293047    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293051    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293055    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293058    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293061    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293065    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293067    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293070    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293073    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293076    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293079    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293082    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293085    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293088    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293090    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293093    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293095    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293098    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293101    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:49:50.622321 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293103    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293106    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293109    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293112    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293114    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293117    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293120    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293122    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293125    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293127    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293130    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293132    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293135    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293137    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293863    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293871    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293874    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293879    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293882    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293885    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:49:50.623165 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293888    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293892    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293895    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293898    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293901    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293903    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293906    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293909    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293912    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293914    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293917    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293920    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293923    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293925    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293928    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293930    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293934    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293936    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293939    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293942    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:49:50.623784 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293946    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293949    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293952    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293955    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293958    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293961    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293963    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293966    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293969    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293972    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293975    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293977    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293980    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293983    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293986    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293988    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293991    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293993    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293996    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.293998    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:49:50.624376 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294000    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294003    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294005    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294011    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294015    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294018    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294021    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294024    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294026    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294029    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294031    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294034    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294037    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294041    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294045    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294048    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294050    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294053    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294055    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:49:50.625059 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294058    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294060    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294063    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294065    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294068    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294071    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294074    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294076    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294079    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294081    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294084    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294086    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294089    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294091    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294094    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294096    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294100    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294103    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294105    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294108    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:49:50.625615 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294110    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294113    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294115    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294118    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294120    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294123    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294126    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294129    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294131    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294134    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294136    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294139    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294142    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294144    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294491    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294498    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294501    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294503    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294506    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294509    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:49:50.626300 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294512    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294515    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294518    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294520    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294523    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294525    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294528    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294530    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294534    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294537    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294539    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294542    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294545    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294547    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294550    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294553    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294555    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294558    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294560    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294563    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:49:50.626886 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294566    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294569    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294571    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294574    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294576    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294579    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294581    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294585    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294588    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294590    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294592    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294595    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294598    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294600    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294603    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294605    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294608    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294610    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294613    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294615    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:49:50.627489 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294619    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294622    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294624    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294627    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294644    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294647    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294650    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294654    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294658    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294661    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294665    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294667    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294670    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294673    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294676    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294678    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294681    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294683    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294686    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:49:50.628072 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294694    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294696    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294699    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294701    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294703    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294706    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294709    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294712    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294715    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294717    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294720    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294722    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294726    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294730    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294734    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294737    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294740    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294747    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294750    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:49:50.628661 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294753    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294756    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294759    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294762    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294764    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294767    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294769    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294772    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294775    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294779    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294782    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294784    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294787    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294790    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.294793    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294867    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294876    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294885    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294892    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294899    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 13:49:50.629197 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294902    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294906    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294910    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294914    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294916    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294920    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294925    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294928    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294931    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294934    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294937    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294939    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294942    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294948    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294950    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294953    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294956    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294960    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294963    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294966    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294969    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294972    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294975    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294979    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 13:49:50.629810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294981    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294986    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294989    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294993    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294996    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.294999    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295002    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295005    2570 flags.go:64] FLAG: --enable-server="true"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295009    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295013    2570 flags.go:64] FLAG: --event-burst="100"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295016    2570 flags.go:64] FLAG: --event-qps="50"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295019    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295022    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295025    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295030    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295033    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295036    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295039    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295042    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295045    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295047    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295050    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295053    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295056    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295059    2570 flags.go:64] FLAG: --feature-gates=""
Jul 10 13:49:50.630418 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295062    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295066    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295069    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295072    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295075    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295077    2570 flags.go:64] FLAG: --help="false"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295080    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-137-35.ec2.internal"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295083    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295087    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295090    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295094    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295097    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295100    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295103    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295106    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295108    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295112    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295115    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295118    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295121    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295124    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295128    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295131    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295134    2570 flags.go:64] FLAG: --lock-file=""
Jul 10 13:49:50.631177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295136    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295139    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295142    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295147    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295150    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295153    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295156    2570 flags.go:64] FLAG: --logging-format="text"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295159    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295162    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295165    2570 flags.go:64] FLAG: --manifest-url=""
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295168    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295172    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295174    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295178    2570 flags.go:64] FLAG: --max-pods="110"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295181    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295184    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295188    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295191    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295194    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295197    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295200    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295206    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295209    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295212    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 13:49:50.631824 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295215    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295218    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295224    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295226    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295229    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295232    2570 flags.go:64] FLAG: --port="10250"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295236    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295239    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-052e9ec06edcb0a0b"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295242    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295245    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295248    2570 flags.go:64] FLAG: --register-node="true"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295251    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295254    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295257    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295260    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295263    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295266    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295269    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295272    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295275    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295278    2570 flags.go:64] FLAG: --runonce="false"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295281    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295284    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295287    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295291    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 13:49:50.632459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295294    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295297    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295299    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295302    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295305    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295308    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295311    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295313    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295316    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295320    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295336    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295342    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295345    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295349    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295354    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295357    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295359    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295362    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295365    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295368    2570 flags.go:64] FLAG: --v="2"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295372    2570 flags.go:64] FLAG: --version="false"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295376    2570 flags.go:64] FLAG: --vmodule=""
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295380    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.295383    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295494    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:49:50.633536 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295498    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295501    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295504    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295507    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295510    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295513    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295518    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295521    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295524    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295526    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295529    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295532    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295534    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295538    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295541    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295544    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295547    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295550    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295553    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:49:50.634236 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295555    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295560    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295563    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295566    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295569    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295571    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295574    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295576    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295579    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295582    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295584    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295586    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295589    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295591    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295594    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295597    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295599    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295602    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295604    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:49:50.860541 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295608    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295611    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295614    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295616    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295619    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295621    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295624    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295626    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295644    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295647    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295650    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295652    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295655    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295658    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295662    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295665    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295667    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295670    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295672    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295675    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:49:50.861191 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295678    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295680    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295683    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295685    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295688    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295690    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295693    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295695    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295698    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295700    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295703    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295706    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295710    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295712    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295715    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295717    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295720    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295722    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295725    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295727    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:49:50.861790 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295730    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295733    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295735    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295738    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295740    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295743    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295749    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295751    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295754    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295756    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295759    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295762    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295764    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295767    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295771    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295774    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295777    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295780    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295782    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:49:50.862352 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.295785    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.296545    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.306807    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.306821    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.307731    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.307739    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307795    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307800    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307803    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307806    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307809    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307811    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307814    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307817    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307820    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:49:50.862875 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307823    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307825    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307828    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307830    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307833    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307836    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307838    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307840    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307844    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307846    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307849    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307852    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307855    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307857    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307860    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307863    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307866    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307869    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307871    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307873    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:49:50.863319 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307876    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307879    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307882    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307884    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307889    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307894    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307898    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307901    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307903    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307906    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307909    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307912    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307914    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307917    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307920    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307922    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307925    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307929    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307933    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:49:50.863850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307937    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307940    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307942    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307945    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307948    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307950    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307952    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307955    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307958    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307960    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307963    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307965    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307968    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307970    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307974    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307976    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307979    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307983    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307986    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307988    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:49:50.864387 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307991    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307993    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307996    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.307998    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308001    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308004    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308006    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308008    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308011    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308013    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308016    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308018    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308022    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308025    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308027    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308030    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308032    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308035    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308039    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308042    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:49:50.864996 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308045    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308047    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308050    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308053    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308055    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308058    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308061    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308063    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308066    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308070    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308073    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.308078    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308180    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308185    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:49:50.865549 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308188    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308192    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308194    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308197    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308200    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308202    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308205    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308208    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308210    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308213    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308216    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308219    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308223    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308225    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308228    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308230    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308233    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308236    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308238    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308241    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:49:50.865997 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308244    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308246    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308249    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308251    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308254    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308256    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308259    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308263    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308266    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308268    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308271    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308273    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308276    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308278    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308281    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308283    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308285    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308288    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308290    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308293    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:49:50.866545 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308296    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308298    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308301    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308304    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308307    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308309    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308312    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308314    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308317    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308320    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308322    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308324    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308327    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308330    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308332    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308335    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308337    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308340    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308342    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308346    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:49:50.867067 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308349    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308351    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308354    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308356    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308359    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308361    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308364    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308366    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308369    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308371    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308374    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308376    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308379    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308381    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308384    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308388    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308392    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308395    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308399    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:49:50.867658 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308402    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308405    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308407    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308410    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308412    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308415    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308417    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308420    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308422    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308425    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308427    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308430    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308433    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308437    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308440    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308443    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308445    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:49:50.868157 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:50.308448    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.308453    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.308556    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.312091    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.313688    2570 server.go:1019] "Starting client certificate rotation"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.313791    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.313828    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.316461    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.322272    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.331409    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.336161    2570 log.go:25] "Validated CRI v1 image API"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.337533    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 13:49:50.868660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.341927    2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 882214c1-5490-49f6-9608-5910f892b45b:/dev/nvme0n1p4 e345f2c2-a2db-4637-a8d2-9d010dc3a62f:/dev/nvme0n1p3]
Jul 10 13:49:50.869011 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.341941    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 13:49:50.869117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.345963    2570 manager.go:216] Machine: {Timestamp:2026-07-10 13:49:50.345483983 +0000 UTC m=+0.368640475 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108165 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d17a0d344f2b01d1d46b9382f762e SystemUUID:ec2d17a0-d344-f2b0-1d1d-46b9382f762e BootID:6dbe142e-0a02-4a4b-bb65-e6c8cac7f22b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:c5:cb:09:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:c5:cb:09:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:43:76:18:b6:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 13:49:50.869117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.346056    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 13:49:50.869117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.346121    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 13:49:50.869117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.349840    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 13:49:50.869117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.349862    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 13:49:50.869117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.350719    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 13:49:50.869117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.350729    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 13:49:50.869117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.350737    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.351471    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.352020    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.353245    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.356735    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.356836    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.356860    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.356875    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.356888    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.356896    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.356929    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.357277    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.357292    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.361460    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.363754    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.363781    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364454    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364468    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364474    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364479    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364487    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364492    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364585    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364592    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364599    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364606    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364615    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.364622    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.365504    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.365511    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.368748    2570 server.go:1268] "Started kubelet"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.368831    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.368894    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.368957    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.371090    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.372014    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.372669    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.372732    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.372776    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 13:49:50.869387 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.374468    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.378072    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.378083    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.378202    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.378761    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.378770    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.378798    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.378961    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.378970    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.379293    2570 factory.go:55] Registering systemd factory
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.379309    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.379593    2570 factory.go:153] Registering CRI-O factory
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.379607    2570 factory.go:223] Registration of the crio container factory successfully
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.379667    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.379685    2570 factory.go:103] Registering Raw factory
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.379697    2570 manager.go:1196] Started watching for new ooms in manager
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.380164    2570 manager.go:349] Starting recovery of all containers
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.382329    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.384496    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.384173    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18c0f1de7fd9ad5b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-07-10 13:49:50.368722267 +0000 UTC m=+0.391878757,LastTimestamp:2026-07-10 13:49:50.368722267 +0000 UTC m=+0.391878757,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.395752    2570 manager.go:354] Recovery completed
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.400137    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.401809    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.401840    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.401853    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.402317    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.402326    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.402332    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.402339    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.403038    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.403060    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.403070    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.403274    2570 policy_none.go:49] "None policy: Start"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.403285    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 13:49:50.870433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.403296    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.404049    2570 policy_none.go:47] "Start"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.406375    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18c0f1de81d2c851  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-07-10 13:49:50.401824849 +0000 UTC m=+0.424981342,LastTimestamp:2026-07-10 13:49:50.401824849 +0000 UTC m=+0.424981342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.417897    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18c0f1de81d31ff1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-07-10 13:49:50.401847281 +0000 UTC m=+0.425003771,LastTimestamp:2026-07-10 13:49:50.401847281 +0000 UTC m=+0.425003771,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.425409    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p95xq"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.427490    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18c0f1de81d3471d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-07-10 13:49:50.401857309 +0000 UTC m=+0.425013800,LastTimestamp:2026-07-10 13:49:50.401857309 +0000 UTC m=+0.425013800,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.437691    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-35.ec2.internal.18c0f1de81d2c851\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18c0f1de81d2c851  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-07-10 13:49:50.401824849 +0000 UTC m=+0.424981342,LastTimestamp:2026-07-10 13:49:50.403049422 +0000 UTC m=+0.426205912,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.440982    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p95xq"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.451465    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.452590    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.452621    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.452658    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 13:49:51.064173 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.452706    2570 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.455087    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.461163    2570 manager.go:337] "Starting Device Plugin manager"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.461186    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.461194    2570 server.go:87] "Starting device plugin registration server"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.461422    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.461433    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.461535    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.461615    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.461625    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.462030    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.462073    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.553262    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"]
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.553316    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.554750    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.554778    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.554788    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.555793    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.555907    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.555934    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.556418    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.556426    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.556443    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.556447    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.556454    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.556459    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.557346    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.557371    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.557938    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.557967    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.557979    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.561490    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.562168    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.562197    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.562210    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:49:51.065272 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.562233    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.571120    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-35.ec2.internal\" not found" node="ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.574818    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-35.ec2.internal\" not found" node="ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.575006    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.575026    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-35.ec2.internal\": node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.579978    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e80e9c091ef9e35f91bb75e55dd39ae0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-35.ec2.internal\" (UID: \"e80e9c091ef9e35f91bb75e55dd39ae0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.580002    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc98d741f88e9a3a4be8a3a8139becdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"cc98d741f88e9a3a4be8a3a8139becdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.580027    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc98d741f88e9a3a4be8a3a8139becdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"cc98d741f88e9a3a4be8a3a8139becdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.653800    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.680188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc98d741f88e9a3a4be8a3a8139becdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"cc98d741f88e9a3a4be8a3a8139becdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.680211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc98d741f88e9a3a4be8a3a8139becdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"cc98d741f88e9a3a4be8a3a8139becdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.680228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e80e9c091ef9e35f91bb75e55dd39ae0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-35.ec2.internal\" (UID: \"e80e9c091ef9e35f91bb75e55dd39ae0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.680280    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc98d741f88e9a3a4be8a3a8139becdc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"cc98d741f88e9a3a4be8a3a8139becdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.680295    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc98d741f88e9a3a4be8a3a8139becdc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"cc98d741f88e9a3a4be8a3a8139becdc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.680333    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e80e9c091ef9e35f91bb75e55dd39ae0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-35.ec2.internal\" (UID: \"e80e9c091ef9e35f91bb75e55dd39ae0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.754581    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.855223    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.873513    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:50.878530    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:51.067679 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:50.955623    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:51.067679 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:51.056094    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:51.231088 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:51.156535    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:51.257100    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:51.277068    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:51.279047    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:51.297230    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:51.299136    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:51.313230    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:51.313351    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:51.313413    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:51.313423    2570 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://ad8aa915f7eec4c37a14e37ce5a2d041-30d39cd53e8bbe9b.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.137.35:45984->98.88.10.79:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:51.357575    2570 apiserver.go:52] "Watching apiserver"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.484792    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.487641    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.490693    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-4bdfh","openshift-image-registry/node-ca-nb27n","openshift-multus/multus-whkm2","openshift-network-diagnostics/network-check-target-prwb4","openshift-network-operator/iptables-alerter-57d86","kube-system/konnectivity-agent-6h9h8","openshift-cluster-node-tuning-operator/tuned-r84ht","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal","openshift-multus/multus-additional-cni-plugins-x4kjg","openshift-multus/network-metrics-daemon-549nd","openshift-ovn-kubernetes/ovnkube-node-zjz4r","kube-system/global-pull-secret-syncer-sk4fp","kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"]
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.491969    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.492977    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.493998    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.494898    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.496083    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.496868    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.497008    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.497284    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9q5wf\""
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.497388    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.497467    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.497553    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 13:49:52.515991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.497656    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.497776    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.499177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.499257    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.499472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.499515    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.499778    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.499800    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.499885    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h6w6s\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.499915    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.499962    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rhrct\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500005    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500066    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500248    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500320    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500369    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500416    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5h7t4\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500441    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.500488    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bw95n\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.501256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.502603    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.502712    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.503662    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507450    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507458    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507484    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 13:49:52.517980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507495    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507500    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m4j4j\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507455    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507574    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507716    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507729    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507800    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2qjlb\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.507943    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.508157    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.508260    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w2wkd\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.508346    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.508359    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gdkzq\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.508377    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 13:49:52.518924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.508407    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.537260    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j5pcr"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.544844    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80e9c091ef9e35f91bb75e55dd39ae0.slice/crio-5360b47f05131f4b705de5e662347bf592a2ba4bdbb0ebeced65bcca1c00983e WatchSource:0}: Error finding container 5360b47f05131f4b705de5e662347bf592a2ba4bdbb0ebeced65bcca1c00983e: Status 404 returned error can't find the container with id 5360b47f05131f4b705de5e662347bf592a2ba4bdbb0ebeced65bcca1c00983e
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.548049    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.550013    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j5pcr"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.552850    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 13:44:51 +0000 UTC" deadline="2028-02-04 04:43:13.705273748 +0000 UTC"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.552877    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13766h53m21.152398253s"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.562107    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal" event={"ID":"e80e9c091ef9e35f91bb75e55dd39ae0","Type":"ContainerStarted","Data":"5360b47f05131f4b705de5e662347bf592a2ba4bdbb0ebeced65bcca1c00983e"}
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.586193    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-etc-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589764    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589812    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-system-cni-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589825    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-kubernetes\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-systemd-units\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.665379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b18c367d-8164-49e8-a5e0-22e6759da098-serviceca\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589947    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-sys\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f2b8453-b037-4092-beb7-f36d13e7fae0-agent-certs\") pod \"konnectivity-agent-6h9h8\" (UID: \"5f2b8453-b037-4092-beb7-f36d13e7fae0\") " pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.589998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-registration-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-systemd\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-kubelet\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590066    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-slash\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-ovn\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-log-socket\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovnkube-config\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d74v\" (UniqueName: \"kubernetes.io/projected/d3c684fd-d02f-4c53-8fc9-cc47672828d9-kube-api-access-5d74v\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlg5p\" (UniqueName: \"kubernetes.io/projected/c6531a6d-1095-4150-b76f-214f90d4fc33-kube-api-access-dlg5p\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-cni-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-kubelet\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.666098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-conf-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysconfig\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-var-lib-kubelet\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590280    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-system-cni-dir\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590308    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-etc-kubernetes\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590342    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gw49\" (UniqueName: \"kubernetes.io/projected/dede2e0d-0fd5-451b-a1be-dcac043f03b6-kube-api-access-6gw49\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15689ad4-e290-448d-829a-d3ed091b3f1d-hosts-file\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-netns\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-cni-multus\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590403    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysctl-d\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590415    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-host\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-var-lib-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.666662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-os-release\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-modprobe-d\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-lib-modules\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590495    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-systemd\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovn-node-metrics-cert\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovnkube-script-lib\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-cni-bin\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-os-release\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590604    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3780ba2a-db6b-4112-8bbc-c14395eabdc0-cni-binary-copy\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdqs7\" (UniqueName: \"kubernetes.io/projected/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-kube-api-access-mdqs7\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590631    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f2b8453-b037-4092-beb7-f36d13e7fae0-konnectivity-ca\") pod \"konnectivity-agent-6h9h8\" (UID: \"5f2b8453-b037-4092-beb7-f36d13e7fae0\") " pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-device-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590669    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-hostroot\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-daemon-config\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.667143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590696    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-run\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-run-netns\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590724    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-node-log\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590736    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-cni-bin\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590769    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-env-overrides\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh2hs\" (UniqueName: \"kubernetes.io/projected/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-kube-api-access-bh2hs\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-cnibin\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590832    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-k8s-cni-cncf-io\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590864    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dede2e0d-0fd5-451b-a1be-dcac043f03b6-host-slash\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15689ad4-e290-448d-829a-d3ed091b3f1d-tmp-dir\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zrkp\" (UniqueName: \"kubernetes.io/projected/15689ad4-e290-448d-829a-d3ed091b3f1d-kube-api-access-9zrkp\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40cfbc71-878d-418c-945e-2295a16948a4-kubelet-config\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590953    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dede2e0d-0fd5-451b-a1be-dcac043f03b6-iptables-alerter-script\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.590985    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-cni-netd\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.667891 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591001    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40cfbc71-878d-418c-945e-2295a16948a4-dbus\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591030    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-sys-fs\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b18c367d-8164-49e8-a5e0-22e6759da098-host\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591074    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-socket-dir-parent\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591087    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-multus-certs\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9cq7\" (UniqueName: \"kubernetes.io/projected/3780ba2a-db6b-4112-8bbc-c14395eabdc0-kube-api-access-s9cq7\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591142    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smv5p\" (UniqueName: \"kubernetes.io/projected/91e74545-39ab-4daa-b982-29863646464d-kube-api-access-smv5p\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkx5k\" (UniqueName: \"kubernetes.io/projected/b18c367d-8164-49e8-a5e0-22e6759da098-kube-api-access-mkx5k\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-cnibin\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591245    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-tuned\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.668445 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591280    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:52.669349 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591320    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.669349 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysctl-conf\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.669349 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-tmp\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.669349 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:52.669349 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.591419    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-socket-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.669349 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.610409    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc98d741f88e9a3a4be8a3a8139becdc.slice/crio-9c4a47750a78344d09f2734addff9460523a12e368b6d80b8f421f1cd03ee4d2 WatchSource:0}: Error finding container 9c4a47750a78344d09f2734addff9460523a12e368b6d80b8f421f1cd03ee4d2: Status 404 returned error can't find the container with id 9c4a47750a78344d09f2734addff9460523a12e368b6d80b8f421f1cd03ee4d2
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692304    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-cni-netd\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40cfbc71-878d-418c-945e-2295a16948a4-dbus\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692346    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-sys-fs\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b18c367d-8164-49e8-a5e0-22e6759da098-host\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692407    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-sys-fs\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-cni-netd\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-socket-dir-parent\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-multus-certs\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b18c367d-8164-49e8-a5e0-22e6759da098-host\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9cq7\" (UniqueName: \"kubernetes.io/projected/3780ba2a-db6b-4112-8bbc-c14395eabdc0-kube-api-access-s9cq7\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.692466    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692506    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-multus-certs\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692531    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.859092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692533    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-socket-dir-parent\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692547    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40cfbc71-878d-418c-945e-2295a16948a4-dbus\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.692603    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret podName:40cfbc71-878d-418c-945e-2295a16948a4 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:53.192548018 +0000 UTC m=+2.109592263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret") pod "global-pull-secret-syncer-sk4fp" (UID: "40cfbc71-878d-418c-945e-2295a16948a4") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692638    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692657    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smv5p\" (UniqueName: \"kubernetes.io/projected/91e74545-39ab-4daa-b982-29863646464d-kube-api-access-smv5p\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx5k\" (UniqueName: \"kubernetes.io/projected/b18c367d-8164-49e8-a5e0-22e6759da098-kube-api-access-mkx5k\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-cnibin\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-tuned\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692725    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692740    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysctl-conf\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692781    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-cnibin\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.692923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysctl-conf\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.860211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693038    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.693214    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-tmp\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-socket-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-etc-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.693349    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs podName:d3c684fd-d02f-4c53-8fc9-cc47672828d9 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:53.193327671 +0000 UTC m=+2.110371928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs") pod "network-metrics-daemon-549nd" (UID: "d3c684fd-d02f-4c53-8fc9-cc47672828d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693391    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-etc-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693401    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693431    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-socket-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-system-cni-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693477    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.861606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693445    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-kubernetes\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693479    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-systemd-units\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693537    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693567    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-system-cni-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693571    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-systemd-units\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.693901    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-kubernetes\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b18c367d-8164-49e8-a5e0-22e6759da098-serviceca\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-sys\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694265    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f2b8453-b037-4092-beb7-f36d13e7fae0-agent-certs\") pod \"konnectivity-agent-6h9h8\" (UID: \"5f2b8453-b037-4092-beb7-f36d13e7fae0\") " pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-registration-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.862127 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694332    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-sys\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-systemd\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694397    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-kubelet\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694410    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91e74545-39ab-4daa-b982-29863646464d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694423    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-registration-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-slash\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694479    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-ovn\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-log-socket\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-slash\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694544    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b18c367d-8164-49e8-a5e0-22e6759da098-serviceca\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694479    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-kubelet\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694574    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-ovn\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694613    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-log-socket\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovnkube-config\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.862754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694709    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d74v\" (UniqueName: \"kubernetes.io/projected/d3c684fd-d02f-4c53-8fc9-cc47672828d9-kube-api-access-5d74v\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694762    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlg5p\" (UniqueName: \"kubernetes.io/projected/c6531a6d-1095-4150-b76f-214f90d4fc33-kube-api-access-dlg5p\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-cni-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694840    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-kubelet\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694868    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-conf-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysconfig\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.694959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-var-lib-kubelet\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695000    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-system-cni-dir\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-etc-kubernetes\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695089    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovnkube-config\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gw49\" (UniqueName: \"kubernetes.io/projected/dede2e0d-0fd5-451b-a1be-dcac043f03b6-kube-api-access-6gw49\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695186    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-systemd\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.863649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695306    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysconfig\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695420    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-var-lib-kubelet\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-etc-kubernetes\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-conf-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695603    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-system-cni-dir\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695665    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-kubelet\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695686    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.695575    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15689ad4-e290-448d-829a-d3ed091b3f1d-hosts-file\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-tuned\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696102    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15689ad4-e290-448d-829a-d3ed091b3f1d-hosts-file\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696629    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-netns\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696880    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-cni-multus\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696906    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-netns\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysctl-d\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.864282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696966    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f2b8453-b037-4092-beb7-f36d13e7fae0-agent-certs\") pod \"konnectivity-agent-6h9h8\" (UID: \"5f2b8453-b037-4092-beb7-f36d13e7fae0\") " pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696976    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-cni-multus\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.697066    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-sysctl-d\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.697101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-host\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.696949    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-host\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-var-lib-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-os-release\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698754    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-modprobe-d\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698770    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-var-lib-openvswitch\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698823    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-lib-modules\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698856    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-systemd\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698888    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovn-node-metrics-cert\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698897    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-os-release\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698919    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovnkube-script-lib\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698949    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-cni-bin\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.865061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698974    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-os-release\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-etc-modprobe-d\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.698975    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-tmp\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3780ba2a-db6b-4112-8bbc-c14395eabdc0-cni-binary-copy\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-lib-modules\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-var-lib-cni-bin\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqs7\" (UniqueName: \"kubernetes.io/projected/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-kube-api-access-mdqs7\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f2b8453-b037-4092-beb7-f36d13e7fae0-konnectivity-ca\") pod \"konnectivity-agent-6h9h8\" (UID: \"5f2b8453-b037-4092-beb7-f36d13e7fae0\") " pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699186    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-os-release\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-device-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699222    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-hostroot\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699255    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-daemon-config\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-run\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-run-netns\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-node-log\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.866154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-cni-bin\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-env-overrides\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699412    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh2hs\" (UniqueName: \"kubernetes.io/projected/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-kube-api-access-bh2hs\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-cnibin\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-k8s-cni-cncf-io\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dede2e0d-0fd5-451b-a1be-dcac043f03b6-host-slash\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15689ad4-e290-448d-829a-d3ed091b3f1d-tmp-dir\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699552    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zrkp\" (UniqueName: \"kubernetes.io/projected/15689ad4-e290-448d-829a-d3ed091b3f1d-kube-api-access-9zrkp\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40cfbc71-878d-418c-945e-2295a16948a4-kubelet-config\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699612    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dede2e0d-0fd5-451b-a1be-dcac043f03b6-iptables-alerter-script\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovnkube-script-lib\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-run-systemd\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699707    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-node-log\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.699984    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-cni-bin\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700163    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dede2e0d-0fd5-451b-a1be-dcac043f03b6-iptables-alerter-script\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700213    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3780ba2a-db6b-4112-8bbc-c14395eabdc0-cni-binary-copy\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700291    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dede2e0d-0fd5-451b-a1be-dcac043f03b6-host-slash\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700353    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-env-overrides\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700502    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-host-run-k8s-cni-cncf-io\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700541    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40cfbc71-878d-418c-945e-2295a16948a4-kubelet-config\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700545    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-hostroot\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700571    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-cni-dir\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91e74545-39ab-4daa-b982-29863646464d-cnibin\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-run\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6531a6d-1095-4150-b76f-214f90d4fc33-device-dir\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700761    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-host-run-netns\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700854    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15689ad4-e290-448d-829a-d3ed091b3f1d-tmp-dir\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700983    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3780ba2a-db6b-4112-8bbc-c14395eabdc0-multus-daemon-config\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.700986    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f2b8453-b037-4092-beb7-f36d13e7fae0-konnectivity-ca\") pod \"konnectivity-agent-6h9h8\" (UID: \"5f2b8453-b037-4092-beb7-f36d13e7fae0\") " pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:49:52.867838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.701954    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-ovn-node-metrics-cert\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.707809    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.707822    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.707831    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4s6xd for pod openshift-network-diagnostics/network-check-target-prwb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:52.707881    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd podName:f2442db3-fb9a-48c7-90c1-9be238c07f89 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:53.207869834 +0000 UTC m=+2.124914079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4s6xd" (UniqueName: "kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd") pod "network-check-target-prwb4" (UID: "f2442db3-fb9a-48c7-90c1-9be238c07f89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.709056    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smv5p\" (UniqueName: \"kubernetes.io/projected/91e74545-39ab-4daa-b982-29863646464d-kube-api-access-smv5p\") pod \"multus-additional-cni-plugins-x4kjg\" (UID: \"91e74545-39ab-4daa-b982-29863646464d\") " pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.709165    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gw49\" (UniqueName: \"kubernetes.io/projected/dede2e0d-0fd5-451b-a1be-dcac043f03b6-kube-api-access-6gw49\") pod \"iptables-alerter-57d86\" (UID: \"dede2e0d-0fd5-451b-a1be-dcac043f03b6\") " pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.711121    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9cq7\" (UniqueName: \"kubernetes.io/projected/3780ba2a-db6b-4112-8bbc-c14395eabdc0-kube-api-access-s9cq7\") pod \"multus-whkm2\" (UID: \"3780ba2a-db6b-4112-8bbc-c14395eabdc0\") " pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.718803    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlg5p\" (UniqueName: \"kubernetes.io/projected/c6531a6d-1095-4150-b76f-214f90d4fc33-kube-api-access-dlg5p\") pod \"aws-ebs-csi-driver-node-qbmcm\" (UID: \"c6531a6d-1095-4150-b76f-214f90d4fc33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.718981    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkx5k\" (UniqueName: \"kubernetes.io/projected/b18c367d-8164-49e8-a5e0-22e6759da098-kube-api-access-mkx5k\") pod \"node-ca-nb27n\" (UID: \"b18c367d-8164-49e8-a5e0-22e6759da098\") " pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.719329    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d74v\" (UniqueName: \"kubernetes.io/projected/d3c684fd-d02f-4c53-8fc9-cc47672828d9-kube-api-access-5d74v\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.719609    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdqs7\" (UniqueName: \"kubernetes.io/projected/8b790b03-0dc3-4cf1-ac8f-01a06bee726a-kube-api-access-mdqs7\") pod \"tuned-r84ht\" (UID: \"8b790b03-0dc3-4cf1-ac8f-01a06bee726a\") " pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.722558    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zrkp\" (UniqueName: \"kubernetes.io/projected/15689ad4-e290-448d-829a-d3ed091b3f1d-kube-api-access-9zrkp\") pod \"node-resolver-4bdfh\" (UID: \"15689ad4-e290-448d-829a-d3ed091b3f1d\") " pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.724528    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh2hs\" (UniqueName: \"kubernetes.io/projected/4f39dfb1-4d93-4c39-8ea9-db64ca0beab7-kube-api-access-bh2hs\") pod \"ovnkube-node-zjz4r\" (UID: \"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:52.868865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.815370    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x4kjg"
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.827512    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e74545_39ab_4daa_b982_29863646464d.slice/crio-81d399e899ec03cb961765f6afb941314419bef92126118ef049d4476797bb75 WatchSource:0}: Error finding container 81d399e899ec03cb961765f6afb941314419bef92126118ef049d4476797bb75: Status 404 returned error can't find the container with id 81d399e899ec03cb961765f6afb941314419bef92126118ef049d4476797bb75
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.844762    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.847785    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nb27n"
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.854471    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18c367d_8164_49e8_a5e0_22e6759da098.slice/crio-473cf6b2f9bf2839e1d2e424193a9d37d6aa585db24147d89f9d417e8a7f5bc9 WatchSource:0}: Error finding container 473cf6b2f9bf2839e1d2e424193a9d37d6aa585db24147d89f9d417e8a7f5bc9: Status 404 returned error can't find the container with id 473cf6b2f9bf2839e1d2e424193a9d37d6aa585db24147d89f9d417e8a7f5bc9
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.858716    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-whkm2"
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.861059    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4bdfh"
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.866210    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3780ba2a_db6b_4112_8bbc_c14395eabdc0.slice/crio-c2fd22c22fdd7e3271851a589c3ebac37efabecb138918e83b763c2653c8ce14 WatchSource:0}: Error finding container c2fd22c22fdd7e3271851a589c3ebac37efabecb138918e83b763c2653c8ce14: Status 404 returned error can't find the container with id c2fd22c22fdd7e3271851a589c3ebac37efabecb138918e83b763c2653c8ce14
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.867058    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-57d86"
Jul 10 13:49:52.869781 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.867855    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15689ad4_e290_448d_829a_d3ed091b3f1d.slice/crio-f75595762a04d138e880940733cf821d67e546aece92be0d8973c8771b2da1c7 WatchSource:0}: Error finding container f75595762a04d138e880940733cf821d67e546aece92be0d8973c8771b2da1c7: Status 404 returned error can't find the container with id f75595762a04d138e880940733cf821d67e546aece92be0d8973c8771b2da1c7
Jul 10 13:49:53.003101 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.872788    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:49:53.003101 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.878052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r84ht"
Jul 10 13:49:53.003101 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.879023    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddede2e0d_0fd5_451b_a1be_dcac043f03b6.slice/crio-feb3de09ef4d26bbbf2a6895f327c86a7deb67b53ea17e0d8e6778c95469821d WatchSource:0}: Error finding container feb3de09ef4d26bbbf2a6895f327c86a7deb67b53ea17e0d8e6778c95469821d: Status 404 returned error can't find the container with id feb3de09ef4d26bbbf2a6895f327c86a7deb67b53ea17e0d8e6778c95469821d
Jul 10 13:49:53.003101 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.883027    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:49:53.003101 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.884414    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2b8453_b037_4092_beb7_f36d13e7fae0.slice/crio-6e8b9065f4037c88f362272f3036368479301f6a60aee921f2ab2f1f252e6c6d WatchSource:0}: Error finding container 6e8b9065f4037c88f362272f3036368479301f6a60aee921f2ab2f1f252e6c6d: Status 404 returned error can't find the container with id 6e8b9065f4037c88f362272f3036368479301f6a60aee921f2ab2f1f252e6c6d
Jul 10 13:49:53.003101 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.886459    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b790b03_0dc3_4cf1_ac8f_01a06bee726a.slice/crio-e295715e1117707b6df9cf7d69d7cb0002e1bde918d2ac884210c113973fab38 WatchSource:0}: Error finding container e295715e1117707b6df9cf7d69d7cb0002e1bde918d2ac884210c113973fab38: Status 404 returned error can't find the container with id e295715e1117707b6df9cf7d69d7cb0002e1bde918d2ac884210c113973fab38
Jul 10 13:49:53.003101 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:52.887236    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm"
Jul 10 13:49:53.003101 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:49:52.898153    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6531a6d_1095_4150_b76f_214f90d4fc33.slice/crio-4b4837604efc51ae53f271231c0d88f72363f104875ea52ca864e39df5f1b04a WatchSource:0}: Error finding container 4b4837604efc51ae53f271231c0d88f72363f104875ea52ca864e39df5f1b04a: Status 404 returned error can't find the container with id 4b4837604efc51ae53f271231c0d88f72363f104875ea52ca864e39df5f1b04a
Jul 10 13:49:53.096441 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.057138    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.208720    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.208782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.208816    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:53.208873    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:53.208925    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret podName:40cfbc71-878d-418c-945e-2295a16948a4 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:54.208910657 +0000 UTC m=+3.125954902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret") pod "global-pull-secret-syncer-sk4fp" (UID: "40cfbc71-878d-418c-945e-2295a16948a4") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:53.208925    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:53.208943    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:53.208959    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:53.208971    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4s6xd for pod openshift-network-diagnostics/network-check-target-prwb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:53.208984    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs podName:d3c684fd-d02f-4c53-8fc9-cc47672828d9 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:54.208966676 +0000 UTC m=+3.126010920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs") pod "network-metrics-daemon-549nd" (UID: "d3c684fd-d02f-4c53-8fc9-cc47672828d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:49:53.263345 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:53.209011    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd podName:f2442db3-fb9a-48c7-90c1-9be238c07f89 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:54.20899791 +0000 UTC m=+3.126042175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4s6xd" (UniqueName: "kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd") pod "network-check-target-prwb4" (UID: "f2442db3-fb9a-48c7-90c1-9be238c07f89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:49:53.586670 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.566156    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 13:44:52 +0000 UTC" deadline="2028-01-17 15:38:45.412298052 +0000 UTC"
Jul 10 13:49:53.586670 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.566187    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13345h48m51.846114874s"
Jul 10 13:49:53.586670 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.582377    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6h9h8" event={"ID":"5f2b8453-b037-4092-beb7-f36d13e7fae0","Type":"ContainerStarted","Data":"6e8b9065f4037c88f362272f3036368479301f6a60aee921f2ab2f1f252e6c6d"}
Jul 10 13:49:53.653200 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.589671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-57d86" event={"ID":"dede2e0d-0fd5-451b-a1be-dcac043f03b6","Type":"ContainerStarted","Data":"feb3de09ef4d26bbbf2a6895f327c86a7deb67b53ea17e0d8e6778c95469821d"}
Jul 10 13:49:53.653200 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.596573    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-whkm2" event={"ID":"3780ba2a-db6b-4112-8bbc-c14395eabdc0","Type":"ContainerStarted","Data":"c2fd22c22fdd7e3271851a589c3ebac37efabecb138918e83b763c2653c8ce14"}
Jul 10 13:49:53.653200 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.606462    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nb27n" event={"ID":"b18c367d-8164-49e8-a5e0-22e6759da098","Type":"ContainerStarted","Data":"473cf6b2f9bf2839e1d2e424193a9d37d6aa585db24147d89f9d417e8a7f5bc9"}
Jul 10 13:49:53.653200 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.627639    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal" event={"ID":"cc98d741f88e9a3a4be8a3a8139becdc","Type":"ContainerStarted","Data":"9c4a47750a78344d09f2734addff9460523a12e368b6d80b8f421f1cd03ee4d2"}
Jul 10 13:49:53.653200 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.641311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm" event={"ID":"c6531a6d-1095-4150-b76f-214f90d4fc33","Type":"ContainerStarted","Data":"4b4837604efc51ae53f271231c0d88f72363f104875ea52ca864e39df5f1b04a"}
Jul 10 13:49:53.682420 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.682349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r84ht" event={"ID":"8b790b03-0dc3-4cf1-ac8f-01a06bee726a","Type":"ContainerStarted","Data":"e295715e1117707b6df9cf7d69d7cb0002e1bde918d2ac884210c113973fab38"}
Jul 10 13:49:53.687558 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.687498    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4bdfh" event={"ID":"15689ad4-e290-448d-829a-d3ed091b3f1d","Type":"ContainerStarted","Data":"f75595762a04d138e880940733cf821d67e546aece92be0d8973c8771b2da1c7"}
Jul 10 13:49:53.689684 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.689613    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" event={"ID":"91e74545-39ab-4daa-b982-29863646464d","Type":"ContainerStarted","Data":"81d399e899ec03cb961765f6afb941314419bef92126118ef049d4476797bb75"}
Jul 10 13:49:53.711971 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.711871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"d57deedb299e940aee3e55d52146fef36322866996fae6f3c54b5ba59bf5e865"}
Jul 10 13:49:53.909761 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:53.909671    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:49:54.216898 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.216789    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:54.216898 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.216842    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:54.216898 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.216870    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:54.217150 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.216991    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:49:54.217150 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.217006    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:49:54.217150 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.217019    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:49:54.217150 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.217030    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4s6xd for pod openshift-network-diagnostics/network-check-target-prwb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:49:54.217150 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.217059    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret podName:40cfbc71-878d-418c-945e-2295a16948a4 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:56.217030678 +0000 UTC m=+5.134074933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret") pod "global-pull-secret-syncer-sk4fp" (UID: "40cfbc71-878d-418c-945e-2295a16948a4") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:49:54.217150 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.217078    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd podName:f2442db3-fb9a-48c7-90c1-9be238c07f89 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:56.217068398 +0000 UTC m=+5.134112638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4s6xd" (UniqueName: "kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd") pod "network-check-target-prwb4" (UID: "f2442db3-fb9a-48c7-90c1-9be238c07f89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:49:54.217150 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.217141    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:49:54.217150 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.217172    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs podName:d3c684fd-d02f-4c53-8fc9-cc47672828d9 nodeName:}" failed. No retries permitted until 2026-07-10 13:49:56.217161339 +0000 UTC m=+5.134205582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs") pod "network-metrics-daemon-549nd" (UID: "d3c684fd-d02f-4c53-8fc9-cc47672828d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:49:54.559264 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.559187    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:54.559416 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.559318    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:49:54.559715 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.559694    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:54.559844 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.559817    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:49:54.559901 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.559891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:54.559973 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:54.559955    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:49:54.567277 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.567220    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 13:44:52 +0000 UTC" deadline="2027-12-24 16:23:54.192774886 +0000 UTC"
Jul 10 13:49:54.567277 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.567275    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12770h33m59.62550353s"
Jul 10 13:49:54.660835 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:54.660543    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:49:56.234323 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:56.234270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:56.234884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:56.234336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:56.234884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:56.234375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:56.234884 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.234554    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:49:56.234884 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.234644    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:49:56.234884 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.234683    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4s6xd for pod openshift-network-diagnostics/network-check-target-prwb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:49:56.234884 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.234758    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd podName:f2442db3-fb9a-48c7-90c1-9be238c07f89 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:00.234724994 +0000 UTC m=+9.151769257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4s6xd" (UniqueName: "kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd") pod "network-check-target-prwb4" (UID: "f2442db3-fb9a-48c7-90c1-9be238c07f89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:49:56.235310 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.235291    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:49:56.235376 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.235349    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret podName:40cfbc71-878d-418c-945e-2295a16948a4 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:00.235332673 +0000 UTC m=+9.152376917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret") pod "global-pull-secret-syncer-sk4fp" (UID: "40cfbc71-878d-418c-945e-2295a16948a4") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:49:56.235429 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.235411    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:49:56.235502 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.235490    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs podName:d3c684fd-d02f-4c53-8fc9-cc47672828d9 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:00.235452996 +0000 UTC m=+9.152497241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs") pod "network-metrics-daemon-549nd" (UID: "d3c684fd-d02f-4c53-8fc9-cc47672828d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:49:56.559800 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:56.559325    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:56.559800 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.559456    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:49:56.559800 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:56.559493    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:56.559800 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.559613    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:49:56.559800 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:56.559668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:56.559800 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:56.559736    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:49:58.559414 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:58.559383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:49:58.559414 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:58.559407    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:49:58.559902 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:58.559530    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:49:58.559902 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:58.559615    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:49:58.559902 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:49:58.559678    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:49:58.559902 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:49:58.559782    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:00.267761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:00.267818    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:00.267846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.268016    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.268038    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.268051    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4s6xd for pod openshift-network-diagnostics/network-check-target-prwb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.268107    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd podName:f2442db3-fb9a-48c7-90c1-9be238c07f89 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:08.268090247 +0000 UTC m=+17.185134504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4s6xd" (UniqueName: "kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd") pod "network-check-target-prwb4" (UID: "f2442db3-fb9a-48c7-90c1-9be238c07f89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.268176    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.268207    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret podName:40cfbc71-878d-418c-945e-2295a16948a4 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:08.268196453 +0000 UTC m=+17.185240697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret") pod "global-pull-secret-syncer-sk4fp" (UID: "40cfbc71-878d-418c-945e-2295a16948a4") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.268263    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:00.268647 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.268293    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs podName:d3c684fd-d02f-4c53-8fc9-cc47672828d9 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:08.268281946 +0000 UTC m=+17.185326192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs") pod "network-metrics-daemon-549nd" (UID: "d3c684fd-d02f-4c53-8fc9-cc47672828d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:00.560039 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:00.559915    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:00.560039 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:00.559951    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:00.560039 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:00.559915    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:00.560284 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.560046    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:00.560284 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.560136    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:00.560284 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:00.560201    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:02.559865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:02.559722    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:02.559865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:02.559804    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:02.560328 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:02.559936    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:02.560328 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:02.560057    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:02.560328 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:02.560167    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:02.560328 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:02.560264    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:04.559137 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:04.559110    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:04.559557 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:04.559145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:04.559557 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:04.559206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:04.559557 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:04.559216    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:04.559557 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:04.559306    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:04.559557 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:04.559404    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:06.559415 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:06.559322    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:06.559884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:06.559443    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:06.559884 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:06.559447    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:06.559884 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:06.559565    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:06.559884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:06.559599    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:06.559884 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:06.559686    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:08.330298 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:08.330269    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:08.330693 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:08.330313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:08.330693 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:08.330341    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:08.331504 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.331475    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:08.331575 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.331509    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:08.331631 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.331568    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4s6xd for pod openshift-network-diagnostics/network-check-target-prwb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:08.331676 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.331649    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd podName:f2442db3-fb9a-48c7-90c1-9be238c07f89 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:24.331624994 +0000 UTC m=+33.248669252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4s6xd" (UniqueName: "kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd") pod "network-check-target-prwb4" (UID: "f2442db3-fb9a-48c7-90c1-9be238c07f89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:08.333641 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.333581    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:08.333767 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.333723    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:08.333982 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.333967    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret podName:40cfbc71-878d-418c-945e-2295a16948a4 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:24.33372549 +0000 UTC m=+33.250769731 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret") pod "global-pull-secret-syncer-sk4fp" (UID: "40cfbc71-878d-418c-945e-2295a16948a4") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:08.334054 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.334040    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs podName:d3c684fd-d02f-4c53-8fc9-cc47672828d9 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:24.334016811 +0000 UTC m=+33.251061060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs") pod "network-metrics-daemon-549nd" (UID: "d3c684fd-d02f-4c53-8fc9-cc47672828d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:08.559535 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:08.559502    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:08.559692 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:08.559510    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:08.559692 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.559614    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:08.559692 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:08.559642    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:08.559860 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.559717    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:08.559860 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:08.559807    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:10.559175 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:10.558985    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:10.559661 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:10.558994    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:10.559661 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:10.559254    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:10.559661 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:10.559351    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:10.559661 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:10.558994    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:10.559661 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:10.559442    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:12.559416 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:12.559382    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:12.559792 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:12.559472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:12.559792 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:12.559477    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:12.559792 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:12.559500    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:12.559792 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:12.559572    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:12.559792 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:12.559622    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:13.768048 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.768014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4bdfh" event={"ID":"15689ad4-e290-448d-829a-d3ed091b3f1d","Type":"ContainerStarted","Data":"8d016f709d212aa3e4110f93b890d029a899addd22121ba14968b3d2fc0b7985"}
Jul 10 13:50:13.769597 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.769575    2570 generic.go:356] "Generic (PLEG): container finished" podID="91e74545-39ab-4daa-b982-29863646464d" containerID="5a6f2e5f5bbb520b44c7c8e6af3c037a672e781deb4e0687cbed019acc11cc76" exitCode=0
Jul 10 13:50:13.769685 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.769641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" event={"ID":"91e74545-39ab-4daa-b982-29863646464d","Type":"ContainerDied","Data":"5a6f2e5f5bbb520b44c7c8e6af3c037a672e781deb4e0687cbed019acc11cc76"}
Jul 10 13:50:13.772585 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.772569    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 13:50:13.772941 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.772923    2570 generic.go:356] "Generic (PLEG): container finished" podID="4f39dfb1-4d93-4c39-8ea9-db64ca0beab7" containerID="93cb191bc541137b0dd205048db662be7626c2f94be0a4230ce519eee6e1f114" exitCode=1
Jul 10 13:50:13.773025 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.772962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"e94dbe6c3d02d94ef649f3112ef8488fde1e040eafb65200aa8c87fa754364b3"}
Jul 10 13:50:13.773084 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.773025    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"3a54f2b5ef2d0dc08bc9ec1c61b27b2dd627d4614faef7ee75c36661b7ce4065"}
Jul 10 13:50:13.773084 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.773062    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"c7e4ceaaf8e6fb35ca902244cdf595449348952c2fd29ce2ab1ce8ba1744ebd6"}
Jul 10 13:50:13.773164 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.773100    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"01b3d942b4f5caf4ba00fdd2e2ffead38c36bf115e18a54a1c71d707222f129d"}
Jul 10 13:50:13.773164 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.773129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerDied","Data":"93cb191bc541137b0dd205048db662be7626c2f94be0a4230ce519eee6e1f114"}
Jul 10 13:50:13.773164 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.773162    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"dce0031b3a4a4f965c8f81fee0d919b80a0f901205e512babc118e13b405aaec"}
Jul 10 13:50:13.774254 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.774236    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6h9h8" event={"ID":"5f2b8453-b037-4092-beb7-f36d13e7fae0","Type":"ContainerStarted","Data":"24634d5f0d456d8eb81615542603e7d66ef709882beaa5ff966a64276d55a573"}
Jul 10 13:50:13.775450 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.775434    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-whkm2" event={"ID":"3780ba2a-db6b-4112-8bbc-c14395eabdc0","Type":"ContainerStarted","Data":"f741185fca5a136a284765c5240bf84111da6e299581105400a721279e48965f"}
Jul 10 13:50:13.776796 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.776776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nb27n" event={"ID":"b18c367d-8164-49e8-a5e0-22e6759da098","Type":"ContainerStarted","Data":"a047644a5480419d920a02557e01e84e90a5cf7f34f70a10e2f44a8d56c417c6"}
Jul 10 13:50:13.778031 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.778011    2570 generic.go:356] "Generic (PLEG): container finished" podID="cc98d741f88e9a3a4be8a3a8139becdc" containerID="83d6a98d54756637c8c3001c48c8f786e3973682918e579db842d9efaa2fbda7" exitCode=0
Jul 10 13:50:13.778109 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.778092    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal" event={"ID":"cc98d741f88e9a3a4be8a3a8139becdc","Type":"ContainerDied","Data":"83d6a98d54756637c8c3001c48c8f786e3973682918e579db842d9efaa2fbda7"}
Jul 10 13:50:13.779453 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.779435    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal" event={"ID":"e80e9c091ef9e35f91bb75e55dd39ae0","Type":"ContainerStarted","Data":"c2c564d55f4c9435d49fb9e7cebc32dc8b96dbb05de8291e4cff7bba6196235a"}
Jul 10 13:50:13.781011 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.780991    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm" event={"ID":"c6531a6d-1095-4150-b76f-214f90d4fc33","Type":"ContainerStarted","Data":"23e14b2ac0d96abc58eb50215ba9cd824f22c72cce2f9a877a23d789828ceff7"}
Jul 10 13:50:13.782338 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.782321    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r84ht" event={"ID":"8b790b03-0dc3-4cf1-ac8f-01a06bee726a","Type":"ContainerStarted","Data":"7a99ff0a94eed7c9e3bd3fc9a2835716a573c90bdf70836faabb004e62160f36"}
Jul 10 13:50:13.810237 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.809557    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4bdfh" podStartSLOduration=2.958305245 podStartE2EDuration="22.809539929s" totalImagesPullingTime="19.851234684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:13.788141544 +0000 UTC m=+22.705185809" watchObservedRunningTime="2026-07-10 13:50:13.809539929 +0000 UTC m=+22.726584198"
Jul 10 13:50:13.848678 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.848635    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal" podStartSLOduration=21.848620205 podStartE2EDuration="21.848620205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:13.8294378 +0000 UTC m=+22.746482064" watchObservedRunningTime="2026-07-10 13:50:13.848620205 +0000 UTC m=+22.765664469"
Jul 10 13:50:13.848984 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.848953    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6h9h8" podStartSLOduration=3.016323947 podStartE2EDuration="22.848944307s" totalImagesPullingTime="19.83262036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:13.848764908 +0000 UTC m=+22.765809154" watchObservedRunningTime="2026-07-10 13:50:13.848944307 +0000 UTC m=+22.765988570"
Jul 10 13:50:13.868115 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.868085    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r84ht" podStartSLOduration=2.036552375 podStartE2EDuration="21.868074438s" totalImagesPullingTime="19.831522063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:13.867607035 +0000 UTC m=+22.784651299" watchObservedRunningTime="2026-07-10 13:50:13.868074438 +0000 UTC m=+22.785118700"
Jul 10 13:50:13.931104 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.931065    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nb27n" podStartSLOduration=3.081862286 podStartE2EDuration="22.931041953s" totalImagesPullingTime="19.849179667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:13.930947884 +0000 UTC m=+22.847992143" watchObservedRunningTime="2026-07-10 13:50:13.931041953 +0000 UTC m=+22.848086206"
Jul 10 13:50:13.960048 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:13.960010    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-whkm2" podStartSLOduration=2.881724657 podStartE2EDuration="22.960000054s" totalImagesPullingTime="20.078275397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:13.958922878 +0000 UTC m=+22.875967140" watchObservedRunningTime="2026-07-10 13:50:13.960000054 +0000 UTC m=+22.877044317"
Jul 10 13:50:14.559831 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.559804    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:14.559973 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.559839    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:14.559973 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.559890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:14.559973 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:14.559899    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:14.559973 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:14.559953    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:14.560101 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:14.560011    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:14.646232 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.646209    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:50:14.646785 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.646762    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:50:14.786797 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.786760    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-57d86" event={"ID":"dede2e0d-0fd5-451b-a1be-dcac043f03b6","Type":"ContainerStarted","Data":"2e70bc183e4c3f63d6f6a8486c28a0e750e9b80b7018607cb804a3d55be28288"}
Jul 10 13:50:14.787719 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.787697    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 13:50:14.788684 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.788662    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal" event={"ID":"cc98d741f88e9a3a4be8a3a8139becdc","Type":"ContainerStarted","Data":"0095f23f93bb7c18e8936de9104d7bff9267b25cf364399edddde927c6101d8d"}
Jul 10 13:50:14.790677 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.790650    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm" event={"ID":"c6531a6d-1095-4150-b76f-214f90d4fc33","Type":"ContainerStarted","Data":"eb04440c407648acb367656bf7c2b37283a3e682d6eb357a499eaec415453bd4"}
Jul 10 13:50:14.790859 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.790842    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:50:14.791680 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.791593    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6h9h8"
Jul 10 13:50:14.826713 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.826634    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-57d86" podStartSLOduration=3.988970883 podStartE2EDuration="23.826616296s" totalImagesPullingTime="19.837645413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:14.80885483 +0000 UTC m=+23.725899093" watchObservedRunningTime="2026-07-10 13:50:14.826616296 +0000 UTC m=+23.743660559"
Jul 10 13:50:14.847861 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:14.847822    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal" podStartSLOduration=22.847809075 podStartE2EDuration="22.847809075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:14.826004769 +0000 UTC m=+23.743049034" watchObservedRunningTime="2026-07-10 13:50:14.847809075 +0000 UTC m=+23.764853338"
Jul 10 13:50:15.580928 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:15.580784    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T13:50:14.787712065Z","UUID":"525773c5-51f4-4fbd-9242-fc0f807e7a18","Handler":null,"Name":"","Endpoint":""}
Jul 10 13:50:15.582325 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:15.582297    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 13:50:15.582460 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:15.582345    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 13:50:15.796081 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:15.796058    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 13:50:15.796537 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:15.796513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"254a47bb4bca08255b7044265f493642f79dda133203b6b0c77b15bb06147b01"}
Jul 10 13:50:16.559894 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:16.559857    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:16.559894 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:16.559881    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:16.560085 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:16.559974    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:16.560085 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:16.559986    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:16.560085 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:16.560058    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:16.560181 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:16.560108    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:16.801466 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:16.801427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm" event={"ID":"c6531a6d-1095-4150-b76f-214f90d4fc33","Type":"ContainerStarted","Data":"ab3fc0d445895071ad221461d9b737213747803b23e7a9c38eb50832949e4bba"}
Jul 10 13:50:16.823436 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:16.823342    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbmcm" podStartSLOduration=2.7706549579999997 podStartE2EDuration="24.823326382s" totalImagesPullingTime="22.052671424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:16.823297907 +0000 UTC m=+25.740342172" watchObservedRunningTime="2026-07-10 13:50:16.823326382 +0000 UTC m=+25.740370644"
Jul 10 13:50:18.560109 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.559949    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:18.560599 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.559976    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:18.560599 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:18.560191    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:18.560599 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.559983    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:18.560599 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:18.560256    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:18.560599 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:18.560332    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:18.808948 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.808875    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 13:50:18.809290 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.809265    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"5c0a8f34d97c4f681c4af84bd30c3cd84fa5e6289ec5b925372e8a9d0b42c431"}
Jul 10 13:50:18.809490 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.809466    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:50:18.809769 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.809737    2570 scope.go:117] "RemoveContainer" containerID="93cb191bc541137b0dd205048db662be7626c2f94be0a4230ce519eee6e1f114"
Jul 10 13:50:18.811115 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.811093    2570 generic.go:356] "Generic (PLEG): container finished" podID="91e74545-39ab-4daa-b982-29863646464d" containerID="e504b4c3cfd5954f1ffd1b691cf16081184773611e680c87c7a63bb3be1714d4" exitCode=0
Jul 10 13:50:18.811253 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.811122    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" event={"ID":"91e74545-39ab-4daa-b982-29863646464d","Type":"ContainerDied","Data":"e504b4c3cfd5954f1ffd1b691cf16081184773611e680c87c7a63bb3be1714d4"}
Jul 10 13:50:18.826521 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:18.826499    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:50:19.817319 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:19.817293    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 13:50:19.817893 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:19.817638    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" event={"ID":"4f39dfb1-4d93-4c39-8ea9-db64ca0beab7","Type":"ContainerStarted","Data":"7bff7c265a9dac836efc99cdd1cfd9c9c5259a0fd318afdee3be5d727b802e44"}
Jul 10 13:50:19.818057 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:19.818030    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:50:19.818189 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:19.818114    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:50:19.832924 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:19.832901    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:50:19.886295 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:19.886252    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r" podStartSLOduration=8.021295011 podStartE2EDuration="27.886233248s" totalImagesPullingTime="19.864938237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:19.883379467 +0000 UTC m=+28.800423730" watchObservedRunningTime="2026-07-10 13:50:19.886233248 +0000 UTC m=+28.803277513"
Jul 10 13:50:20.552611 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:20.552382    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sk4fp"]
Jul 10 13:50:20.552833 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:20.552674    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:20.552833 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:20.552798    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:20.555147 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:20.555125    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-549nd"]
Jul 10 13:50:20.555255 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:20.555233    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:20.555357 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:20.555339    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:20.559103 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:20.559078    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-prwb4"]
Jul 10 13:50:20.559220 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:20.559198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:20.559288 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:20.559269    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:20.821818 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:20.821758    2570 generic.go:356] "Generic (PLEG): container finished" podID="91e74545-39ab-4daa-b982-29863646464d" containerID="9ff7f0a95450edb4250fae81d5216bf58dd8d4d0d525fd39617bad19d6fa0b8e" exitCode=0
Jul 10 13:50:20.822125 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:20.821834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" event={"ID":"91e74545-39ab-4daa-b982-29863646464d","Type":"ContainerDied","Data":"9ff7f0a95450edb4250fae81d5216bf58dd8d4d0d525fd39617bad19d6fa0b8e"}
Jul 10 13:50:22.559070 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:22.559033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:22.559547 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:22.559146    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:22.559547 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:22.559159    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:22.559547 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:22.559155    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:22.559547 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:22.559258    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:22.559547 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:22.559339    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:22.828610 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:22.828582    2570 generic.go:356] "Generic (PLEG): container finished" podID="91e74545-39ab-4daa-b982-29863646464d" containerID="a00a8f6560741f4b85c1e5fea1491fd82dce5ae822079c0a150ddbac85b8d712" exitCode=0
Jul 10 13:50:22.828724 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:22.828620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" event={"ID":"91e74545-39ab-4daa-b982-29863646464d","Type":"ContainerDied","Data":"a00a8f6560741f4b85c1e5fea1491fd82dce5ae822079c0a150ddbac85b8d712"}
Jul 10 13:50:24.356460 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:24.356377    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:24.356460 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:24.356426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.356528    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.356531    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:24.356536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.356586    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs podName:d3c684fd-d02f-4c53-8fc9-cc47672828d9 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:56.356569257 +0000 UTC m=+65.273613518 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs") pod "network-metrics-daemon-549nd" (UID: "d3c684fd-d02f-4c53-8fc9-cc47672828d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.356607    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret podName:40cfbc71-878d-418c-945e-2295a16948a4 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:56.356598063 +0000 UTC m=+65.273642303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret") pod "global-pull-secret-syncer-sk4fp" (UID: "40cfbc71-878d-418c-945e-2295a16948a4") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.356613    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.356632    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.356643    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4s6xd for pod openshift-network-diagnostics/network-check-target-prwb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:24.356977 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.356675    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd podName:f2442db3-fb9a-48c7-90c1-9be238c07f89 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:56.356665413 +0000 UTC m=+65.273709665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4s6xd" (UniqueName: "kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd") pod "network-check-target-prwb4" (UID: "f2442db3-fb9a-48c7-90c1-9be238c07f89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:24.559832 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:24.559800    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:24.559832 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:24.559831    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:24.560065 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.559915    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sk4fp" podUID="40cfbc71-878d-418c-945e-2295a16948a4"
Jul 10 13:50:24.560065 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:24.559959    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:24.560154 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.560073    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prwb4" podUID="f2442db3-fb9a-48c7-90c1-9be238c07f89"
Jul 10 13:50:24.560191 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:24.560145    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-549nd" podUID="d3c684fd-d02f-4c53-8fc9-cc47672828d9"
Jul 10 13:50:25.908468 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.908432    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeReady"
Jul 10 13:50:25.908930 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.908591    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 13:50:25.965855 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.965822    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-965d67f94-pndj4"]
Jul 10 13:50:25.968718 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.968699    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:25.971489 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.971466    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r8g5k\""
Jul 10 13:50:25.971607 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.971466    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 13:50:25.971607 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.971466    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 13:50:25.971607 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.971534    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 13:50:25.977721 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.977700    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 13:50:25.985963 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:25.985940    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-965d67f94-pndj4"]
Jul 10 13:50:26.069275 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.069238    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9xh\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-kube-api-access-wm9xh\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.069459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.069279    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-bound-sa-token\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.069459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.069363    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-image-registry-private-configuration\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.069459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.069404    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.069459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.069427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-installation-pull-secrets\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.069644 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.069463    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa29fd87-1528-4ed8-9706-27e5f0cf680d-ca-trust-extracted\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.069644 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.069490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-trusted-ca\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.069644 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.069521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-certificates\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.136921 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.136888    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cg7wr"]
Jul 10 13:50:26.139096 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.139072    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.145474 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.145443    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 13:50:26.145601 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.145478    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j6zkp\""
Jul 10 13:50:26.145971 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.145951    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 13:50:26.165030 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.164972    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cg7wr"]
Jul 10 13:50:26.170310 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.170290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-certificates\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.170416 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.170336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9xh\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-kube-api-access-wm9xh\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.170475 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.170459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-bound-sa-token\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.170538 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.170520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-image-registry-private-configuration\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.170601 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.170559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.170601 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.170584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-installation-pull-secrets\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.170707 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.170626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa29fd87-1528-4ed8-9706-27e5f0cf680d-ca-trust-extracted\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.170707 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.170656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-trusted-ca\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.171039 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.171013    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-certificates\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.171460 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.171439    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:50:26.171460 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.171461    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-965d67f94-pndj4: secret "image-registry-tls" not found
Jul 10 13:50:26.171594 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.171517    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls podName:aa29fd87-1528-4ed8-9706-27e5f0cf680d nodeName:}" failed. No retries permitted until 2026-07-10 13:50:26.671499579 +0000 UTC m=+35.588543837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls") pod "image-registry-965d67f94-pndj4" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d") : secret "image-registry-tls" not found
Jul 10 13:50:26.171874 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.171826    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa29fd87-1528-4ed8-9706-27e5f0cf680d-ca-trust-extracted\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.172186 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.172169    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-trusted-ca\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.175886 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.175864    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-image-registry-private-configuration\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.175991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.175865    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-installation-pull-secrets\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.192157 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.192137    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-bound-sa-token\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.192375 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.192350    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9xh\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-kube-api-access-wm9xh\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.234317 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.234101    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bbtl9"]
Jul 10 13:50:26.237896 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.237872    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbtl9"
Jul 10 13:50:26.245713 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.245694    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 13:50:26.245864 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.245783    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 13:50:26.246058 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.246014    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9rbnh\""
Jul 10 13:50:26.246209 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.246195    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 13:50:26.250774 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.250732    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbtl9"]
Jul 10 13:50:26.271622 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.271594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct8rl\" (UniqueName: \"kubernetes.io/projected/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-kube-api-access-ct8rl\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.271770 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.271630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.271831 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.271783    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-tmp-dir\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.271930 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.271852    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-config-volume\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.372437 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.372399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-tmp-dir\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.372645 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.372483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-config-volume\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.372645 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.372514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b2471f5-2960-4f0b-aa67-d6a016d9b6d3-cert\") pod \"ingress-canary-bbtl9\" (UID: \"9b2471f5-2960-4f0b-aa67-d6a016d9b6d3\") " pod="openshift-ingress-canary/ingress-canary-bbtl9"
Jul 10 13:50:26.372645 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.372548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct8rl\" (UniqueName: \"kubernetes.io/projected/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-kube-api-access-ct8rl\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.372645 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.372573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzdk5\" (UniqueName: \"kubernetes.io/projected/9b2471f5-2960-4f0b-aa67-d6a016d9b6d3-kube-api-access-vzdk5\") pod \"ingress-canary-bbtl9\" (UID: \"9b2471f5-2960-4f0b-aa67-d6a016d9b6d3\") " pod="openshift-ingress-canary/ingress-canary-bbtl9"
Jul 10 13:50:26.372861 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.372706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.372861 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.372778    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-tmp-dir\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.372861 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.372850    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:50:26.372967 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.372914    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls podName:b5fb2df7-1f6c-494a-8938-5ab22fc38cb3 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:26.872894658 +0000 UTC m=+35.789938915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls") pod "dns-default-cg7wr" (UID: "b5fb2df7-1f6c-494a-8938-5ab22fc38cb3") : secret "dns-default-metrics-tls" not found
Jul 10 13:50:26.373215 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.373188    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-config-volume\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.390653 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.390624    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct8rl\" (UniqueName: \"kubernetes.io/projected/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-kube-api-access-ct8rl\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.473396 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.473310    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b2471f5-2960-4f0b-aa67-d6a016d9b6d3-cert\") pod \"ingress-canary-bbtl9\" (UID: \"9b2471f5-2960-4f0b-aa67-d6a016d9b6d3\") " pod="openshift-ingress-canary/ingress-canary-bbtl9"
Jul 10 13:50:26.473396 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.473361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzdk5\" (UniqueName: \"kubernetes.io/projected/9b2471f5-2960-4f0b-aa67-d6a016d9b6d3-kube-api-access-vzdk5\") pod \"ingress-canary-bbtl9\" (UID: \"9b2471f5-2960-4f0b-aa67-d6a016d9b6d3\") " pod="openshift-ingress-canary/ingress-canary-bbtl9"
Jul 10 13:50:26.476153 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.476124    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b2471f5-2960-4f0b-aa67-d6a016d9b6d3-cert\") pod \"ingress-canary-bbtl9\" (UID: \"9b2471f5-2960-4f0b-aa67-d6a016d9b6d3\") " pod="openshift-ingress-canary/ingress-canary-bbtl9"
Jul 10 13:50:26.485389 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.485351    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzdk5\" (UniqueName: \"kubernetes.io/projected/9b2471f5-2960-4f0b-aa67-d6a016d9b6d3-kube-api-access-vzdk5\") pod \"ingress-canary-bbtl9\" (UID: \"9b2471f5-2960-4f0b-aa67-d6a016d9b6d3\") " pod="openshift-ingress-canary/ingress-canary-bbtl9"
Jul 10 13:50:26.548292 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.548264    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbtl9"
Jul 10 13:50:26.559887 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.559820    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:26.560003 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.559820    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:26.560056 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.559820    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:26.566276 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.566252    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 13:50:26.566408 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.566289    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 13:50:26.566408 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.566369    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 13:50:26.566577 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.566560    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 13:50:26.566653 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.566642    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nwfk\""
Jul 10 13:50:26.566711 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.566647    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-snqnd\""
Jul 10 13:50:26.674949 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.674909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:26.675074 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.675054    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:50:26.675117 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.675076    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-965d67f94-pndj4: secret "image-registry-tls" not found
Jul 10 13:50:26.675164 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.675128    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls podName:aa29fd87-1528-4ed8-9706-27e5f0cf680d nodeName:}" failed. No retries permitted until 2026-07-10 13:50:27.675111448 +0000 UTC m=+36.592155690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls") pod "image-registry-965d67f94-pndj4" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d") : secret "image-registry-tls" not found
Jul 10 13:50:26.877238 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:26.877163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:26.877383 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.877296    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:50:26.877383 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:26.877357    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls podName:b5fb2df7-1f6c-494a-8938-5ab22fc38cb3 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:27.877339834 +0000 UTC m=+36.794384076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls") pod "dns-default-cg7wr" (UID: "b5fb2df7-1f6c-494a-8938-5ab22fc38cb3") : secret "dns-default-metrics-tls" not found
Jul 10 13:50:27.020047 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:27.020022    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbtl9"]
Jul 10 13:50:27.024464 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:50:27.024440    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2471f5_2960_4f0b_aa67_d6a016d9b6d3.slice/crio-8f89b55a278b489e07348cbb1bcadad745f293a8c3c8aaf25a00da26dfb3ecaa WatchSource:0}: Error finding container 8f89b55a278b489e07348cbb1bcadad745f293a8c3c8aaf25a00da26dfb3ecaa: Status 404 returned error can't find the container with id 8f89b55a278b489e07348cbb1bcadad745f293a8c3c8aaf25a00da26dfb3ecaa
Jul 10 13:50:27.681995 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:27.681966    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:27.682135 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:27.682099    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:50:27.682135 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:27.682114    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-965d67f94-pndj4: secret "image-registry-tls" not found
Jul 10 13:50:27.682200 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:27.682166    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls podName:aa29fd87-1528-4ed8-9706-27e5f0cf680d nodeName:}" failed. No retries permitted until 2026-07-10 13:50:29.682148988 +0000 UTC m=+38.599193242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls") pod "image-registry-965d67f94-pndj4" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d") : secret "image-registry-tls" not found
Jul 10 13:50:27.843564 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:27.843538    2570 generic.go:356] "Generic (PLEG): container finished" podID="91e74545-39ab-4daa-b982-29863646464d" containerID="719ee715c0b894aca54fedd9ec0d3bdd42b73da5b3008bb1d9fb2a6cc5b6919d" exitCode=0
Jul 10 13:50:27.843712 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:27.843606    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" event={"ID":"91e74545-39ab-4daa-b982-29863646464d","Type":"ContainerDied","Data":"719ee715c0b894aca54fedd9ec0d3bdd42b73da5b3008bb1d9fb2a6cc5b6919d"}
Jul 10 13:50:27.844763 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:27.844726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbtl9" event={"ID":"9b2471f5-2960-4f0b-aa67-d6a016d9b6d3","Type":"ContainerStarted","Data":"8f89b55a278b489e07348cbb1bcadad745f293a8c3c8aaf25a00da26dfb3ecaa"}
Jul 10 13:50:27.884424 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:27.884399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:27.884571 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:27.884553    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:50:27.884633 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:27.884622    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls podName:b5fb2df7-1f6c-494a-8938-5ab22fc38cb3 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:29.884602514 +0000 UTC m=+38.801646772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls") pod "dns-default-cg7wr" (UID: "b5fb2df7-1f6c-494a-8938-5ab22fc38cb3") : secret "dns-default-metrics-tls" not found
Jul 10 13:50:28.849321 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:28.849287    2570 generic.go:356] "Generic (PLEG): container finished" podID="91e74545-39ab-4daa-b982-29863646464d" containerID="7b2582e7bba26f8c583b290673f440c312d2f9bb9fae1d14220abc93d0bc29f4" exitCode=0
Jul 10 13:50:28.849739 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:28.849351    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" event={"ID":"91e74545-39ab-4daa-b982-29863646464d","Type":"ContainerDied","Data":"7b2582e7bba26f8c583b290673f440c312d2f9bb9fae1d14220abc93d0bc29f4"}
Jul 10 13:50:29.700286 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:29.700049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:29.700451 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:29.700235    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:50:29.700451 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:29.700368    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-965d67f94-pndj4: secret "image-registry-tls" not found
Jul 10 13:50:29.700451 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:29.700431    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls podName:aa29fd87-1528-4ed8-9706-27e5f0cf680d nodeName:}" failed. No retries permitted until 2026-07-10 13:50:33.700413752 +0000 UTC m=+42.617458013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls") pod "image-registry-965d67f94-pndj4" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d") : secret "image-registry-tls" not found
Jul 10 13:50:29.854523 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:29.854492    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" event={"ID":"91e74545-39ab-4daa-b982-29863646464d","Type":"ContainerStarted","Data":"2fdb3ee386ad5ecf2f7947ff5a67b709508340e880b25c73c286b8ba492bdb5a"}
Jul 10 13:50:29.883591 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:29.883541    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x4kjg" podStartSLOduration=7.658691123 podStartE2EDuration="38.883526039s" totalImagesPullingTime="31.224834916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:29.883291588 +0000 UTC m=+38.800335846" watchObservedRunningTime="2026-07-10 13:50:29.883526039 +0000 UTC m=+38.800570303"
Jul 10 13:50:29.905759 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:29.904571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:29.905759 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:29.904800    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:50:29.905759 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:29.904864    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls podName:b5fb2df7-1f6c-494a-8938-5ab22fc38cb3 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:33.904846337 +0000 UTC m=+42.821890590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls") pod "dns-default-cg7wr" (UID: "b5fb2df7-1f6c-494a-8938-5ab22fc38cb3") : secret "dns-default-metrics-tls" not found
Jul 10 13:50:30.858088 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:30.858051    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbtl9" event={"ID":"9b2471f5-2960-4f0b-aa67-d6a016d9b6d3","Type":"ContainerStarted","Data":"010d68ee1f00f02526c317791a3637dde3e2f3ead4257099f2e6c0e395e6b535"}
Jul 10 13:50:30.885092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:30.885049    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bbtl9" podStartSLOduration=1.9483386010000001 podStartE2EDuration="4.885034953s" totalImagesPullingTime="2.936696352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:30.884672717 +0000 UTC m=+39.801716980" watchObservedRunningTime="2026-07-10 13:50:30.885034953 +0000 UTC m=+39.802079216"
Jul 10 13:50:33.731064 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:33.731026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:33.731479 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:33.731180    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:50:33.731479 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:33.731199    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-965d67f94-pndj4: secret "image-registry-tls" not found
Jul 10 13:50:33.731479 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:33.731249    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls podName:aa29fd87-1528-4ed8-9706-27e5f0cf680d nodeName:}" failed. No retries permitted until 2026-07-10 13:50:41.731234494 +0000 UTC m=+50.648278756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls") pod "image-registry-965d67f94-pndj4" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d") : secret "image-registry-tls" not found
Jul 10 13:50:33.932460 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:33.932429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:33.932592 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:33.932539    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:50:33.932592 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:33.932584    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls podName:b5fb2df7-1f6c-494a-8938-5ab22fc38cb3 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:41.932572465 +0000 UTC m=+50.849616706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls") pod "dns-default-cg7wr" (UID: "b5fb2df7-1f6c-494a-8938-5ab22fc38cb3") : secret "dns-default-metrics-tls" not found
Jul 10 13:50:41.780407 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:41.780372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:41.780851 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:41.780523    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:50:41.780851 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:41.780541    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-965d67f94-pndj4: secret "image-registry-tls" not found
Jul 10 13:50:41.780851 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:41.780590    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls podName:aa29fd87-1528-4ed8-9706-27e5f0cf680d nodeName:}" failed. No retries permitted until 2026-07-10 13:50:57.780576204 +0000 UTC m=+66.697620444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls") pod "image-registry-965d67f94-pndj4" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d") : secret "image-registry-tls" not found
Jul 10 13:50:41.981890 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:41.981862    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:41.982027 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:41.982009    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:50:41.982081 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:41.982071    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls podName:b5fb2df7-1f6c-494a-8938-5ab22fc38cb3 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:57.982058258 +0000 UTC m=+66.899102498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls") pod "dns-default-cg7wr" (UID: "b5fb2df7-1f6c-494a-8938-5ab22fc38cb3") : secret "dns-default-metrics-tls" not found
Jul 10 13:50:51.844353 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:51.844327    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjz4r"
Jul 10 13:50:56.375072 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.375036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:56.375072 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.375080    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:50:56.375501 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.375104    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:56.381985 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.381963    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 13:50:56.382095 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.382076    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 13:50:56.382290 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.382275    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 13:50:56.385796 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:56.385774    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 13:50:56.385875 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:56.385861    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs podName:d3c684fd-d02f-4c53-8fc9-cc47672828d9 nodeName:}" failed. No retries permitted until 2026-07-10 13:52:00.385840683 +0000 UTC m=+129.302884939 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs") pod "network-metrics-daemon-549nd" (UID: "d3c684fd-d02f-4c53-8fc9-cc47672828d9") : secret "metrics-daemon-secret" not found
Jul 10 13:50:56.388710 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.388692    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40cfbc71-878d-418c-945e-2295a16948a4-original-pull-secret\") pod \"global-pull-secret-syncer-sk4fp\" (UID: \"40cfbc71-878d-418c-945e-2295a16948a4\") " pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:56.390397 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.390380    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 13:50:56.398327 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.398308    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s6xd\" (UniqueName: \"kubernetes.io/projected/f2442db3-fb9a-48c7-90c1-9be238c07f89-kube-api-access-4s6xd\") pod \"network-check-target-prwb4\" (UID: \"f2442db3-fb9a-48c7-90c1-9be238c07f89\") " pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:56.579474 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.579447    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sk4fp"
Jul 10 13:50:56.586700 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.586680    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-snqnd\""
Jul 10 13:50:56.594884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.594857    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:50:56.710825 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.710798    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sk4fp"]
Jul 10 13:50:56.713720 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:50:56.713695    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cfbc71_878d_418c_945e_2295a16948a4.slice/crio-148985f72f5b0c21c2d113d38523c1d98f033d1a201d503ce59a387ad317af38 WatchSource:0}: Error finding container 148985f72f5b0c21c2d113d38523c1d98f033d1a201d503ce59a387ad317af38: Status 404 returned error can't find the container with id 148985f72f5b0c21c2d113d38523c1d98f033d1a201d503ce59a387ad317af38
Jul 10 13:50:56.725306 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.725283    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-prwb4"]
Jul 10 13:50:56.727692 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:50:56.727674    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2442db3_fb9a_48c7_90c1_9be238c07f89.slice/crio-1f03ef7b42b929d749cba2d1a7d0991fd0ef1d9cb7d6e3cfbeee2c62519411cd WatchSource:0}: Error finding container 1f03ef7b42b929d749cba2d1a7d0991fd0ef1d9cb7d6e3cfbeee2c62519411cd: Status 404 returned error can't find the container with id 1f03ef7b42b929d749cba2d1a7d0991fd0ef1d9cb7d6e3cfbeee2c62519411cd
Jul 10 13:50:56.915664 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.915583    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sk4fp" event={"ID":"40cfbc71-878d-418c-945e-2295a16948a4","Type":"ContainerStarted","Data":"148985f72f5b0c21c2d113d38523c1d98f033d1a201d503ce59a387ad317af38"}
Jul 10 13:50:56.916598 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:56.916572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-prwb4" event={"ID":"f2442db3-fb9a-48c7-90c1-9be238c07f89","Type":"ContainerStarted","Data":"1f03ef7b42b929d749cba2d1a7d0991fd0ef1d9cb7d6e3cfbeee2c62519411cd"}
Jul 10 13:50:57.784462 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:57.784418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:50:57.784924 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:57.784595    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:50:57.784924 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:57.784611    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-965d67f94-pndj4: secret "image-registry-tls" not found
Jul 10 13:50:57.784924 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:57.784675    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls podName:aa29fd87-1528-4ed8-9706-27e5f0cf680d nodeName:}" failed. No retries permitted until 2026-07-10 13:51:29.784655297 +0000 UTC m=+98.701699558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls") pod "image-registry-965d67f94-pndj4" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d") : secret "image-registry-tls" not found
Jul 10 13:50:57.985619 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:50:57.985585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:50:57.985838 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:57.985787    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:50:57.985916 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:50:57.985897    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls podName:b5fb2df7-1f6c-494a-8938-5ab22fc38cb3 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:29.985874955 +0000 UTC m=+98.902919196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls") pod "dns-default-cg7wr" (UID: "b5fb2df7-1f6c-494a-8938-5ab22fc38cb3") : secret "dns-default-metrics-tls" not found
Jul 10 13:51:01.930669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.930566    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sk4fp" event={"ID":"40cfbc71-878d-418c-945e-2295a16948a4","Type":"ContainerStarted","Data":"75c3f597149dca1823542a3211fd8384ee6f2fe0018006c1fd911f71edbf0932"}
Jul 10 13:51:01.931942 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.931918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-prwb4" event={"ID":"f2442db3-fb9a-48c7-90c1-9be238c07f89","Type":"ContainerStarted","Data":"176fdc557256b4378f6ef974d0936a0694c326a28587115d87b36ec1ca6ca8dd"}
Jul 10 13:51:01.932056 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.932040    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:51:01.952565 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.952518    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sk4fp" podStartSLOduration=65.140598659 podStartE2EDuration="1m9.952503364s" totalImagesPullingTime="4.811904705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:01.951663258 +0000 UTC m=+70.868707521" watchObservedRunningTime="2026-07-10 13:51:01.952503364 +0000 UTC m=+70.869547627"
Jul 10 13:51:01.965189 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.965163    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c5775766-brv7z"]
Jul 10 13:51:01.966816 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.966795    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:01.969079 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.969060    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 10 13:51:01.969221 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.969207    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 10 13:51:01.969467 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.969446    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 13:51:01.969533 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.969453    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 13:51:01.970043 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.970026    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9dp5t\""
Jul 10 13:51:01.970302 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.970285    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 10 13:51:01.970401 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.970384    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 10 13:51:01.974983 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.974932    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-prwb4" podStartSLOduration=65.188003898 podStartE2EDuration="1m9.974911851s" totalImagesPullingTime="4.786907953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:01.973858774 +0000 UTC m=+70.890903037" watchObservedRunningTime="2026-07-10 13:51:01.974911851 +0000 UTC m=+70.891956117"
Jul 10 13:51:01.992221 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:01.991267    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c5775766-brv7z"]
Jul 10 13:51:02.014357 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.014324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-stats-auth\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.014523 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.014367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.014590 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.014527    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.014646 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.014586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lrvq\" (UniqueName: \"kubernetes.io/projected/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-kube-api-access-8lrvq\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.014706 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.014650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-default-certificate\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.115469 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.115435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-default-certificate\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.115629 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.115538    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-stats-auth\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.115629 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.115575    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.115629 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.115602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.115629 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.115626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lrvq\" (UniqueName: \"kubernetes.io/projected/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-kube-api-access-8lrvq\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.115852 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:02.115708    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 13:51:02.115852 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:02.115846    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:02.615741282 +0000 UTC m=+71.532785522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : configmap references non-existent config key: service-ca.crt
Jul 10 13:51:02.115933 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:02.115871    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:02.615861045 +0000 UTC m=+71.532905286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : secret "router-metrics-certs-default" not found
Jul 10 13:51:02.118092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.118062    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-stats-auth\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.118197 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.118062    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-default-certificate\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.128223 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.128200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lrvq\" (UniqueName: \"kubernetes.io/projected/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-kube-api-access-8lrvq\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.618403 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.618363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.618403 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:02.618407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:02.618684 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:02.618523    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 13:51:02.618684 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:02.618532    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:03.618519383 +0000 UTC m=+72.535563637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : configmap references non-existent config key: service-ca.crt
Jul 10 13:51:02.618684 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:02.618634    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:03.618623671 +0000 UTC m=+72.535667912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : secret "router-metrics-certs-default" not found
Jul 10 13:51:03.626809 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:03.626761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:03.626809 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:03.626809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:03.627219 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:03.626898    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 13:51:03.627219 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:03.626954    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:05.626937568 +0000 UTC m=+74.543981828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : secret "router-metrics-certs-default" not found
Jul 10 13:51:03.627219 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:03.626968    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:05.626961477 +0000 UTC m=+74.544005717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : configmap references non-existent config key: service-ca.crt
Jul 10 13:51:05.640187 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:05.640148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:05.640187 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:05.640193    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:05.640656 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:05.640300    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:09.640287699 +0000 UTC m=+78.557331939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : configmap references non-existent config key: service-ca.crt
Jul 10 13:51:05.640656 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:05.640314    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 13:51:05.640656 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:05.640377    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:09.640359867 +0000 UTC m=+78.557404127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : secret "router-metrics-certs-default" not found
Jul 10 13:51:06.886045 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.886010    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8sxd6"]
Jul 10 13:51:06.887940 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.887923    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:06.889871 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.889848    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 13:51:06.889999 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.889985    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 13:51:06.890325 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.890309    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 13:51:06.890462 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.890448    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 13:51:06.890829 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.890812    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xrxqc\""
Jul 10 13:51:06.907644 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.907620    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8sxd6"]
Jul 10 13:51:06.950077 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.950053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:06.950167 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.950090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41cd8e57-350c-4802-8811-12561af5b788-data-volume\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:06.950167 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.950111    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41cd8e57-350c-4802-8811-12561af5b788-crio-socket\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:06.950167 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.950157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g8q4\" (UniqueName: \"kubernetes.io/projected/41cd8e57-350c-4802-8811-12561af5b788-kube-api-access-6g8q4\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:06.950276 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:06.950194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.051482 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.051459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.051567 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.051528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.051567 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.051560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41cd8e57-350c-4802-8811-12561af5b788-data-volume\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.051632 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:07.051568    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:07.051632 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.051577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41cd8e57-350c-4802-8811-12561af5b788-crio-socket\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.051632 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.051593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g8q4\" (UniqueName: \"kubernetes.io/projected/41cd8e57-350c-4802-8811-12561af5b788-kube-api-access-6g8q4\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.051632 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:07.051621    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:07.551603146 +0000 UTC m=+76.468647400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:07.051803 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:07.051682    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:07.051803 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.051685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41cd8e57-350c-4802-8811-12561af5b788-crio-socket\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.051803 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:07.051732    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:07.551717552 +0000 UTC m=+76.468761794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:07.051908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.051889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41cd8e57-350c-4802-8811-12561af5b788-data-volume\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.061549 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.061530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g8q4\" (UniqueName: \"kubernetes.io/projected/41cd8e57-350c-4802-8811-12561af5b788-kube-api-access-6g8q4\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.555118 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.555076    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.555297 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:07.555181    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:07.555297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:07.555185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:07.555297 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:07.555229    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:08.555216129 +0000 UTC m=+77.472260370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:07.555446 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:07.555303    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:07.555446 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:07.555358    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:08.555342474 +0000 UTC m=+77.472386717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:08.562608 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:08.562576    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:08.562999 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:08.562676    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:08.562999 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:08.562694    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:08.562999 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:08.562782    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:10.562763545 +0000 UTC m=+79.479807800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:08.562999 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:08.562812    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:08.562999 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:08.562849    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:10.562838046 +0000 UTC m=+79.479882302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:08.687147 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:08.687121    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4bdfh_15689ad4-e290-448d-829a-d3ed091b3f1d/dns-node-resolver/0.log"
Jul 10 13:51:09.670805 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:09.670734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:09.670805 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:09.670811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:09.671212 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:09.670872    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 13:51:09.671212 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:09.670931    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:17.670917 +0000 UTC m=+86.587961241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : secret "router-metrics-certs-default" not found
Jul 10 13:51:09.671212 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:09.670945    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:17.670939087 +0000 UTC m=+86.587983327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : configmap references non-existent config key: service-ca.crt
Jul 10 13:51:09.886400 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:09.886370    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nb27n_b18c367d-8164-49e8-a5e0-22e6759da098/node-ca/0.log"
Jul 10 13:51:10.486559 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:10.486532    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbtl9_9b2471f5-2960-4f0b-aa67-d6a016d9b6d3/serve-healthcheck-canary/0.log"
Jul 10 13:51:10.578191 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:10.578141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:10.578353 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:10.578214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:10.578353 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:10.578299    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:10.578440 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:10.578358    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:14.578343526 +0000 UTC m=+83.495387770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:10.578440 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:10.578308    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:10.578440 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:10.578429    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:14.578416519 +0000 UTC m=+83.495460761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:14.608927 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:14.608807    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:14.608927 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:14.608892    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:14.609328 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:14.608938    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:14.609328 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:14.608987    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:14.609328 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:14.609027    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:22.609008555 +0000 UTC m=+91.526052821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:14.609328 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:14.609044    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:22.609037169 +0000 UTC m=+91.526081410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:17.732138 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:17.732084    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:17.732138 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:17.732137    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:17.732585 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:17.732224    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 13:51:17.732585 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:17.732278    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:33.732265216 +0000 UTC m=+102.649309456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : configmap references non-existent config key: service-ca.crt
Jul 10 13:51:17.732585 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:17.732292    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs podName:d60bfbb9-096b-4bec-bc9d-0e8359dc1381 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:33.732285656 +0000 UTC m=+102.649329897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs") pod "router-default-7c5775766-brv7z" (UID: "d60bfbb9-096b-4bec-bc9d-0e8359dc1381") : secret "router-metrics-certs-default" not found
Jul 10 13:51:22.668701 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:22.668666    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:22.669200 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:22.668739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:22.669200 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:22.668831    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:22.669200 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:22.668905    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls podName:41cd8e57-350c-4802-8811-12561af5b788 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:38.66888907 +0000 UTC m=+107.585933311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8sxd6" (UID: "41cd8e57-350c-4802-8811-12561af5b788") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:22.669380 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:22.669330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41cd8e57-350c-4802-8811-12561af5b788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:29.823595 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:29.823558    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:51:29.825831 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:29.825798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"image-registry-965d67f94-pndj4\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") " pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:51:29.887520 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:29.887496    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r8g5k\""
Jul 10 13:51:29.890606 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:29.890593    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:51:30.019549 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:30.019522    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-965d67f94-pndj4"]
Jul 10 13:51:30.022729 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:30.022703    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa29fd87_1528_4ed8_9706_27e5f0cf680d.slice/crio-0a8db54b258b66b761e78d54f18009f8b663a7ab84517b09bb6252fef1fbb62a WatchSource:0}: Error finding container 0a8db54b258b66b761e78d54f18009f8b663a7ab84517b09bb6252fef1fbb62a: Status 404 returned error can't find the container with id 0a8db54b258b66b761e78d54f18009f8b663a7ab84517b09bb6252fef1fbb62a
Jul 10 13:51:30.025055 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:30.025027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:51:30.027282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:30.027261    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5fb2df7-1f6c-494a-8938-5ab22fc38cb3-metrics-tls\") pod \"dns-default-cg7wr\" (UID: \"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3\") " pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:51:30.051574 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:30.051554    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j6zkp\""
Jul 10 13:51:30.059412 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:30.059395    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:51:30.196388 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:30.196361    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cg7wr"]
Jul 10 13:51:30.199279 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:30.199246    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5fb2df7_1f6c_494a_8938_5ab22fc38cb3.slice/crio-33a6473b0ebf1ffc781ee48a41bdc56c5296768e6d30f79cd5580dfc2aeb7434 WatchSource:0}: Error finding container 33a6473b0ebf1ffc781ee48a41bdc56c5296768e6d30f79cd5580dfc2aeb7434: Status 404 returned error can't find the container with id 33a6473b0ebf1ffc781ee48a41bdc56c5296768e6d30f79cd5580dfc2aeb7434
Jul 10 13:51:31.001949 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:31.001918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-965d67f94-pndj4" event={"ID":"aa29fd87-1528-4ed8-9706-27e5f0cf680d","Type":"ContainerStarted","Data":"1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410"}
Jul 10 13:51:31.002389 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:31.001975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-965d67f94-pndj4" event={"ID":"aa29fd87-1528-4ed8-9706-27e5f0cf680d","Type":"ContainerStarted","Data":"0a8db54b258b66b761e78d54f18009f8b663a7ab84517b09bb6252fef1fbb62a"}
Jul 10 13:51:31.002389 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:31.002004    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:51:31.003028 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:31.003006    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cg7wr" event={"ID":"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3","Type":"ContainerStarted","Data":"33a6473b0ebf1ffc781ee48a41bdc56c5296768e6d30f79cd5580dfc2aeb7434"}
Jul 10 13:51:31.040311 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:31.040266    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-965d67f94-pndj4" podStartSLOduration=99.040250866 podStartE2EDuration="1m39.040250866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:31.038908621 +0000 UTC m=+99.955952884" watchObservedRunningTime="2026-07-10 13:51:31.040250866 +0000 UTC m=+99.957295128"
Jul 10 13:51:32.936639 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:32.936566    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-prwb4"
Jul 10 13:51:33.009504 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.009471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cg7wr" event={"ID":"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3","Type":"ContainerStarted","Data":"d6c4573a7ecd81dbc6dca1c3ebf42e6951244c68e12eb66ce88f1613a63b3ffa"}
Jul 10 13:51:33.009669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.009516    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cg7wr" event={"ID":"b5fb2df7-1f6c-494a-8938-5ab22fc38cb3","Type":"ContainerStarted","Data":"b6fb6fd461964627db2e25fd27fa963451c0ff67140fb5ccfb7d614f52efd3f4"}
Jul 10 13:51:33.009669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.009618    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:51:33.030464 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.030410    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cg7wr" podStartSLOduration=64.663272995 podStartE2EDuration="1m7.03039647s" totalImagesPullingTime="2.367123475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:33.030278427 +0000 UTC m=+101.947322693" watchObservedRunningTime="2026-07-10 13:51:33.03039647 +0000 UTC m=+101.947440732"
Jul 10 13:51:33.754954 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.754919    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:33.754954 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.754956    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:33.755553 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.755526    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-service-ca-bundle\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:33.757386 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.757367    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60bfbb9-096b-4bec-bc9d-0e8359dc1381-metrics-certs\") pod \"router-default-7c5775766-brv7z\" (UID: \"d60bfbb9-096b-4bec-bc9d-0e8359dc1381\") " pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:33.776391 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.776366    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:33.921390 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:33.921364    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c5775766-brv7z"]
Jul 10 13:51:33.923939 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:33.923912    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60bfbb9_096b_4bec_bc9d_0e8359dc1381.slice/crio-e1f65eecebb9599ee12bf678262beab2ddafe49450653a9b1217d6f55559ae90 WatchSource:0}: Error finding container e1f65eecebb9599ee12bf678262beab2ddafe49450653a9b1217d6f55559ae90: Status 404 returned error can't find the container with id e1f65eecebb9599ee12bf678262beab2ddafe49450653a9b1217d6f55559ae90
Jul 10 13:51:34.015384 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:34.015316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c5775766-brv7z" event={"ID":"d60bfbb9-096b-4bec-bc9d-0e8359dc1381","Type":"ContainerStarted","Data":"938a2dfad3a911a342d86c8bea9f55bcf2af1b02d36c3e1c516616c5dfaa2cc8"}
Jul 10 13:51:34.015384 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:34.015369    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c5775766-brv7z" event={"ID":"d60bfbb9-096b-4bec-bc9d-0e8359dc1381","Type":"ContainerStarted","Data":"e1f65eecebb9599ee12bf678262beab2ddafe49450653a9b1217d6f55559ae90"}
Jul 10 13:51:34.039989 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:34.039737    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c5775766-brv7z" podStartSLOduration=33.039716478 podStartE2EDuration="33.039716478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:34.039250827 +0000 UTC m=+102.956295091" watchObservedRunningTime="2026-07-10 13:51:34.039716478 +0000 UTC m=+102.956760737"
Jul 10 13:51:34.777179 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:34.777146    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:34.780582 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:34.780557    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:35.018783 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:35.018735    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:35.019920 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:35.019898    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c5775766-brv7z"
Jul 10 13:51:38.686071 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.686037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:38.688334 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.688313    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41cd8e57-350c-4802-8811-12561af5b788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8sxd6\" (UID: \"41cd8e57-350c-4802-8811-12561af5b788\") " pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:38.697033 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.697010    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8sxd6"
Jul 10 13:51:38.851622 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.851594    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8sxd6"]
Jul 10 13:51:38.854758 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:38.854710    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41cd8e57_350c_4802_8811_12561af5b788.slice/crio-c22976ffa9858c799960f644f54a2b224f50d658044aca1c0779a293aaae93b3 WatchSource:0}: Error finding container c22976ffa9858c799960f644f54a2b224f50d658044aca1c0779a293aaae93b3: Status 404 returned error can't find the container with id c22976ffa9858c799960f644f54a2b224f50d658044aca1c0779a293aaae93b3
Jul 10 13:51:38.980987 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.980958    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"]
Jul 10 13:51:38.983286 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.983252    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"
Jul 10 13:51:38.986000 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.985734    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ndlcw\""
Jul 10 13:51:38.986000 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.985783    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 13:51:38.986000 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.985868    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 13:51:38.986212 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.986167    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 13:51:38.988329 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:38.988306    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 10 13:51:39.000989 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.000969    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"]
Jul 10 13:51:39.032198 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.032173    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8sxd6" event={"ID":"41cd8e57-350c-4802-8811-12561af5b788","Type":"ContainerStarted","Data":"c22976ffa9858c799960f644f54a2b224f50d658044aca1c0779a293aaae93b3"}
Jul 10 13:51:39.068467 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.068440    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"]
Jul 10 13:51:39.070258 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.070240    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"]
Jul 10 13:51:39.070383 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.070366    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"
Jul 10 13:51:39.071813 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.071796    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"
Jul 10 13:51:39.076196 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.076171    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jvtn8\""
Jul 10 13:51:39.076465 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.076183    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-76br5\""
Jul 10 13:51:39.076465 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.076206    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 10 13:51:39.076465 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.076267    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 10 13:51:39.076696 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.076675    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 10 13:51:39.088333 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.088312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smvf\" (UniqueName: \"kubernetes.io/projected/8b22c9eb-33f9-4755-a6ac-5db27cc79ca1-kube-api-access-4smvf\") pod \"managed-serviceaccount-addon-agent-7c86dd55c8-btnjs\" (UID: \"8b22c9eb-33f9-4755-a6ac-5db27cc79ca1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"
Jul 10 13:51:39.088436 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.088396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b22c9eb-33f9-4755-a6ac-5db27cc79ca1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c86dd55c8-btnjs\" (UID: \"8b22c9eb-33f9-4755-a6ac-5db27cc79ca1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"
Jul 10 13:51:39.098152 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.098132    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"]
Jul 10 13:51:39.119817 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.119793    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"]
Jul 10 13:51:39.189019 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.188992    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/32b75f97-8d75-48aa-8fac-c944c45672b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-nkrsc\" (UID: \"32b75f97-8d75-48aa-8fac-c944c45672b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"
Jul 10 13:51:39.189145 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.189025    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/490c5a67-536c-4f73-aaa0-f126bf339d02-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2p6n8\" (UID: \"490c5a67-536c-4f73-aaa0-f126bf339d02\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"
Jul 10 13:51:39.189145 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.189043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b22c9eb-33f9-4755-a6ac-5db27cc79ca1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c86dd55c8-btnjs\" (UID: \"8b22c9eb-33f9-4755-a6ac-5db27cc79ca1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"
Jul 10 13:51:39.189145 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.189060    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smvf\" (UniqueName: \"kubernetes.io/projected/8b22c9eb-33f9-4755-a6ac-5db27cc79ca1-kube-api-access-4smvf\") pod \"managed-serviceaccount-addon-agent-7c86dd55c8-btnjs\" (UID: \"8b22c9eb-33f9-4755-a6ac-5db27cc79ca1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"
Jul 10 13:51:39.189314 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.189161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/490c5a67-536c-4f73-aaa0-f126bf339d02-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2p6n8\" (UID: \"490c5a67-536c-4f73-aaa0-f126bf339d02\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"
Jul 10 13:51:39.191723 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.191701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b22c9eb-33f9-4755-a6ac-5db27cc79ca1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c86dd55c8-btnjs\" (UID: \"8b22c9eb-33f9-4755-a6ac-5db27cc79ca1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"
Jul 10 13:51:39.203111 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.203093    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smvf\" (UniqueName: \"kubernetes.io/projected/8b22c9eb-33f9-4755-a6ac-5db27cc79ca1-kube-api-access-4smvf\") pod \"managed-serviceaccount-addon-agent-7c86dd55c8-btnjs\" (UID: \"8b22c9eb-33f9-4755-a6ac-5db27cc79ca1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"
Jul 10 13:51:39.289711 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.289651    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/32b75f97-8d75-48aa-8fac-c944c45672b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-nkrsc\" (UID: \"32b75f97-8d75-48aa-8fac-c944c45672b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"
Jul 10 13:51:39.289711 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.289683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/490c5a67-536c-4f73-aaa0-f126bf339d02-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2p6n8\" (UID: \"490c5a67-536c-4f73-aaa0-f126bf339d02\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"
Jul 10 13:51:39.289711 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.289706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/490c5a67-536c-4f73-aaa0-f126bf339d02-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2p6n8\" (UID: \"490c5a67-536c-4f73-aaa0-f126bf339d02\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"
Jul 10 13:51:39.290228 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.290209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/490c5a67-536c-4f73-aaa0-f126bf339d02-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2p6n8\" (UID: \"490c5a67-536c-4f73-aaa0-f126bf339d02\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"
Jul 10 13:51:39.291807 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.291786    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/32b75f97-8d75-48aa-8fac-c944c45672b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-nkrsc\" (UID: \"32b75f97-8d75-48aa-8fac-c944c45672b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"
Jul 10 13:51:39.291905 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.291884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/490c5a67-536c-4f73-aaa0-f126bf339d02-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2p6n8\" (UID: \"490c5a67-536c-4f73-aaa0-f126bf339d02\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"
Jul 10 13:51:39.301735 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.301718    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"
Jul 10 13:51:39.383034 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.383010    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"
Jul 10 13:51:39.387849 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.387829    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"
Jul 10 13:51:39.430178 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.429961    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs"]
Jul 10 13:51:39.433034 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:39.432696    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b22c9eb_33f9_4755_a6ac_5db27cc79ca1.slice/crio-5df62171a4e3db45f4b383ceb38d33cab879054690c094de0d27dbcaaaccd795 WatchSource:0}: Error finding container 5df62171a4e3db45f4b383ceb38d33cab879054690c094de0d27dbcaaaccd795: Status 404 returned error can't find the container with id 5df62171a4e3db45f4b383ceb38d33cab879054690c094de0d27dbcaaaccd795
Jul 10 13:51:39.542036 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.541916    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"]
Jul 10 13:51:39.546303 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:39.546268    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b75f97_8d75_48aa_8fac_c944c45672b8.slice/crio-4b57145448f731f9ebca3a66f446702a3d1f8b63360dc6222683bf97fb95346d WatchSource:0}: Error finding container 4b57145448f731f9ebca3a66f446702a3d1f8b63360dc6222683bf97fb95346d: Status 404 returned error can't find the container with id 4b57145448f731f9ebca3a66f446702a3d1f8b63360dc6222683bf97fb95346d
Jul 10 13:51:39.578565 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:39.578540    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2p6n8"]
Jul 10 13:51:39.582570 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:39.582543    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490c5a67_536c_4f73_aaa0_f126bf339d02.slice/crio-55ea04132499f9f116b30e8ad06c221e8051fb84ccd45a7be9974bac8e6e4cca WatchSource:0}: Error finding container 55ea04132499f9f116b30e8ad06c221e8051fb84ccd45a7be9974bac8e6e4cca: Status 404 returned error can't find the container with id 55ea04132499f9f116b30e8ad06c221e8051fb84ccd45a7be9974bac8e6e4cca
Jul 10 13:51:40.037410 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:40.037371    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs" event={"ID":"8b22c9eb-33f9-4755-a6ac-5db27cc79ca1","Type":"ContainerStarted","Data":"5df62171a4e3db45f4b383ceb38d33cab879054690c094de0d27dbcaaaccd795"}
Jul 10 13:51:40.038586 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:40.038555    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8" event={"ID":"490c5a67-536c-4f73-aaa0-f126bf339d02","Type":"ContainerStarted","Data":"55ea04132499f9f116b30e8ad06c221e8051fb84ccd45a7be9974bac8e6e4cca"}
Jul 10 13:51:40.039939 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:40.039910    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc" event={"ID":"32b75f97-8d75-48aa-8fac-c944c45672b8","Type":"ContainerStarted","Data":"4b57145448f731f9ebca3a66f446702a3d1f8b63360dc6222683bf97fb95346d"}
Jul 10 13:51:43.017994 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:43.017960    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cg7wr"
Jul 10 13:51:45.058543 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.058507    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8" event={"ID":"490c5a67-536c-4f73-aaa0-f126bf339d02","Type":"ContainerStarted","Data":"f00254605f23e2e1513e99ebea834ff3a25f2a6f371dbb32e8bbc0083c63ef32"}
Jul 10 13:51:45.060011 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.059982    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc" event={"ID":"32b75f97-8d75-48aa-8fac-c944c45672b8","Type":"ContainerStarted","Data":"afc69778023d7ee8f7d9bb9b027d1a8c4e71b8e18e3cfdcae6664f6e97e2cf03"}
Jul 10 13:51:45.060331 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.060161    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"
Jul 10 13:51:45.061383 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.061354    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8sxd6" event={"ID":"41cd8e57-350c-4802-8811-12561af5b788","Type":"ContainerStarted","Data":"3bc33e5d91d7e6dd62066a1548bb18a73c7771b77821bcb69126c17d31c22355"}
Jul 10 13:51:45.062858 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.062830    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs" event={"ID":"8b22c9eb-33f9-4755-a6ac-5db27cc79ca1","Type":"ContainerStarted","Data":"44381f327c483be76df501028c410e75c2a44b306d765d2a713a138a93dc6248"}
Jul 10 13:51:45.065205 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.065184    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc"
Jul 10 13:51:45.085121 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.085067    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-2p6n8" podStartSLOduration=1.316391535 podStartE2EDuration="6.085050112s" totalImagesPullingTime="4.768658577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:45.08497941 +0000 UTC m=+114.002023699" watchObservedRunningTime="2026-07-10 13:51:45.085050112 +0000 UTC m=+114.002094375"
Jul 10 13:51:45.110119 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.109976    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nkrsc" podStartSLOduration=1.306427579 podStartE2EDuration="6.109959749s" totalImagesPullingTime="4.80353217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:45.109590846 +0000 UTC m=+114.026635121" watchObservedRunningTime="2026-07-10 13:51:45.109959749 +0000 UTC m=+114.027004012"
Jul 10 13:51:45.127910 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:45.127866    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c86dd55c8-btnjs" podStartSLOduration=2.203967192 podStartE2EDuration="7.127848382s" totalImagesPullingTime="4.92388119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:45.127634158 +0000 UTC m=+114.044678422" watchObservedRunningTime="2026-07-10 13:51:45.127848382 +0000 UTC m=+114.044892646"
Jul 10 13:51:46.068984 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.068950    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8sxd6" event={"ID":"41cd8e57-350c-4802-8811-12561af5b788","Type":"ContainerStarted","Data":"96b0268dd8b9f1cb754997112b6ecec10e7c8515aa4671a43c136220e6843522"}
Jul 10 13:51:46.099180 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.099153    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kg24x"]
Jul 10 13:51:46.102409 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.102382    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.105962 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.105939    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 13:51:46.106093 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.106043    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 13:51:46.106093 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.106053    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 13:51:46.106093 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.106066    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 13:51:46.106264 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.106134    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 13:51:46.106394 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.106379    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hbj7j\""
Jul 10 13:51:46.112919 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.112897    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kg24x"]
Jul 10 13:51:46.247528 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.247498    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8be30c5-fef3-4c20-a779-0fb11b80973e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.247694 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.247564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8be30c5-fef3-4c20-a779-0fb11b80973e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.247694 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.247638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99q5c\" (UniqueName: \"kubernetes.io/projected/e8be30c5-fef3-4c20-a779-0fb11b80973e-kube-api-access-99q5c\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.247694 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.247671    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8be30c5-fef3-4c20-a779-0fb11b80973e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.348434 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.348350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8be30c5-fef3-4c20-a779-0fb11b80973e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.348434 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.348385    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8be30c5-fef3-4c20-a779-0fb11b80973e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.348434 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.348417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99q5c\" (UniqueName: \"kubernetes.io/projected/e8be30c5-fef3-4c20-a779-0fb11b80973e-kube-api-access-99q5c\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.348681 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.348596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8be30c5-fef3-4c20-a779-0fb11b80973e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.349176 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.349150    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8be30c5-fef3-4c20-a779-0fb11b80973e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.351368 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.351339    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8be30c5-fef3-4c20-a779-0fb11b80973e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.351482 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.351441    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8be30c5-fef3-4c20-a779-0fb11b80973e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.358443 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.358402    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99q5c\" (UniqueName: \"kubernetes.io/projected/e8be30c5-fef3-4c20-a779-0fb11b80973e-kube-api-access-99q5c\") pod \"prometheus-operator-64785b6675-kg24x\" (UID: \"e8be30c5-fef3-4c20-a779-0fb11b80973e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.413202 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.413175    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x"
Jul 10 13:51:46.554314 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:46.554282    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kg24x"]
Jul 10 13:51:47.073426 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:47.073393    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x" event={"ID":"e8be30c5-fef3-4c20-a779-0fb11b80973e","Type":"ContainerStarted","Data":"6c4f4df2584a13946da351f874775cdb6b24576214e66f0eab1e73662f08ef97"}
Jul 10 13:51:48.078838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.078796    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8sxd6" event={"ID":"41cd8e57-350c-4802-8811-12561af5b788","Type":"ContainerStarted","Data":"429533c89fac2cb0589e3dccef1f9c9b38e1638bfd77c6e30cfb308f4f020547"}
Jul 10 13:51:48.105018 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.104959    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8sxd6" podStartSLOduration=33.406790247 podStartE2EDuration="42.10493887s" totalImagesPullingTime="8.698148623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:51:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:48.104832696 +0000 UTC m=+117.021876983" watchObservedRunningTime="2026-07-10 13:51:48.10493887 +0000 UTC m=+117.021983125"
Jul 10 13:51:48.144486 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.144458    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-x2jp8"]
Jul 10 13:51:48.147464 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.147444    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-x2jp8"
Jul 10 13:51:48.149614 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.149587    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 13:51:48.149732 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.149674    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z7qgv\""
Jul 10 13:51:48.149867 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.149853    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 13:51:48.159448 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.159427    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-x2jp8"]
Jul 10 13:51:48.263104 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.263071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dnkl\" (UniqueName: \"kubernetes.io/projected/b60ba0d4-2bda-4165-99cc-fe7d200d9aaf-kube-api-access-2dnkl\") pod \"downloads-68c9cbb497-x2jp8\" (UID: \"b60ba0d4-2bda-4165-99cc-fe7d200d9aaf\") " pod="openshift-console/downloads-68c9cbb497-x2jp8"
Jul 10 13:51:48.364470 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.364378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dnkl\" (UniqueName: \"kubernetes.io/projected/b60ba0d4-2bda-4165-99cc-fe7d200d9aaf-kube-api-access-2dnkl\") pod \"downloads-68c9cbb497-x2jp8\" (UID: \"b60ba0d4-2bda-4165-99cc-fe7d200d9aaf\") " pod="openshift-console/downloads-68c9cbb497-x2jp8"
Jul 10 13:51:48.374269 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.374237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dnkl\" (UniqueName: \"kubernetes.io/projected/b60ba0d4-2bda-4165-99cc-fe7d200d9aaf-kube-api-access-2dnkl\") pod \"downloads-68c9cbb497-x2jp8\" (UID: \"b60ba0d4-2bda-4165-99cc-fe7d200d9aaf\") " pod="openshift-console/downloads-68c9cbb497-x2jp8"
Jul 10 13:51:48.456341 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.456306    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-x2jp8"
Jul 10 13:51:48.677065 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:48.677040    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-x2jp8"]
Jul 10 13:51:48.679557 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:48.679527    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60ba0d4_2bda_4165_99cc_fe7d200d9aaf.slice/crio-4c172f2fb72ad5a4f589b633ff9dba09ed2079e9a65a5808f169a91f7ecdee1e WatchSource:0}: Error finding container 4c172f2fb72ad5a4f589b633ff9dba09ed2079e9a65a5808f169a91f7ecdee1e: Status 404 returned error can't find the container with id 4c172f2fb72ad5a4f589b633ff9dba09ed2079e9a65a5808f169a91f7ecdee1e
Jul 10 13:51:49.082764 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:49.082713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-x2jp8" event={"ID":"b60ba0d4-2bda-4165-99cc-fe7d200d9aaf","Type":"ContainerStarted","Data":"4c172f2fb72ad5a4f589b633ff9dba09ed2079e9a65a5808f169a91f7ecdee1e"}
Jul 10 13:51:49.084322 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:49.084298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x" event={"ID":"e8be30c5-fef3-4c20-a779-0fb11b80973e","Type":"ContainerStarted","Data":"92a939777bf3dcbf796fd02be16958701fb777f92cd21abaeeefa9c0398ceb87"}
Jul 10 13:51:49.084438 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:49.084339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x" event={"ID":"e8be30c5-fef3-4c20-a779-0fb11b80973e","Type":"ContainerStarted","Data":"a433d11ada5ef8fc272d111091c10a6c2298fbb3137545689019d4f611e10f95"}
Jul 10 13:51:49.103908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:49.103867    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-kg24x" podStartSLOduration=1.07124389 podStartE2EDuration="3.103854884s" totalImagesPullingTime="2.032610994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:49.103427462 +0000 UTC m=+118.020471725" watchObservedRunningTime="2026-07-10 13:51:49.103854884 +0000 UTC m=+118.020899146"
Jul 10 13:51:49.896206 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:49.896174    2570 patch_prober.go:28] interesting pod/image-registry-965d67f94-pndj4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 13:51:49.896368 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:49.896232    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-965d67f94-pndj4" podUID="aa29fd87-1528-4ed8-9706-27e5f0cf680d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 13:51:51.565600 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.565569    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6vw4k"]
Jul 10 13:51:51.569247 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.569226    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"]
Jul 10 13:51:51.569384 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.569370    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.571864 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.571844    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 13:51:51.572379 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.572358    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 13:51:51.572607 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.572586    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.572713 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.572657    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zk5vq\""
Jul 10 13:51:51.572713 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.572678    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 13:51:51.576157 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.575945    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 10 13:51:51.576157 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.575967    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-svl29\""
Jul 10 13:51:51.576157 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.576033    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 10 13:51:51.576512 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.576492    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 10 13:51:51.584771 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.584730    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"]
Jul 10 13:51:51.688657 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688628    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ec5a3a3-777c-41b3-9c45-e04515b2307f-metrics-client-ca\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.688826 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688660    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.688826 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688692    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-tls\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.688826 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.688977 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688868    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.688977 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688894    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-wtmp\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.688977 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-accelerators-collector-config\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.688977 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688935    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-root\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.688977 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-textfile\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.689171 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.688994    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82r6f\" (UniqueName: \"kubernetes.io/projected/9ec5a3a3-777c-41b3-9c45-e04515b2307f-kube-api-access-82r6f\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.689171 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.689042    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.689171 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.689073    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.689171 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.689112    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.689171 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.689161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-sys\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.689357 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.689190    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdzmh\" (UniqueName: \"kubernetes.io/projected/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-api-access-pdzmh\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.789586 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.789765 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-wtmp\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.789765 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-accelerators-collector-config\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.789895 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-root\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.789895 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789839    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-textfile\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.789895 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789842    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-root\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.789895 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789804    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-wtmp\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.789895 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82r6f\" (UniqueName: \"kubernetes.io/projected/9ec5a3a3-777c-41b3-9c45-e04515b2307f-kube-api-access-82r6f\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.789968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-sys\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdzmh\" (UniqueName: \"kubernetes.io/projected/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-api-access-pdzmh\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ec5a3a3-777c-41b3-9c45-e04515b2307f-metrics-client-ca\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790111    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-tls\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.790165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790162    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec5a3a3-777c-41b3-9c45-e04515b2307f-sys\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.790590 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790182    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.790590 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790216    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-accelerators-collector-config\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.790590 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:51.790290    2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 10 13:51:51.790590 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:51.790353    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-tls podName:69b59a0c-00dc-4b3b-ab96-6d1f23d192e5 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:52.290334816 +0000 UTC m=+121.207379065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-ddzpf" (UID: "69b59a0c-00dc-4b3b-ab96-6d1f23d192e5") : secret "kube-state-metrics-tls" not found
Jul 10 13:51:51.790851 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ec5a3a3-777c-41b3-9c45-e04515b2307f-metrics-client-ca\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.790851 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790796    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.790851 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.791016 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.790850    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.791070 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.791040    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-textfile\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.792793 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.792766    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.793263 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.793237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-tls\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.793422 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.793403    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ec5a3a3-777c-41b3-9c45-e04515b2307f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.799875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.799848    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82r6f\" (UniqueName: \"kubernetes.io/projected/9ec5a3a3-777c-41b3-9c45-e04515b2307f-kube-api-access-82r6f\") pod \"node-exporter-6vw4k\" (UID: \"9ec5a3a3-777c-41b3-9c45-e04515b2307f\") " pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.801440 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.801416    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdzmh\" (UniqueName: \"kubernetes.io/projected/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-api-access-pdzmh\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:51.882783 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:51.882705    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6vw4k"
Jul 10 13:51:51.894641 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:51.894614    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec5a3a3_777c_41b3_9c45_e04515b2307f.slice/crio-d70d4fa3d49301169ce440ceb313a68cd42bdf1859568f06b0fd7ce974c8384f WatchSource:0}: Error finding container d70d4fa3d49301169ce440ceb313a68cd42bdf1859568f06b0fd7ce974c8384f: Status 404 returned error can't find the container with id d70d4fa3d49301169ce440ceb313a68cd42bdf1859568f06b0fd7ce974c8384f
Jul 10 13:51:52.010098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:52.010073    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:51:52.098155 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:52.098120    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6vw4k" event={"ID":"9ec5a3a3-777c-41b3-9c45-e04515b2307f","Type":"ContainerStarted","Data":"d70d4fa3d49301169ce440ceb313a68cd42bdf1859568f06b0fd7ce974c8384f"}
Jul 10 13:51:52.294079 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:52.294032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:52.296984 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:52.296954    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/69b59a0c-00dc-4b3b-ab96-6d1f23d192e5-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ddzpf\" (UID: \"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:52.492091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:52.492054    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"
Jul 10 13:51:52.665210 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:52.664950    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ddzpf"]
Jul 10 13:51:52.830327 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:52.830254    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b59a0c_00dc_4b3b_ab96_6d1f23d192e5.slice/crio-f34e04ce65d8c91181272f05532901e191f4b5f734364b5944543ca0c83f5bfe WatchSource:0}: Error finding container f34e04ce65d8c91181272f05532901e191f4b5f734364b5944543ca0c83f5bfe: Status 404 returned error can't find the container with id f34e04ce65d8c91181272f05532901e191f4b5f734364b5944543ca0c83f5bfe
Jul 10 13:51:53.103947 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.103864    2570 generic.go:356] "Generic (PLEG): container finished" podID="9ec5a3a3-777c-41b3-9c45-e04515b2307f" containerID="b86fa239da7dd9a3add994a56ac4fbd9bfbed163dffe12782b9357aa21ded9ad" exitCode=0
Jul 10 13:51:53.103947 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.103906    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6vw4k" event={"ID":"9ec5a3a3-777c-41b3-9c45-e04515b2307f","Type":"ContainerDied","Data":"b86fa239da7dd9a3add994a56ac4fbd9bfbed163dffe12782b9357aa21ded9ad"}
Jul 10 13:51:53.105683 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.105650    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf" event={"ID":"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5","Type":"ContainerStarted","Data":"f34e04ce65d8c91181272f05532901e191f4b5f734364b5944543ca0c83f5bfe"}
Jul 10 13:51:53.277001 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.276568    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b699d79f-ptp9l"]
Jul 10 13:51:53.279798 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.279775    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.282320 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.282205    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 13:51:53.282320 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.282217    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 13:51:53.282579 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.282556    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 13:51:53.282688 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.282652    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 13:51:53.283241 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.282706    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 13:51:53.283241 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.282740    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2gbl6\""
Jul 10 13:51:53.291441 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.291418    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b699d79f-ptp9l"]
Jul 10 13:51:53.406602 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.406526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-serving-cert\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.406602 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.406561    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-config\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.406602 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.406588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-service-ca\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.406886 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.406689    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-oauth-serving-cert\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.406886 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.406795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j4mt\" (UniqueName: \"kubernetes.io/projected/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-kube-api-access-7j4mt\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.406886 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.406821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-oauth-config\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.508178 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.507867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j4mt\" (UniqueName: \"kubernetes.io/projected/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-kube-api-access-7j4mt\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.508178 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.507916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-oauth-config\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.508178 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.507964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-serving-cert\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.508178 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.507990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-config\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.508178 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.508019    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-service-ca\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.508178 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.508068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-oauth-serving-cert\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.508909 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.508857    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-oauth-serving-cert\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.508909 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.508890    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-config\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.509095 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.508990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-service-ca\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.510971 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.510949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-oauth-config\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.511109 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.511063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-serving-cert\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.521926 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.521886    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j4mt\" (UniqueName: \"kubernetes.io/projected/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-kube-api-access-7j4mt\") pod \"console-54b699d79f-ptp9l\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") " pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.591357 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.591305    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:51:53.742696 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:53.741950    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b699d79f-ptp9l"]
Jul 10 13:51:53.746139 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:53.746108    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4478ecbd_0cb1_44ae_816c_b19502f0b5eb.slice/crio-822f4f1396e1500ae2c42d6811b5a2bb78888f24be35a5846c32cfd80440288f WatchSource:0}: Error finding container 822f4f1396e1500ae2c42d6811b5a2bb78888f24be35a5846c32cfd80440288f: Status 404 returned error can't find the container with id 822f4f1396e1500ae2c42d6811b5a2bb78888f24be35a5846c32cfd80440288f
Jul 10 13:51:54.110853 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.110813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b699d79f-ptp9l" event={"ID":"4478ecbd-0cb1-44ae-816c-b19502f0b5eb","Type":"ContainerStarted","Data":"822f4f1396e1500ae2c42d6811b5a2bb78888f24be35a5846c32cfd80440288f"}
Jul 10 13:51:54.113363 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.113328    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6vw4k" event={"ID":"9ec5a3a3-777c-41b3-9c45-e04515b2307f","Type":"ContainerStarted","Data":"dad129ffb688f36b97b305a91e993f8ee5b74ef41180e2ef1eae5b0ffb0557d8"}
Jul 10 13:51:54.113482 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.113425    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6vw4k" event={"ID":"9ec5a3a3-777c-41b3-9c45-e04515b2307f","Type":"ContainerStarted","Data":"10e436a4d1c3d3b1f3f6d5aebe0779f7b03d87f7d5e91afc2e2436099dd0febb"}
Jul 10 13:51:54.133961 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.133910    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6vw4k" podStartSLOduration=2.077453216 podStartE2EDuration="3.133892686s" totalImagesPullingTime="980.196198ms" totalInitContainerRuntime="76.243272ms" isStatefulPod=true podCreationTimestamp="2026-07-10 13:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:54.133389104 +0000 UTC m=+123.050433370" watchObservedRunningTime="2026-07-10 13:51:54.133892686 +0000 UTC m=+123.050936948"
Jul 10 13:51:54.585933 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.585898    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"]
Jul 10 13:51:54.591172 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.591151    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.594669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.594012    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 10 13:51:54.594669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.594401    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jhr8k\""
Jul 10 13:51:54.594669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.594459    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4sapca6ptrr5p\""
Jul 10 13:51:54.594669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.594554    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 10 13:51:54.594915 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.594778    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 10 13:51:54.595213 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.594998    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 10 13:51:54.595213 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.595054    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 10 13:51:54.610503 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.610411    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"]
Jul 10 13:51:54.718699 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.718662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.718884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.718716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-tls\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.718884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.718765    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.718884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.718804    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.718884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.718828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-grpc-tls\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.718884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.718879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7b59335-aa85-42b3-83de-48367db43c47-metrics-client-ca\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.719293 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.718921    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.719293 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.718944    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjc4w\" (UniqueName: \"kubernetes.io/projected/f7b59335-aa85-42b3-83de-48367db43c47-kube-api-access-jjc4w\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.820204 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.820167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.820669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.820210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-grpc-tls\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.820669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.820267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7b59335-aa85-42b3-83de-48367db43c47-metrics-client-ca\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.820669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.820326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.820669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.820354    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjc4w\" (UniqueName: \"kubernetes.io/projected/f7b59335-aa85-42b3-83de-48367db43c47-kube-api-access-jjc4w\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.820669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.820417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.820669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.820447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-tls\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.820669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.820475    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.821508 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.821440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7b59335-aa85-42b3-83de-48367db43c47-metrics-client-ca\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.824806 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.824758    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.825887 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.825209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-tls\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.826494 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.826063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-grpc-tls\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.826494 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.826346    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.826494 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.826456    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.827276 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.827233    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7b59335-aa85-42b3-83de-48367db43c47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.830922 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.830900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjc4w\" (UniqueName: \"kubernetes.io/projected/f7b59335-aa85-42b3-83de-48367db43c47-kube-api-access-jjc4w\") pod \"thanos-querier-5679b9f4fd-5hspq\" (UID: \"f7b59335-aa85-42b3-83de-48367db43c47\") " pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:54.904150 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:54.904116    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:51:55.075092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.075051    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"]
Jul 10 13:51:55.080272 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:55.080242    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b59335_aa85_42b3_83de_48367db43c47.slice/crio-1287f8360a3e34faf7bc78d5898d5088d41b1a0a2f9261a02a5741762a089e0b WatchSource:0}: Error finding container 1287f8360a3e34faf7bc78d5898d5088d41b1a0a2f9261a02a5741762a089e0b: Status 404 returned error can't find the container with id 1287f8360a3e34faf7bc78d5898d5088d41b1a0a2f9261a02a5741762a089e0b
Jul 10 13:51:55.119842 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.119810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq" event={"ID":"f7b59335-aa85-42b3-83de-48367db43c47","Type":"ContainerStarted","Data":"1287f8360a3e34faf7bc78d5898d5088d41b1a0a2f9261a02a5741762a089e0b"}
Jul 10 13:51:55.123244 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.123000    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf" event={"ID":"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5","Type":"ContainerStarted","Data":"731e36ea29bf4e5eedc7ccd7801cd3b6a888082848c27ac4c3135c5054ee2c54"}
Jul 10 13:51:55.123244 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.123052    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf" event={"ID":"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5","Type":"ContainerStarted","Data":"60538f14c13fbfce546cb271efbd3274ac23e9ff04cf2c7cf0c420ed025d2d0b"}
Jul 10 13:51:55.123244 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.123081    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf" event={"ID":"69b59a0c-00dc-4b3b-ab96-6d1f23d192e5","Type":"ContainerStarted","Data":"2c014f086c47a73c78e91c654336c3b9f0b1ce6932fe6c2b3505476fcb10b2dd"}
Jul 10 13:51:55.143265 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.143189    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-ddzpf" podStartSLOduration=2.646821007 podStartE2EDuration="4.143169377s" totalImagesPullingTime="1.49634837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:55.141737946 +0000 UTC m=+124.058782211" watchObservedRunningTime="2026-07-10 13:51:55.143169377 +0000 UTC m=+124.060213641"
Jul 10 13:51:55.801994 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.801956    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"]
Jul 10 13:51:55.805552 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.805518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:55.807668 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.807643    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q2fgg\""
Jul 10 13:51:55.809253 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.809070    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 13:51:55.809896 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.809876    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 10 13:51:55.810024 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.809978    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 10 13:51:55.810024 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.810001    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-44en18v7klok7\""
Jul 10 13:51:55.810135 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.810080    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 10 13:51:55.823572 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.823548    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"]
Jul 10 13:51:55.930686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.930237    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14cb747a-4ea4-49ac-b8ea-e840fac8182a-metrics-server-audit-profiles\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:55.930686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.930299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-secret-metrics-server-tls\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:55.930686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.930352    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-secret-metrics-server-client-certs\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:55.930686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.930393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-client-ca-bundle\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:55.930686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.930455    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14cb747a-4ea4-49ac-b8ea-e840fac8182a-audit-log\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:55.930686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.930486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14cb747a-4ea4-49ac-b8ea-e840fac8182a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:55.930686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:55.930552    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld8n7\" (UniqueName: \"kubernetes.io/projected/14cb747a-4ea4-49ac-b8ea-e840fac8182a-kube-api-access-ld8n7\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.031639 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.031598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld8n7\" (UniqueName: \"kubernetes.io/projected/14cb747a-4ea4-49ac-b8ea-e840fac8182a-kube-api-access-ld8n7\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.031840 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.031660    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14cb747a-4ea4-49ac-b8ea-e840fac8182a-metrics-server-audit-profiles\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.031840 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.031704    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-secret-metrics-server-tls\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.031840 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.031737    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-secret-metrics-server-client-certs\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.031840 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.031795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-client-ca-bundle\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.032667 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.032640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14cb747a-4ea4-49ac-b8ea-e840fac8182a-audit-log\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.032789 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.032687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14cb747a-4ea4-49ac-b8ea-e840fac8182a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.033011 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.032946    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14cb747a-4ea4-49ac-b8ea-e840fac8182a-metrics-server-audit-profiles\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.033117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.033014    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14cb747a-4ea4-49ac-b8ea-e840fac8182a-audit-log\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.033394 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.033366    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14cb747a-4ea4-49ac-b8ea-e840fac8182a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.035342 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.035301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-client-ca-bundle\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.035803 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.035730    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-secret-metrics-server-client-certs\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.036315 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.036279    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14cb747a-4ea4-49ac-b8ea-e840fac8182a-secret-metrics-server-tls\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.043387 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.043343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld8n7\" (UniqueName: \"kubernetes.io/projected/14cb747a-4ea4-49ac-b8ea-e840fac8182a-kube-api-access-ld8n7\") pod \"metrics-server-7b857cf7b4-f8gmn\" (UID: \"14cb747a-4ea4-49ac-b8ea-e840fac8182a\") " pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.119256 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.119171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:51:56.255883 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.255599    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"]
Jul 10 13:51:56.259080 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.259055    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:56.262865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.262841    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 10 13:51:56.263018 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.262841    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-l6nlh\""
Jul 10 13:51:56.274298 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.274278    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"]
Jul 10 13:51:56.336871 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.336817    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/453e5acc-4503-444e-8a52-153b97524c47-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5h9ml\" (UID: \"453e5acc-4503-444e-8a52-153b97524c47\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:56.337025 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.336942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxz82\" (UniqueName: \"kubernetes.io/projected/453e5acc-4503-444e-8a52-153b97524c47-kube-api-access-bxz82\") pod \"monitoring-plugin-5f68df7f58-5h9ml\" (UID: \"453e5acc-4503-444e-8a52-153b97524c47\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:56.437521 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.437438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxz82\" (UniqueName: \"kubernetes.io/projected/453e5acc-4503-444e-8a52-153b97524c47-kube-api-access-bxz82\") pod \"monitoring-plugin-5f68df7f58-5h9ml\" (UID: \"453e5acc-4503-444e-8a52-153b97524c47\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:56.437521 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.437501    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/453e5acc-4503-444e-8a52-153b97524c47-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5h9ml\" (UID: \"453e5acc-4503-444e-8a52-153b97524c47\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:56.437733 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:56.437648    2570 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 10 13:51:56.437733 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:51:56.437709    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453e5acc-4503-444e-8a52-153b97524c47-monitoring-plugin-cert podName:453e5acc-4503-444e-8a52-153b97524c47 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:56.937690685 +0000 UTC m=+125.854734950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/453e5acc-4503-444e-8a52-153b97524c47-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-5h9ml" (UID: "453e5acc-4503-444e-8a52-153b97524c47") : secret "monitoring-plugin-cert" not found
Jul 10 13:51:56.448636 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.448605    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxz82\" (UniqueName: \"kubernetes.io/projected/453e5acc-4503-444e-8a52-153b97524c47-kube-api-access-bxz82\") pod \"monitoring-plugin-5f68df7f58-5h9ml\" (UID: \"453e5acc-4503-444e-8a52-153b97524c47\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:56.943247 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.943205    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/453e5acc-4503-444e-8a52-153b97524c47-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5h9ml\" (UID: \"453e5acc-4503-444e-8a52-153b97524c47\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:56.946147 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:56.946120    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/453e5acc-4503-444e-8a52-153b97524c47-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5h9ml\" (UID: \"453e5acc-4503-444e-8a52-153b97524c47\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:57.172125 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:57.171913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:51:58.374304 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:58.374275    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"]
Jul 10 13:51:58.379534 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:58.379493    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453e5acc_4503_444e_8a52_153b97524c47.slice/crio-5cdaad7a6454711cc4677ea4ecdc7453b4cc20b828b48a11461c104c4eec850c WatchSource:0}: Error finding container 5cdaad7a6454711cc4677ea4ecdc7453b4cc20b828b48a11461c104c4eec850c: Status 404 returned error can't find the container with id 5cdaad7a6454711cc4677ea4ecdc7453b4cc20b828b48a11461c104c4eec850c
Jul 10 13:51:58.395112 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:58.394389    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"]
Jul 10 13:51:58.401113 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:51:58.400690    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14cb747a_4ea4_49ac_b8ea_e840fac8182a.slice/crio-315bd68d9688b32e3e76a693227800088043a600208f56b57803fbc06f861ad3 WatchSource:0}: Error finding container 315bd68d9688b32e3e76a693227800088043a600208f56b57803fbc06f861ad3: Status 404 returned error can't find the container with id 315bd68d9688b32e3e76a693227800088043a600208f56b57803fbc06f861ad3
Jul 10 13:51:59.145329 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:59.145285    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml" event={"ID":"453e5acc-4503-444e-8a52-153b97524c47","Type":"ContainerStarted","Data":"5cdaad7a6454711cc4677ea4ecdc7453b4cc20b828b48a11461c104c4eec850c"}
Jul 10 13:51:59.146911 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:59.146881    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn" event={"ID":"14cb747a-4ea4-49ac-b8ea-e840fac8182a","Type":"ContainerStarted","Data":"315bd68d9688b32e3e76a693227800088043a600208f56b57803fbc06f861ad3"}
Jul 10 13:51:59.149699 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:59.149668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq" event={"ID":"f7b59335-aa85-42b3-83de-48367db43c47","Type":"ContainerStarted","Data":"ff8434f53bc6f791aaacc45c5d4c2b00191715afabc3d2610d8d656374fb3a10"}
Jul 10 13:51:59.149828 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:59.149790    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq" event={"ID":"f7b59335-aa85-42b3-83de-48367db43c47","Type":"ContainerStarted","Data":"b8f91e78dd4ff42dea5f706571416a04a8f2f7121d000c8bb4c27c395f778141"}
Jul 10 13:51:59.149900 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:59.149840    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq" event={"ID":"f7b59335-aa85-42b3-83de-48367db43c47","Type":"ContainerStarted","Data":"d3851d69a5314949f3a3dda5820e87feab7b57afd23071842c1c65f79cde1e16"}
Jul 10 13:51:59.151784 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:59.151761    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b699d79f-ptp9l" event={"ID":"4478ecbd-0cb1-44ae-816c-b19502f0b5eb","Type":"ContainerStarted","Data":"894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1"}
Jul 10 13:51:59.175126 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:51:59.173833    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b699d79f-ptp9l" podStartSLOduration=1.7272984 podStartE2EDuration="6.173814606s" totalImagesPullingTime="4.446516206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:59.173291836 +0000 UTC m=+128.090336100" watchObservedRunningTime="2026-07-10 13:51:59.173814606 +0000 UTC m=+128.090858869"
Jul 10 13:52:00.158114 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:00.158076    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq" event={"ID":"f7b59335-aa85-42b3-83de-48367db43c47","Type":"ContainerStarted","Data":"900b002012d7198ab30d4f20cb2e7cda4472c09a6d202bad64298b5e86b41637"}
Jul 10 13:52:00.475249 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:00.475210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:52:00.477831 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:00.477808    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3c684fd-d02f-4c53-8fc9-cc47672828d9-metrics-certs\") pod \"network-metrics-daemon-549nd\" (UID: \"d3c684fd-d02f-4c53-8fc9-cc47672828d9\") " pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:52:00.773200 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:00.773120    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nwfk\""
Jul 10 13:52:00.781560 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:00.781533    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-549nd"
Jul 10 13:52:01.737052 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.737017    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6dddcb7b-75wsq"]
Jul 10 13:52:01.740297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.740277    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.748633 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.748609    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 13:52:01.770297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.770273    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6dddcb7b-75wsq"]
Jul 10 13:52:01.786892 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.786861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjpt5\" (UniqueName: \"kubernetes.io/projected/1fb5cff3-46f0-492e-986e-936af8563d14-kube-api-access-rjpt5\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.787040 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.786908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-serving-cert\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.787040 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.786938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-console-config\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.787040 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.786964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-trusted-ca-bundle\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.787040 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.787010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-service-ca\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.787247 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.787126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-oauth-config\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.787247 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.787181    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-oauth-serving-cert\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.888519 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.888467    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjpt5\" (UniqueName: \"kubernetes.io/projected/1fb5cff3-46f0-492e-986e-936af8563d14-kube-api-access-rjpt5\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.888519 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.888523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-serving-cert\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.888769 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.888548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-console-config\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.888769 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.888576    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-trusted-ca-bundle\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.888769 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.888605    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-service-ca\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.888769 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.888687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-oauth-config\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.888769 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.888723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-oauth-serving-cert\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.889535 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.889503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-console-config\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.889831 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.889811    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-oauth-serving-cert\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.889928 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.889829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-service-ca\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.889928 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.889815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-trusted-ca-bundle\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.892069 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.892051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-serving-cert\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.892201 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.892179    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-oauth-config\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:01.897511 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:01.897492    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjpt5\" (UniqueName: \"kubernetes.io/projected/1fb5cff3-46f0-492e-986e-936af8563d14-kube-api-access-rjpt5\") pod \"console-5c6dddcb7b-75wsq\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") " pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:02.050986 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:02.050902    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:02.578773 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:02.578724    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-965d67f94-pndj4"]
Jul 10 13:52:03.592111 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:03.592071    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:52:03.592547 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:03.592144    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:52:03.597807 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:03.597781    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:52:04.181071 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:04.181044    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:52:08.425232 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:08.425016    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-549nd"]
Jul 10 13:52:08.430004 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:52:08.429943    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c684fd_d02f_4c53_8fc9_cc47672828d9.slice/crio-b0edfbb9a1c3b7e2b0a881160165405201f378268b13a03f4305eaa2aa6847b9 WatchSource:0}: Error finding container b0edfbb9a1c3b7e2b0a881160165405201f378268b13a03f4305eaa2aa6847b9: Status 404 returned error can't find the container with id b0edfbb9a1c3b7e2b0a881160165405201f378268b13a03f4305eaa2aa6847b9
Jul 10 13:52:08.461201 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:08.460994    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6dddcb7b-75wsq"]
Jul 10 13:52:09.210218 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.210180    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml" event={"ID":"453e5acc-4503-444e-8a52-153b97524c47","Type":"ContainerStarted","Data":"b0f0ac954bb59445bfeac5efd34b535cfd2a33332c413d52b02c9a4c4fa81228"}
Jul 10 13:52:09.213278 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.213167    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:52:09.215682 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.215654    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn" event={"ID":"14cb747a-4ea4-49ac-b8ea-e840fac8182a","Type":"ContainerStarted","Data":"18f0e2317855a1827be25307a16cb10aa213a8d0854265906f4b62b91775360c"}
Jul 10 13:52:09.218620 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.218599    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml"
Jul 10 13:52:09.220282 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.219971    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-x2jp8" event={"ID":"b60ba0d4-2bda-4165-99cc-fe7d200d9aaf","Type":"ContainerStarted","Data":"b60ac08de45e097228a0aa45cfec4873ca2ecb882554849dababa1183b2633e5"}
Jul 10 13:52:09.220769 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.220709    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-x2jp8"
Jul 10 13:52:09.226327 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.226303    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq" event={"ID":"f7b59335-aa85-42b3-83de-48367db43c47","Type":"ContainerStarted","Data":"fafbe586814fd2f780a0c7baef600a7627ad1fc69da9e062a331912d9c59a551"}
Jul 10 13:52:09.227018 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.226996    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq" event={"ID":"f7b59335-aa85-42b3-83de-48367db43c47","Type":"ContainerStarted","Data":"b1ed433ffaf5e529297a4471673658613532e5864248867351ebd86843e6c5c2"}
Jul 10 13:52:09.227615 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.227577    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:52:09.228458 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.228301    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5h9ml" podStartSLOduration=3.362831826 podStartE2EDuration="13.228281725s" totalImagesPullingTime="9.865449899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:09.226705853 +0000 UTC m=+138.143750124" watchObservedRunningTime="2026-07-10 13:52:09.228281725 +0000 UTC m=+138.145325988"
Jul 10 13:52:09.230839 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.230811    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-549nd" event={"ID":"d3c684fd-d02f-4c53-8fc9-cc47672828d9","Type":"ContainerStarted","Data":"b0edfbb9a1c3b7e2b0a881160165405201f378268b13a03f4305eaa2aa6847b9"}
Jul 10 13:52:09.233853 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.233835    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-x2jp8"
Jul 10 13:52:09.234655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.234635    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq"
Jul 10 13:52:09.235389 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.235362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6dddcb7b-75wsq" event={"ID":"1fb5cff3-46f0-492e-986e-936af8563d14","Type":"ContainerStarted","Data":"1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0"}
Jul 10 13:52:09.235515 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.235400    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6dddcb7b-75wsq" event={"ID":"1fb5cff3-46f0-492e-986e-936af8563d14","Type":"ContainerStarted","Data":"90131908a7e639af519a42a3cccbe8369ebafd65ed13ad35e87ad9db5520e796"}
Jul 10 13:52:09.246341 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.246289    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-x2jp8" podStartSLOduration=1.680415261 podStartE2EDuration="21.246273276s" totalImagesPullingTime="19.565858015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:09.245427163 +0000 UTC m=+138.162471427" watchObservedRunningTime="2026-07-10 13:52:09.246273276 +0000 UTC m=+138.163317540"
Jul 10 13:52:09.316297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.315525    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn" podStartSLOduration=4.470292122 podStartE2EDuration="14.315502213s" totalImagesPullingTime="9.845210091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:09.312938412 +0000 UTC m=+138.229982678" watchObservedRunningTime="2026-07-10 13:52:09.315502213 +0000 UTC m=+138.232546476"
Jul 10 13:52:09.316297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.316110    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5679b9f4fd-5hspq" podStartSLOduration=11.460775454 podStartE2EDuration="15.316098284s" totalImagesPullingTime="3.85532283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:09.293348333 +0000 UTC m=+138.210392596" watchObservedRunningTime="2026-07-10 13:52:09.316098284 +0000 UTC m=+138.233142549"
Jul 10 13:52:09.370352 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:09.369462    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6dddcb7b-75wsq" podStartSLOduration=8.369439782 podStartE2EDuration="8.369439782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:52:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:09.368793594 +0000 UTC m=+138.285837858" watchObservedRunningTime="2026-07-10 13:52:09.369439782 +0000 UTC m=+138.286484050"
Jul 10 13:52:11.249717 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:11.249668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-549nd" event={"ID":"d3c684fd-d02f-4c53-8fc9-cc47672828d9","Type":"ContainerStarted","Data":"38f245a56939ff1d65190dbf83eb4543ac0b4d2ed7ce3e6f9db88e78c3f0e176"}
Jul 10 13:52:11.250182 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:11.249765    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-549nd" event={"ID":"d3c684fd-d02f-4c53-8fc9-cc47672828d9","Type":"ContainerStarted","Data":"8934b4f6c3ac90bf212b1a3fc08e6fa2a760fecc0171723549ac5649935b484a"}
Jul 10 13:52:12.051209 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:12.051174    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:12.051371 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:12.051232    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:12.056452 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:12.056429    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:12.076082 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:12.076030    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-549nd" podStartSLOduration=139.424343845 podStartE2EDuration="2m21.0760134s" totalImagesPullingTime="1.651669555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:11.274826019 +0000 UTC m=+140.191870285" watchObservedRunningTime="2026-07-10 13:52:12.0760134 +0000 UTC m=+140.993057664"
Jul 10 13:52:12.259000 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:12.258971    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:52:12.321489 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:12.321423    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b699d79f-ptp9l"]
Jul 10 13:52:16.120202 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:16.120166    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:52:16.120699 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:16.120271    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:52:27.606022 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:27.605976    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-965d67f94-pndj4" podUID="aa29fd87-1528-4ed8-9706-27e5f0cf680d" containerName="registry" containerID="cri-o://1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410" gracePeriod=30
Jul 10 13:52:27.875288 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:27.875234    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:52:28.014432 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014401    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-trusted-ca\") pod \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") "
Jul 10 13:52:28.014614 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014461    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa29fd87-1528-4ed8-9706-27e5f0cf680d-ca-trust-extracted\") pod \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") "
Jul 10 13:52:28.014614 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014502    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") pod \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") "
Jul 10 13:52:28.014614 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014596    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-image-registry-private-configuration\") pod \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") "
Jul 10 13:52:28.014808 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014637    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-bound-sa-token\") pod \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") "
Jul 10 13:52:28.014808 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014688    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-installation-pull-secrets\") pod \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") "
Jul 10 13:52:28.014808 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014736    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm9xh\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-kube-api-access-wm9xh\") pod \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") "
Jul 10 13:52:28.014968 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014893    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aa29fd87-1528-4ed8-9706-27e5f0cf680d" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:52:28.014968 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.014952    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-certificates\") pod \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\" (UID: \"aa29fd87-1528-4ed8-9706-27e5f0cf680d\") "
Jul 10 13:52:28.015242 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.015210    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-trusted-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:28.015578 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.015544    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aa29fd87-1528-4ed8-9706-27e5f0cf680d" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:52:28.017232 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.017175    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aa29fd87-1528-4ed8-9706-27e5f0cf680d" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:52:28.017392 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.017373    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aa29fd87-1528-4ed8-9706-27e5f0cf680d" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:52:28.017455 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.017393    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aa29fd87-1528-4ed8-9706-27e5f0cf680d" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:52:28.017512 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.017467    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aa29fd87-1528-4ed8-9706-27e5f0cf680d" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:52:28.017628 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.017611    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-kube-api-access-wm9xh" (OuterVolumeSpecName: "kube-api-access-wm9xh") pod "aa29fd87-1528-4ed8-9706-27e5f0cf680d" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d"). InnerVolumeSpecName "kube-api-access-wm9xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:52:28.025458 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.025431    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa29fd87-1528-4ed8-9706-27e5f0cf680d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aa29fd87-1528-4ed8-9706-27e5f0cf680d" (UID: "aa29fd87-1528-4ed8-9706-27e5f0cf680d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:52:28.116018 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.115994    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-installation-pull-secrets\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:28.116018 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.116015    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm9xh\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-kube-api-access-wm9xh\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:28.116133 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.116025    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-certificates\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:28.116133 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.116033    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa29fd87-1528-4ed8-9706-27e5f0cf680d-ca-trust-extracted\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:28.116133 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.116042    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-registry-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:28.116133 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.116050    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa29fd87-1528-4ed8-9706-27e5f0cf680d-image-registry-private-configuration\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:28.116133 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.116059    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa29fd87-1528-4ed8-9706-27e5f0cf680d-bound-sa-token\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:28.321805 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.321774    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa29fd87-1528-4ed8-9706-27e5f0cf680d" containerID="1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410" exitCode=0
Jul 10 13:52:28.321918 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.321814    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-965d67f94-pndj4"
Jul 10 13:52:28.321918 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.321851    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-965d67f94-pndj4" event={"ID":"aa29fd87-1528-4ed8-9706-27e5f0cf680d","Type":"ContainerDied","Data":"1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410"}
Jul 10 13:52:28.321918 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.321900    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-965d67f94-pndj4" event={"ID":"aa29fd87-1528-4ed8-9706-27e5f0cf680d","Type":"ContainerDied","Data":"0a8db54b258b66b761e78d54f18009f8b663a7ab84517b09bb6252fef1fbb62a"}
Jul 10 13:52:28.322022 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.321920    2570 scope.go:117] "RemoveContainer" containerID="1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410"
Jul 10 13:52:28.331864 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.331838    2570 scope.go:117] "RemoveContainer" containerID="1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410"
Jul 10 13:52:28.332391 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:52:28.332360    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410\": container with ID starting with 1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410 not found: ID does not exist" containerID="1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410"
Jul 10 13:52:28.332488 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.332403    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410"} err="failed to get container status \"1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410\": rpc error: code = NotFound desc = could not find container \"1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410\": container with ID starting with 1fb246c0ae09d014045621b190a873c26d0b1a14b10acdf44fe01388b3d46410 not found: ID does not exist"
Jul 10 13:52:28.347060 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.347039    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-965d67f94-pndj4"]
Jul 10 13:52:28.351222 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:28.351202    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-965d67f94-pndj4"]
Jul 10 13:52:29.564271 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:29.564240    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa29fd87-1528-4ed8-9706-27e5f0cf680d" path="/var/lib/kubelet/pods/aa29fd87-1528-4ed8-9706-27e5f0cf680d/volumes"
Jul 10 13:52:36.125013 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:36.124984    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:52:36.129248 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:36.129226    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b857cf7b4-f8gmn"
Jul 10 13:52:37.352864 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.352800    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54b699d79f-ptp9l" podUID="4478ecbd-0cb1-44ae-816c-b19502f0b5eb" containerName="console" containerID="cri-o://894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1" gracePeriod=15
Jul 10 13:52:37.638080 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.638025    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:52:37.787196 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787170    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j4mt\" (UniqueName: \"kubernetes.io/projected/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-kube-api-access-7j4mt\") pod \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") "
Jul 10 13:52:37.787333 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787208    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-oauth-serving-cert\") pod \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") "
Jul 10 13:52:37.787333 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787232    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-config\") pod \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") "
Jul 10 13:52:37.787333 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787251    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-oauth-config\") pod \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") "
Jul 10 13:52:37.787496 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787362    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-serving-cert\") pod \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") "
Jul 10 13:52:37.787496 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787432    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-service-ca\") pod \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\" (UID: \"4478ecbd-0cb1-44ae-816c-b19502f0b5eb\") "
Jul 10 13:52:37.787640 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787607    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-config" (OuterVolumeSpecName: "console-config") pod "4478ecbd-0cb1-44ae-816c-b19502f0b5eb" (UID: "4478ecbd-0cb1-44ae-816c-b19502f0b5eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:52:37.787731 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787616    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4478ecbd-0cb1-44ae-816c-b19502f0b5eb" (UID: "4478ecbd-0cb1-44ae-816c-b19502f0b5eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:52:37.787855 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.787825    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "4478ecbd-0cb1-44ae-816c-b19502f0b5eb" (UID: "4478ecbd-0cb1-44ae-816c-b19502f0b5eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:52:37.789432 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.789405    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4478ecbd-0cb1-44ae-816c-b19502f0b5eb" (UID: "4478ecbd-0cb1-44ae-816c-b19502f0b5eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:52:37.789511 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.789439    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4478ecbd-0cb1-44ae-816c-b19502f0b5eb" (UID: "4478ecbd-0cb1-44ae-816c-b19502f0b5eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:52:37.789511 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.789461    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-kube-api-access-7j4mt" (OuterVolumeSpecName: "kube-api-access-7j4mt") pod "4478ecbd-0cb1-44ae-816c-b19502f0b5eb" (UID: "4478ecbd-0cb1-44ae-816c-b19502f0b5eb"). InnerVolumeSpecName "kube-api-access-7j4mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:52:37.887938 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.887910    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:37.887938 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.887935    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j4mt\" (UniqueName: \"kubernetes.io/projected/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-kube-api-access-7j4mt\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:37.888115 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.887945    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-oauth-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:37.888115 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.887955    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:37.888115 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.887965    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-oauth-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:37.888115 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:37.887973    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4478ecbd-0cb1-44ae-816c-b19502f0b5eb-console-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:52:38.361049 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.361018    2570 generic.go:356] "Generic (PLEG): container finished" podID="4478ecbd-0cb1-44ae-816c-b19502f0b5eb" containerID="894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1" exitCode=0
Jul 10 13:52:38.361411 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.361070    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b699d79f-ptp9l"
Jul 10 13:52:38.361411 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.361098    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b699d79f-ptp9l" event={"ID":"4478ecbd-0cb1-44ae-816c-b19502f0b5eb","Type":"ContainerDied","Data":"894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1"}
Jul 10 13:52:38.361411 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.361146    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b699d79f-ptp9l" event={"ID":"4478ecbd-0cb1-44ae-816c-b19502f0b5eb","Type":"ContainerDied","Data":"822f4f1396e1500ae2c42d6811b5a2bb78888f24be35a5846c32cfd80440288f"}
Jul 10 13:52:38.361411 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.361166    2570 scope.go:117] "RemoveContainer" containerID="894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1"
Jul 10 13:52:38.369110 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.369096    2570 scope.go:117] "RemoveContainer" containerID="894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1"
Jul 10 13:52:38.369334 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:52:38.369319    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1\": container with ID starting with 894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1 not found: ID does not exist" containerID="894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1"
Jul 10 13:52:38.369375 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.369342    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1"} err="failed to get container status \"894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1\": rpc error: code = NotFound desc = could not find container \"894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1\": container with ID starting with 894d6209dfc21ad623b8ddfd210626bba53e5e69727a80a84e55d0cdf95592c1 not found: ID does not exist"
Jul 10 13:52:38.380884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.380864    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b699d79f-ptp9l"]
Jul 10 13:52:38.390213 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:38.387657    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b699d79f-ptp9l"]
Jul 10 13:52:39.564404 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:52:39.564371    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4478ecbd-0cb1-44ae-816c-b19502f0b5eb" path="/var/lib/kubelet/pods/4478ecbd-0cb1-44ae-816c-b19502f0b5eb/volumes"
Jul 10 13:53:17.052124 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.052092    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7c556b8c-wcj99"]
Jul 10 13:53:17.052655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.052419    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4478ecbd-0cb1-44ae-816c-b19502f0b5eb" containerName="console"
Jul 10 13:53:17.052655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.052432    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4478ecbd-0cb1-44ae-816c-b19502f0b5eb" containerName="console"
Jul 10 13:53:17.052655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.052443    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa29fd87-1528-4ed8-9706-27e5f0cf680d" containerName="registry"
Jul 10 13:53:17.052655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.052448    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa29fd87-1528-4ed8-9706-27e5f0cf680d" containerName="registry"
Jul 10 13:53:17.052655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.052497    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4478ecbd-0cb1-44ae-816c-b19502f0b5eb" containerName="console"
Jul 10 13:53:17.052655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.052507    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa29fd87-1528-4ed8-9706-27e5f0cf680d" containerName="registry"
Jul 10 13:53:17.054246 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.054223    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.076659 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.076628    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-trusted-ca-bundle\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.076773 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.076663    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzfbz\" (UniqueName: \"kubernetes.io/projected/59750426-10e9-4a66-afce-9dc170f383fa-kube-api-access-lzfbz\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.076773 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.076682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-oauth-config\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.076773 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.076700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-service-ca\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.076893 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.076786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-serving-cert\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.079011 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.076814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-console-config\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.079314 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.079290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-oauth-serving-cert\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.082398 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.082375    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7c556b8c-wcj99"]
Jul 10 13:53:17.180429 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.180391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-serving-cert\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.180584 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.180428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-console-config\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.180584 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.180500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-oauth-serving-cert\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.180584 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.180544    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-trusted-ca-bundle\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.180584 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.180569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzfbz\" (UniqueName: \"kubernetes.io/projected/59750426-10e9-4a66-afce-9dc170f383fa-kube-api-access-lzfbz\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.180822 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.180599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-oauth-config\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.180822 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.180628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-service-ca\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.181427 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.181402    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-oauth-serving-cert\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.181427 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.181420    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-service-ca\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.181556 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.181402    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-console-config\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.181556 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.181501    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-trusted-ca-bundle\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.182890 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.182868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-serving-cert\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.182994 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.182976    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-oauth-config\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.189868 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.189846    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzfbz\" (UniqueName: \"kubernetes.io/projected/59750426-10e9-4a66-afce-9dc170f383fa-kube-api-access-lzfbz\") pod \"console-5d7c556b8c-wcj99\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") " pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.362912 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.362827    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:17.486068 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.486036    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7c556b8c-wcj99"]
Jul 10 13:53:17.488850 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:53:17.488816    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59750426_10e9_4a66_afce_9dc170f383fa.slice/crio-ad547cbd223f32e6f33361472d08f6e97eb5344b7a9dbb9076ea89bd695f50d2 WatchSource:0}: Error finding container ad547cbd223f32e6f33361472d08f6e97eb5344b7a9dbb9076ea89bd695f50d2: Status 404 returned error can't find the container with id ad547cbd223f32e6f33361472d08f6e97eb5344b7a9dbb9076ea89bd695f50d2
Jul 10 13:53:17.510306 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:17.510282    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7c556b8c-wcj99" event={"ID":"59750426-10e9-4a66-afce-9dc170f383fa","Type":"ContainerStarted","Data":"ad547cbd223f32e6f33361472d08f6e97eb5344b7a9dbb9076ea89bd695f50d2"}
Jul 10 13:53:18.515899 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:18.515865    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7c556b8c-wcj99" event={"ID":"59750426-10e9-4a66-afce-9dc170f383fa","Type":"ContainerStarted","Data":"7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042"}
Jul 10 13:53:18.538128 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:18.538082    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7c556b8c-wcj99" podStartSLOduration=1.538066092 podStartE2EDuration="1.538066092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:53:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:53:18.537327678 +0000 UTC m=+207.454371942" watchObservedRunningTime="2026-07-10 13:53:18.538066092 +0000 UTC m=+207.455110355"
Jul 10 13:53:27.362978 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:27.362942    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:27.363417 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:27.363030    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:27.367682 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:27.367658    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:27.552479 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:27.552453    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:53:27.605253 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:27.605221    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6dddcb7b-75wsq"]
Jul 10 13:53:52.627680 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.627613    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c6dddcb7b-75wsq" podUID="1fb5cff3-46f0-492e-986e-936af8563d14" containerName="console" containerID="cri-o://1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0" gracePeriod=15
Jul 10 13:53:52.863798 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.863774    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:53:52.959816 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.959789    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-oauth-serving-cert\") pod \"1fb5cff3-46f0-492e-986e-936af8563d14\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") "
Jul 10 13:53:52.959937 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.959829    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-console-config\") pod \"1fb5cff3-46f0-492e-986e-936af8563d14\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") "
Jul 10 13:53:52.959937 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.959849    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjpt5\" (UniqueName: \"kubernetes.io/projected/1fb5cff3-46f0-492e-986e-936af8563d14-kube-api-access-rjpt5\") pod \"1fb5cff3-46f0-492e-986e-936af8563d14\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") "
Jul 10 13:53:52.959937 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.959870    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-service-ca\") pod \"1fb5cff3-46f0-492e-986e-936af8563d14\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") "
Jul 10 13:53:52.959937 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.959897    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-trusted-ca-bundle\") pod \"1fb5cff3-46f0-492e-986e-936af8563d14\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") "
Jul 10 13:53:52.960122 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.959947    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-serving-cert\") pod \"1fb5cff3-46f0-492e-986e-936af8563d14\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") "
Jul 10 13:53:52.960122 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.959973    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-oauth-config\") pod \"1fb5cff3-46f0-492e-986e-936af8563d14\" (UID: \"1fb5cff3-46f0-492e-986e-936af8563d14\") "
Jul 10 13:53:52.960224 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.960139    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-console-config" (OuterVolumeSpecName: "console-config") pod "1fb5cff3-46f0-492e-986e-936af8563d14" (UID: "1fb5cff3-46f0-492e-986e-936af8563d14"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:52.960351 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.960332    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-console-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:53:52.960433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.960363    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-service-ca" (OuterVolumeSpecName: "service-ca") pod "1fb5cff3-46f0-492e-986e-936af8563d14" (UID: "1fb5cff3-46f0-492e-986e-936af8563d14"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:52.960433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.960379    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1fb5cff3-46f0-492e-986e-936af8563d14" (UID: "1fb5cff3-46f0-492e-986e-936af8563d14"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:52.960433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.960368    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1fb5cff3-46f0-492e-986e-936af8563d14" (UID: "1fb5cff3-46f0-492e-986e-936af8563d14"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:52.961996 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.961974    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1fb5cff3-46f0-492e-986e-936af8563d14" (UID: "1fb5cff3-46f0-492e-986e-936af8563d14"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:52.962063 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.962020    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1fb5cff3-46f0-492e-986e-936af8563d14" (UID: "1fb5cff3-46f0-492e-986e-936af8563d14"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:52.962102 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:52.962062    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb5cff3-46f0-492e-986e-936af8563d14-kube-api-access-rjpt5" (OuterVolumeSpecName: "kube-api-access-rjpt5") pod "1fb5cff3-46f0-492e-986e-936af8563d14" (UID: "1fb5cff3-46f0-492e-986e-936af8563d14"). InnerVolumeSpecName "kube-api-access-rjpt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:53:53.061023 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.060997    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-oauth-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:53:53.061023 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.061021    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjpt5\" (UniqueName: \"kubernetes.io/projected/1fb5cff3-46f0-492e-986e-936af8563d14-kube-api-access-rjpt5\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:53:53.061166 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.061030    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:53:53.061166 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.061039    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fb5cff3-46f0-492e-986e-936af8563d14-trusted-ca-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:53:53.061166 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.061048    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:53:53.061166 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.061056    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fb5cff3-46f0-492e-986e-936af8563d14-console-oauth-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:53:53.643465 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.643426    2570 generic.go:356] "Generic (PLEG): container finished" podID="1fb5cff3-46f0-492e-986e-936af8563d14" containerID="1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0" exitCode=0
Jul 10 13:53:53.643834 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.643462    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6dddcb7b-75wsq" event={"ID":"1fb5cff3-46f0-492e-986e-936af8563d14","Type":"ContainerDied","Data":"1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0"}
Jul 10 13:53:53.643834 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.643471    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6dddcb7b-75wsq"
Jul 10 13:53:53.643834 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.643513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6dddcb7b-75wsq" event={"ID":"1fb5cff3-46f0-492e-986e-936af8563d14","Type":"ContainerDied","Data":"90131908a7e639af519a42a3cccbe8369ebafd65ed13ad35e87ad9db5520e796"}
Jul 10 13:53:53.643834 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.643533    2570 scope.go:117] "RemoveContainer" containerID="1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0"
Jul 10 13:53:53.651446 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.651426    2570 scope.go:117] "RemoveContainer" containerID="1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0"
Jul 10 13:53:53.651708 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:53:53.651690    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0\": container with ID starting with 1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0 not found: ID does not exist" containerID="1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0"
Jul 10 13:53:53.651775 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.651716    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0"} err="failed to get container status \"1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0\": rpc error: code = NotFound desc = could not find container \"1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0\": container with ID starting with 1cee3bc4cfeb568ffc16cbd0834be4eb2cd15afbf8a502cde365de54432f1ac0 not found: ID does not exist"
Jul 10 13:53:53.663812 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.661107    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6dddcb7b-75wsq"]
Jul 10 13:53:53.665568 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:53.665547    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6dddcb7b-75wsq"]
Jul 10 13:53:55.564390 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:53:55.564357    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb5cff3-46f0-492e-986e-936af8563d14" path="/var/lib/kubelet/pods/1fb5cff3-46f0-492e-986e-936af8563d14/volumes"
Jul 10 13:54:33.338331 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.338294    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"]
Jul 10 13:54:33.338858 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.338759    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb5cff3-46f0-492e-986e-936af8563d14" containerName="console"
Jul 10 13:54:33.338858 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.338780    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb5cff3-46f0-492e-986e-936af8563d14" containerName="console"
Jul 10 13:54:33.338979 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.338862    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb5cff3-46f0-492e-986e-936af8563d14" containerName="console"
Jul 10 13:54:33.340721 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.340700    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.344097 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.344074    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 13:54:33.344972 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.344955    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h7hf2\""
Jul 10 13:54:33.345052 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.344954    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 13:54:33.352082 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.352062    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"]
Jul 10 13:54:33.456019 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.455985    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.456019 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.456022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.456224 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.456047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-268qt\" (UniqueName: \"kubernetes.io/projected/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-kube-api-access-268qt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.557444 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.557408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.557628 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.557451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.557628 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.557488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-268qt\" (UniqueName: \"kubernetes.io/projected/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-kube-api-access-268qt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.557835 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.557815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.557925 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.557888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.566600 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.566574    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-268qt\" (UniqueName: \"kubernetes.io/projected/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-kube-api-access-268qt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.649846 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.649775    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:33.774576 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.774549    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"]
Jul 10 13:54:33.777054 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:54:33.777019    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b31e8f_c1de_4c39_9dba_09ef1fba9257.slice/crio-c5c67ab299660870260184c15661f4dbd35b754f05a08ce1927343071103f7c5 WatchSource:0}: Error finding container c5c67ab299660870260184c15661f4dbd35b754f05a08ce1927343071103f7c5: Status 404 returned error can't find the container with id c5c67ab299660870260184c15661f4dbd35b754f05a08ce1927343071103f7c5
Jul 10 13:54:33.798704 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:33.798675    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4" event={"ID":"c0b31e8f-c1de-4c39-9dba-09ef1fba9257","Type":"ContainerStarted","Data":"c5c67ab299660870260184c15661f4dbd35b754f05a08ce1927343071103f7c5"}
Jul 10 13:54:42.835889 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:42.835850    2570 generic.go:356] "Generic (PLEG): container finished" podID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerID="9501ff99c5a02162626edc100ccd540fdd1201957a4a1db2f634491df21c33f4" exitCode=0
Jul 10 13:54:42.836385 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:42.835941    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4" event={"ID":"c0b31e8f-c1de-4c39-9dba-09ef1fba9257","Type":"ContainerDied","Data":"9501ff99c5a02162626edc100ccd540fdd1201957a4a1db2f634491df21c33f4"}
Jul 10 13:54:44.847665 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:44.847600    2570 generic.go:356] "Generic (PLEG): container finished" podID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerID="a550dd497bf4fb50729408ef8f4a9cdc4db06fc497cde3b3c7bcb30ac0535348" exitCode=0
Jul 10 13:54:44.847988 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:44.847690    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4" event={"ID":"c0b31e8f-c1de-4c39-9dba-09ef1fba9257","Type":"ContainerDied","Data":"a550dd497bf4fb50729408ef8f4a9cdc4db06fc497cde3b3c7bcb30ac0535348"}
Jul 10 13:54:53.599878 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:53.599853    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 13:54:53.600289 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:53.600218    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 13:54:53.605968 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:53.605948    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 13:54:53.886493 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:53.886429    2570 generic.go:356] "Generic (PLEG): container finished" podID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerID="5f232090a696b600cbb5c99d53b5eab77112bafb4f6e4c19319b1a80b36431c2" exitCode=0
Jul 10 13:54:53.886493 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:53.886465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4" event={"ID":"c0b31e8f-c1de-4c39-9dba-09ef1fba9257","Type":"ContainerDied","Data":"5f232090a696b600cbb5c99d53b5eab77112bafb4f6e4c19319b1a80b36431c2"}
Jul 10 13:54:55.026907 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.026884    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:55.137678 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.137649    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-bundle\") pod \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") "
Jul 10 13:54:55.137678 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.137683    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-268qt\" (UniqueName: \"kubernetes.io/projected/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-kube-api-access-268qt\") pod \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") "
Jul 10 13:54:55.137878 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.137735    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-util\") pod \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\" (UID: \"c0b31e8f-c1de-4c39-9dba-09ef1fba9257\") "
Jul 10 13:54:55.138372 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.138349    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-bundle" (OuterVolumeSpecName: "bundle") pod "c0b31e8f-c1de-4c39-9dba-09ef1fba9257" (UID: "c0b31e8f-c1de-4c39-9dba-09ef1fba9257"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:54:55.139895 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.139877    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-kube-api-access-268qt" (OuterVolumeSpecName: "kube-api-access-268qt") pod "c0b31e8f-c1de-4c39-9dba-09ef1fba9257" (UID: "c0b31e8f-c1de-4c39-9dba-09ef1fba9257"). InnerVolumeSpecName "kube-api-access-268qt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:54:55.143319 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.143267    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-util" (OuterVolumeSpecName: "util") pod "c0b31e8f-c1de-4c39-9dba-09ef1fba9257" (UID: "c0b31e8f-c1de-4c39-9dba-09ef1fba9257"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:54:55.238715 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.238684    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:54:55.238715 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.238707    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:54:55.238715 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.238716    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-268qt\" (UniqueName: \"kubernetes.io/projected/c0b31e8f-c1de-4c39-9dba-09ef1fba9257-kube-api-access-268qt\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:54:55.896563 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.896491    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4"
Jul 10 13:54:55.896563 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.896520    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xf4" event={"ID":"c0b31e8f-c1de-4c39-9dba-09ef1fba9257","Type":"ContainerDied","Data":"c5c67ab299660870260184c15661f4dbd35b754f05a08ce1927343071103f7c5"}
Jul 10 13:54:55.896725 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:54:55.896568    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5c67ab299660870260184c15661f4dbd35b754f05a08ce1927343071103f7c5"
Jul 10 13:55:01.601795 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.601761    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"]
Jul 10 13:55:01.602158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.602030    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerName="extract"
Jul 10 13:55:01.602158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.602040    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerName="extract"
Jul 10 13:55:01.602158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.602050    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerName="pull"
Jul 10 13:55:01.602158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.602055    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerName="pull"
Jul 10 13:55:01.602158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.602066    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerName="util"
Jul 10 13:55:01.602158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.602072    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerName="util"
Jul 10 13:55:01.602158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.602126    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b31e8f-c1de-4c39-9dba-09ef1fba9257" containerName="extract"
Jul 10 13:55:01.605378 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.605357    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"
Jul 10 13:55:01.607863 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.607843    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 10 13:55:01.608155 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.608129    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 10 13:55:01.608437 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.608421    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dnvd8\""
Jul 10 13:55:01.618706 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.618685    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"]
Jul 10 13:55:01.688516 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.688488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5djvk\" (UniqueName: \"kubernetes.io/projected/386ef8cd-e6d2-4cad-99a4-05b5ee155edf-kube-api-access-5djvk\") pod \"cert-manager-operator-controller-manager-55c444bf86-tzz7q\" (UID: \"386ef8cd-e6d2-4cad-99a4-05b5ee155edf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"
Jul 10 13:55:01.688628 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.688533    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386ef8cd-e6d2-4cad-99a4-05b5ee155edf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tzz7q\" (UID: \"386ef8cd-e6d2-4cad-99a4-05b5ee155edf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"
Jul 10 13:55:01.789221 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.789174    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5djvk\" (UniqueName: \"kubernetes.io/projected/386ef8cd-e6d2-4cad-99a4-05b5ee155edf-kube-api-access-5djvk\") pod \"cert-manager-operator-controller-manager-55c444bf86-tzz7q\" (UID: \"386ef8cd-e6d2-4cad-99a4-05b5ee155edf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"
Jul 10 13:55:01.789410 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.789252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386ef8cd-e6d2-4cad-99a4-05b5ee155edf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tzz7q\" (UID: \"386ef8cd-e6d2-4cad-99a4-05b5ee155edf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"
Jul 10 13:55:01.789643 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.789623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386ef8cd-e6d2-4cad-99a4-05b5ee155edf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tzz7q\" (UID: \"386ef8cd-e6d2-4cad-99a4-05b5ee155edf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"
Jul 10 13:55:01.797652 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.797621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5djvk\" (UniqueName: \"kubernetes.io/projected/386ef8cd-e6d2-4cad-99a4-05b5ee155edf-kube-api-access-5djvk\") pod \"cert-manager-operator-controller-manager-55c444bf86-tzz7q\" (UID: \"386ef8cd-e6d2-4cad-99a4-05b5ee155edf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"
Jul 10 13:55:01.913920 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:01.913832    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"
Jul 10 13:55:02.044883 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:02.044805    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q"]
Jul 10 13:55:02.047716 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:55:02.047690    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386ef8cd_e6d2_4cad_99a4_05b5ee155edf.slice/crio-3fd1052e909d543cdd0205c34e902f3810164880fcd05f6319b09e8f6c3c7120 WatchSource:0}: Error finding container 3fd1052e909d543cdd0205c34e902f3810164880fcd05f6319b09e8f6c3c7120: Status 404 returned error can't find the container with id 3fd1052e909d543cdd0205c34e902f3810164880fcd05f6319b09e8f6c3c7120
Jul 10 13:55:02.050446 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:02.050427    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 13:55:02.925572 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:02.925529    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q" event={"ID":"386ef8cd-e6d2-4cad-99a4-05b5ee155edf","Type":"ContainerStarted","Data":"3fd1052e909d543cdd0205c34e902f3810164880fcd05f6319b09e8f6c3c7120"}
Jul 10 13:55:03.932078 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:03.932041    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q" event={"ID":"386ef8cd-e6d2-4cad-99a4-05b5ee155edf","Type":"ContainerStarted","Data":"5fc0244af01357e02b78a847a3221d3b6f39600ea9237b33205873d818ff0435"}
Jul 10 13:55:03.954072 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:03.954022    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tzz7q" podStartSLOduration=1.2840960319999999 podStartE2EDuration="2.954003798s" totalImagesPullingTime="1.669907766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:55:03.952606573 +0000 UTC m=+312.869650835" watchObservedRunningTime="2026-07-10 13:55:03.954003798 +0000 UTC m=+312.871048061"
Jul 10 13:55:05.292240 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.292195    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"]
Jul 10 13:55:05.298649 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.298620    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.301721 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.301694    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h7hf2\""
Jul 10 13:55:05.302323 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.302304    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 13:55:05.302405 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.302315    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 13:55:05.317964 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.317943    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"]
Jul 10 13:55:05.421708 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.421682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.421863 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.421716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qf5\" (UniqueName: \"kubernetes.io/projected/92d810f0-7c3e-4b70-a5de-c34a54066e27-kube-api-access-w2qf5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.421863 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.421739    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.522939 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.522910    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.523050 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.522941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qf5\" (UniqueName: \"kubernetes.io/projected/92d810f0-7c3e-4b70-a5de-c34a54066e27-kube-api-access-w2qf5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.523050 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.522966    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.523274 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.523255    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.523329 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.523311    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.530788 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.530736    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qf5\" (UniqueName: \"kubernetes.io/projected/92d810f0-7c3e-4b70-a5de-c34a54066e27-kube-api-access-w2qf5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.607473 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.607406    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:05.609561 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.609288    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fddkr"]
Jul 10 13:55:05.611685 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.611667    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:05.614164 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.614141    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 13:55:05.614164 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.614159    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 13:55:05.622025 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.622001    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fddkr"]
Jul 10 13:55:05.724266 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.724240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d00d963e-ea97-4304-b6b5-0c73c3efd2ef-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fddkr\" (UID: \"d00d963e-ea97-4304-b6b5-0c73c3efd2ef\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:05.724432 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.724278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhdn9\" (UniqueName: \"kubernetes.io/projected/d00d963e-ea97-4304-b6b5-0c73c3efd2ef-kube-api-access-vhdn9\") pod \"cert-manager-webhook-6486ffd997-fddkr\" (UID: \"d00d963e-ea97-4304-b6b5-0c73c3efd2ef\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:05.734032 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.734011    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"]
Jul 10 13:55:05.736398 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:55:05.736375    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d810f0_7c3e_4b70_a5de_c34a54066e27.slice/crio-fe7ee7b5538552fb468e278720352cd58439124b3869ca9282ac23e899339587 WatchSource:0}: Error finding container fe7ee7b5538552fb468e278720352cd58439124b3869ca9282ac23e899339587: Status 404 returned error can't find the container with id fe7ee7b5538552fb468e278720352cd58439124b3869ca9282ac23e899339587
Jul 10 13:55:05.825064 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.825027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d00d963e-ea97-4304-b6b5-0c73c3efd2ef-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fddkr\" (UID: \"d00d963e-ea97-4304-b6b5-0c73c3efd2ef\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:05.825210 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.825071    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhdn9\" (UniqueName: \"kubernetes.io/projected/d00d963e-ea97-4304-b6b5-0c73c3efd2ef-kube-api-access-vhdn9\") pod \"cert-manager-webhook-6486ffd997-fddkr\" (UID: \"d00d963e-ea97-4304-b6b5-0c73c3efd2ef\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:05.833177 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.833152    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d00d963e-ea97-4304-b6b5-0c73c3efd2ef-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fddkr\" (UID: \"d00d963e-ea97-4304-b6b5-0c73c3efd2ef\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:05.833288 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.833184    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhdn9\" (UniqueName: \"kubernetes.io/projected/d00d963e-ea97-4304-b6b5-0c73c3efd2ef-kube-api-access-vhdn9\") pod \"cert-manager-webhook-6486ffd997-fddkr\" (UID: \"d00d963e-ea97-4304-b6b5-0c73c3efd2ef\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:05.933949 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.933879    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:05.944796 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.944761    2570 generic.go:356] "Generic (PLEG): container finished" podID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerID="a452b36773c94590a2fcfa4c351ff1f7f43fb86b2a379bab78113e5181ab8f1b" exitCode=0
Jul 10 13:55:05.944904 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.944804    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m" event={"ID":"92d810f0-7c3e-4b70-a5de-c34a54066e27","Type":"ContainerDied","Data":"a452b36773c94590a2fcfa4c351ff1f7f43fb86b2a379bab78113e5181ab8f1b"}
Jul 10 13:55:05.944904 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:05.944864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m" event={"ID":"92d810f0-7c3e-4b70-a5de-c34a54066e27","Type":"ContainerStarted","Data":"fe7ee7b5538552fb468e278720352cd58439124b3869ca9282ac23e899339587"}
Jul 10 13:55:06.057861 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:06.057829    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fddkr"]
Jul 10 13:55:06.061037 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:55:06.061013    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd00d963e_ea97_4304_b6b5_0c73c3efd2ef.slice/crio-e055c08f8689588e1434a893657ec822fa6209bb1aa860263b666e72fb34a796 WatchSource:0}: Error finding container e055c08f8689588e1434a893657ec822fa6209bb1aa860263b666e72fb34a796: Status 404 returned error can't find the container with id e055c08f8689588e1434a893657ec822fa6209bb1aa860263b666e72fb34a796
Jul 10 13:55:06.952760 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:06.952685    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr" event={"ID":"d00d963e-ea97-4304-b6b5-0c73c3efd2ef","Type":"ContainerStarted","Data":"e055c08f8689588e1434a893657ec822fa6209bb1aa860263b666e72fb34a796"}
Jul 10 13:55:07.709527 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.709492    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"]
Jul 10 13:55:07.715254 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.715224    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"
Jul 10 13:55:07.717497 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.717435    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vcq64\""
Jul 10 13:55:07.721992 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.721965    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"]
Jul 10 13:55:07.841230 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.841195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25q6b\" (UniqueName: \"kubernetes.io/projected/faba5e8b-d959-44c1-a882-dd16adb1a710-kube-api-access-25q6b\") pod \"cert-manager-cainjector-559cdd8c87-jcnl7\" (UID: \"faba5e8b-d959-44c1-a882-dd16adb1a710\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"
Jul 10 13:55:07.841402 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.841239    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faba5e8b-d959-44c1-a882-dd16adb1a710-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jcnl7\" (UID: \"faba5e8b-d959-44c1-a882-dd16adb1a710\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"
Jul 10 13:55:07.942510 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.942471    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25q6b\" (UniqueName: \"kubernetes.io/projected/faba5e8b-d959-44c1-a882-dd16adb1a710-kube-api-access-25q6b\") pod \"cert-manager-cainjector-559cdd8c87-jcnl7\" (UID: \"faba5e8b-d959-44c1-a882-dd16adb1a710\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"
Jul 10 13:55:07.942687 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.942528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faba5e8b-d959-44c1-a882-dd16adb1a710-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jcnl7\" (UID: \"faba5e8b-d959-44c1-a882-dd16adb1a710\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"
Jul 10 13:55:07.950914 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.950883    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25q6b\" (UniqueName: \"kubernetes.io/projected/faba5e8b-d959-44c1-a882-dd16adb1a710-kube-api-access-25q6b\") pod \"cert-manager-cainjector-559cdd8c87-jcnl7\" (UID: \"faba5e8b-d959-44c1-a882-dd16adb1a710\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"
Jul 10 13:55:07.951084 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:07.950976    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faba5e8b-d959-44c1-a882-dd16adb1a710-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jcnl7\" (UID: \"faba5e8b-d959-44c1-a882-dd16adb1a710\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"
Jul 10 13:55:08.027916 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:08.027837    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"
Jul 10 13:55:09.236310 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:09.236279    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7"]
Jul 10 13:55:09.237908 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:55:09.237822    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaba5e8b_d959_44c1_a882_dd16adb1a710.slice/crio-d4c6f95f8cf5fe56907b422521b77439d1b34e7de707ac431ee98afb7b21a9f4 WatchSource:0}: Error finding container d4c6f95f8cf5fe56907b422521b77439d1b34e7de707ac431ee98afb7b21a9f4: Status 404 returned error can't find the container with id d4c6f95f8cf5fe56907b422521b77439d1b34e7de707ac431ee98afb7b21a9f4
Jul 10 13:55:09.971098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:09.971065    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7" event={"ID":"faba5e8b-d959-44c1-a882-dd16adb1a710","Type":"ContainerStarted","Data":"5ec63a8eedd1fd476118406b81cfb9b7e28854680651c870322de29534c4f21b"}
Jul 10 13:55:09.971098 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:09.971110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7" event={"ID":"faba5e8b-d959-44c1-a882-dd16adb1a710","Type":"ContainerStarted","Data":"d4c6f95f8cf5fe56907b422521b77439d1b34e7de707ac431ee98afb7b21a9f4"}
Jul 10 13:55:09.972572 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:09.972547    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr" event={"ID":"d00d963e-ea97-4304-b6b5-0c73c3efd2ef","Type":"ContainerStarted","Data":"48d38f19a8091c16f9635b9c7d759df0f3daf25e6749d9e35c9ab10e954a08be"}
Jul 10 13:55:09.972687 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:09.972624    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:09.974303 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:09.974269    2570 generic.go:356] "Generic (PLEG): container finished" podID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerID="6aaeda7eee4b82cb63fd1415468e0c2628577b77d20e6dcfd8d5ea6e53fcfa42" exitCode=0
Jul 10 13:55:09.974421 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:09.974312    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m" event={"ID":"92d810f0-7c3e-4b70-a5de-c34a54066e27","Type":"ContainerDied","Data":"6aaeda7eee4b82cb63fd1415468e0c2628577b77d20e6dcfd8d5ea6e53fcfa42"}
Jul 10 13:55:09.987415 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:09.987369    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jcnl7" podStartSLOduration=2.987355384 podStartE2EDuration="2.987355384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:55:09.985916712 +0000 UTC m=+318.902960989" watchObservedRunningTime="2026-07-10 13:55:09.987355384 +0000 UTC m=+318.904399646"
Jul 10 13:55:10.017736 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:10.017684    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr" podStartSLOduration=1.96248131 podStartE2EDuration="5.017663005s" totalImagesPullingTime="3.055181695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:55:10.017054896 +0000 UTC m=+318.934099152" watchObservedRunningTime="2026-07-10 13:55:10.017663005 +0000 UTC m=+318.934707271"
Jul 10 13:55:10.982312 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:10.982271    2570 generic.go:356] "Generic (PLEG): container finished" podID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerID="45755e6733ae31b58af6d40e1097a96f773787f6964387009bced1fd606a1fdf" exitCode=0
Jul 10 13:55:10.982685 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:10.982348    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m" event={"ID":"92d810f0-7c3e-4b70-a5de-c34a54066e27","Type":"ContainerDied","Data":"45755e6733ae31b58af6d40e1097a96f773787f6964387009bced1fd606a1fdf"}
Jul 10 13:55:12.114714 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.114685    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:12.279964 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.279877    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-bundle\") pod \"92d810f0-7c3e-4b70-a5de-c34a54066e27\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") "
Jul 10 13:55:12.279964 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.279957    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-util\") pod \"92d810f0-7c3e-4b70-a5de-c34a54066e27\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") "
Jul 10 13:55:12.280138 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.280030    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2qf5\" (UniqueName: \"kubernetes.io/projected/92d810f0-7c3e-4b70-a5de-c34a54066e27-kube-api-access-w2qf5\") pod \"92d810f0-7c3e-4b70-a5de-c34a54066e27\" (UID: \"92d810f0-7c3e-4b70-a5de-c34a54066e27\") "
Jul 10 13:55:12.280320 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.280295    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-bundle" (OuterVolumeSpecName: "bundle") pod "92d810f0-7c3e-4b70-a5de-c34a54066e27" (UID: "92d810f0-7c3e-4b70-a5de-c34a54066e27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:55:12.282086 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.282057    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92d810f0-7c3e-4b70-a5de-c34a54066e27-kube-api-access-w2qf5" (OuterVolumeSpecName: "kube-api-access-w2qf5") pod "92d810f0-7c3e-4b70-a5de-c34a54066e27" (UID: "92d810f0-7c3e-4b70-a5de-c34a54066e27"). InnerVolumeSpecName "kube-api-access-w2qf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:55:12.284586 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.284560    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-util" (OuterVolumeSpecName: "util") pod "92d810f0-7c3e-4b70-a5de-c34a54066e27" (UID: "92d810f0-7c3e-4b70-a5de-c34a54066e27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:55:12.381105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.381072    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2qf5\" (UniqueName: \"kubernetes.io/projected/92d810f0-7c3e-4b70-a5de-c34a54066e27-kube-api-access-w2qf5\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:55:12.381105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.381101    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:55:12.381105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.381111    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92d810f0-7c3e-4b70-a5de-c34a54066e27-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:55:12.992575 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.992547    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m"
Jul 10 13:55:12.992718 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.992546    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdh8m" event={"ID":"92d810f0-7c3e-4b70-a5de-c34a54066e27","Type":"ContainerDied","Data":"fe7ee7b5538552fb468e278720352cd58439124b3869ca9282ac23e899339587"}
Jul 10 13:55:12.992718 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:12.992669    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe7ee7b5538552fb468e278720352cd58439124b3869ca9282ac23e899339587"
Jul 10 13:55:15.984351 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:15.984322    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fddkr"
Jul 10 13:55:30.016107 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.016075    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"]
Jul 10 13:55:30.016459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.016371    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerName="pull"
Jul 10 13:55:30.016459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.016383    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerName="pull"
Jul 10 13:55:30.016459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.016391    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerName="extract"
Jul 10 13:55:30.016459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.016397    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerName="extract"
Jul 10 13:55:30.016459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.016412    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerName="util"
Jul 10 13:55:30.016459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.016419    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerName="util"
Jul 10 13:55:30.016666 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.016472    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="92d810f0-7c3e-4b70-a5de-c34a54066e27" containerName="extract"
Jul 10 13:55:30.018511 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.018491    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.021014 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.020993    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 13:55:30.021115 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.020994    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 13:55:30.021690 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.021670    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h7hf2\""
Jul 10 13:55:30.028879 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.028859    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"]
Jul 10 13:55:30.100898 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.100870    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfv4r\" (UniqueName: \"kubernetes.io/projected/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-kube-api-access-wfv4r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.101019 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.100940    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.101019 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.100967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.201579 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.201519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfv4r\" (UniqueName: \"kubernetes.io/projected/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-kube-api-access-wfv4r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.201662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.201579    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.201662 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.201607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.201978 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.201959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.201978 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.201969    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.210011 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.209992    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfv4r\" (UniqueName: \"kubernetes.io/projected/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-kube-api-access-wfv4r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.327548 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.327520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:30.459324 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:30.459249    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"]
Jul 10 13:55:30.464209 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:55:30.464175    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c6adcb_b8f9_4a08_ac21_b478aaaf49ca.slice/crio-344b820f1116edc778e8f413ad0a3edc0edd9b2d2d233b89913fa66ac4ec00a4 WatchSource:0}: Error finding container 344b820f1116edc778e8f413ad0a3edc0edd9b2d2d233b89913fa66ac4ec00a4: Status 404 returned error can't find the container with id 344b820f1116edc778e8f413ad0a3edc0edd9b2d2d233b89913fa66ac4ec00a4
Jul 10 13:55:31.072757 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:31.072711    2570 generic.go:356] "Generic (PLEG): container finished" podID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerID="ebfb16cedc7f5bc9d696b69787fa5842e88e1ea4c896c193a7313946f2122d0c" exitCode=0
Jul 10 13:55:31.073111 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:31.072783    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf" event={"ID":"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca","Type":"ContainerDied","Data":"ebfb16cedc7f5bc9d696b69787fa5842e88e1ea4c896c193a7313946f2122d0c"}
Jul 10 13:55:31.073111 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:31.072842    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf" event={"ID":"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca","Type":"ContainerStarted","Data":"344b820f1116edc778e8f413ad0a3edc0edd9b2d2d233b89913fa66ac4ec00a4"}
Jul 10 13:55:32.078364 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:32.078268    2570 generic.go:356] "Generic (PLEG): container finished" podID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerID="60aec783910f63a02ce1f91640a7d85c86bff935dbcf8ea9551c3ecd5a325a6f" exitCode=0
Jul 10 13:55:32.078364 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:32.078353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf" event={"ID":"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca","Type":"ContainerDied","Data":"60aec783910f63a02ce1f91640a7d85c86bff935dbcf8ea9551c3ecd5a325a6f"}
Jul 10 13:55:33.084586 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:33.084548    2570 generic.go:356] "Generic (PLEG): container finished" podID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerID="865431f8819749ea7fc8224a284ef32710f036153f0cc8d774d94b54b4f3af15" exitCode=0
Jul 10 13:55:33.084980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:33.084644    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf" event={"ID":"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca","Type":"ContainerDied","Data":"865431f8819749ea7fc8224a284ef32710f036153f0cc8d774d94b54b4f3af15"}
Jul 10 13:55:34.207826 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.207801    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:34.233595 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.233568    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-bundle\") pod \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") "
Jul 10 13:55:34.233711 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.233619    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfv4r\" (UniqueName: \"kubernetes.io/projected/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-kube-api-access-wfv4r\") pod \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") "
Jul 10 13:55:34.233711 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.233664    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-util\") pod \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\" (UID: \"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca\") "
Jul 10 13:55:34.234340 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.234308    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-bundle" (OuterVolumeSpecName: "bundle") pod "c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" (UID: "c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:55:34.235705 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.235668    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-kube-api-access-wfv4r" (OuterVolumeSpecName: "kube-api-access-wfv4r") pod "c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" (UID: "c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca"). InnerVolumeSpecName "kube-api-access-wfv4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:55:34.239558 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.239534    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-util" (OuterVolumeSpecName: "util") pod "c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" (UID: "c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:55:34.334303 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.334264    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:55:34.334303 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.334302    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfv4r\" (UniqueName: \"kubernetes.io/projected/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-kube-api-access-wfv4r\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:55:34.334303 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:34.334313    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:55:35.097724 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:35.097691    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf" event={"ID":"c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca","Type":"ContainerDied","Data":"344b820f1116edc778e8f413ad0a3edc0edd9b2d2d233b89913fa66ac4ec00a4"}
Jul 10 13:55:35.097724 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:35.097711    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs97pf"
Jul 10 13:55:35.097945 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:35.097735    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="344b820f1116edc778e8f413ad0a3edc0edd9b2d2d233b89913fa66ac4ec00a4"
Jul 10 13:55:43.236435 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.236392    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"]
Jul 10 13:55:43.236875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.236735    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerName="pull"
Jul 10 13:55:43.236875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.236763    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerName="pull"
Jul 10 13:55:43.236875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.236779    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerName="util"
Jul 10 13:55:43.236875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.236788    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerName="util"
Jul 10 13:55:43.236875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.236804    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerName="extract"
Jul 10 13:55:43.236875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.236812    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerName="extract"
Jul 10 13:55:43.236875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.236876    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c6adcb-b8f9-4a08-ac21-b478aaaf49ca" containerName="extract"
Jul 10 13:55:43.243414 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.243392    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.245807 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.245787    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 13:55:43.245913 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.245890    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k9vzt\""
Jul 10 13:55:43.245986 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.245966    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 13:55:43.245986 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.245976    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 13:55:43.246093 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.245894    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 13:55:43.254323 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.254301    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"]
Jul 10 13:55:43.304692 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.304666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cde7be0-bb25-42fa-b0a1-01bb72442734-tmp\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.304833 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.304727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt49s\" (UniqueName: \"kubernetes.io/projected/0cde7be0-bb25-42fa-b0a1-01bb72442734-kube-api-access-rt49s\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.304833 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.304811    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cde7be0-bb25-42fa-b0a1-01bb72442734-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.305008 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.304845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cde7be0-bb25-42fa-b0a1-01bb72442734-webhook-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.305008 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.304875    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0cde7be0-bb25-42fa-b0a1-01bb72442734-manifests\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.405330 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.405296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cde7be0-bb25-42fa-b0a1-01bb72442734-tmp\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.405447 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.405350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt49s\" (UniqueName: \"kubernetes.io/projected/0cde7be0-bb25-42fa-b0a1-01bb72442734-kube-api-access-rt49s\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.405447 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.405376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cde7be0-bb25-42fa-b0a1-01bb72442734-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.405447 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.405398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cde7be0-bb25-42fa-b0a1-01bb72442734-webhook-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.405447 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.405416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0cde7be0-bb25-42fa-b0a1-01bb72442734-manifests\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.405821 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.405800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0cde7be0-bb25-42fa-b0a1-01bb72442734-manifests\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.407650 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.407621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cde7be0-bb25-42fa-b0a1-01bb72442734-tmp\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.407787 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.407706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cde7be0-bb25-42fa-b0a1-01bb72442734-webhook-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.407889 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.407854    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cde7be0-bb25-42fa-b0a1-01bb72442734-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.414029 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.414006    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt49s\" (UniqueName: \"kubernetes.io/projected/0cde7be0-bb25-42fa-b0a1-01bb72442734-kube-api-access-rt49s\") pod \"opendatahub-operator-controller-manager-545b4db9db-z5tc9\" (UID: \"0cde7be0-bb25-42fa-b0a1-01bb72442734\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.555354 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.555283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:43.698035 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:43.698007    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"]
Jul 10 13:55:43.702449 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:55:43.702421    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cde7be0_bb25_42fa_b0a1_01bb72442734.slice/crio-321d44a8fe222790e8191abb9fe1532b4802ec23e5f6f39943e19402519427e2 WatchSource:0}: Error finding container 321d44a8fe222790e8191abb9fe1532b4802ec23e5f6f39943e19402519427e2: Status 404 returned error can't find the container with id 321d44a8fe222790e8191abb9fe1532b4802ec23e5f6f39943e19402519427e2
Jul 10 13:55:44.136680 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:44.136649    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9" event={"ID":"0cde7be0-bb25-42fa-b0a1-01bb72442734","Type":"ContainerStarted","Data":"321d44a8fe222790e8191abb9fe1532b4802ec23e5f6f39943e19402519427e2"}
Jul 10 13:55:47.154085 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:47.153997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9" event={"ID":"0cde7be0-bb25-42fa-b0a1-01bb72442734","Type":"ContainerStarted","Data":"87e897dce717e747b6f5c6d0039ad6d0bfff0e057ccf9fc12ed17052d9bf6b6d"}
Jul 10 13:55:48.160143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:48.160056    2570 generic.go:356] "Generic (PLEG): container finished" podID="0cde7be0-bb25-42fa-b0a1-01bb72442734" containerID="87e897dce717e747b6f5c6d0039ad6d0bfff0e057ccf9fc12ed17052d9bf6b6d" exitCode=0
Jul 10 13:55:48.160143 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:48.160097    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9" event={"ID":"0cde7be0-bb25-42fa-b0a1-01bb72442734","Type":"ContainerDied","Data":"87e897dce717e747b6f5c6d0039ad6d0bfff0e057ccf9fc12ed17052d9bf6b6d"}
Jul 10 13:55:50.171011 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:50.170978    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9" event={"ID":"0cde7be0-bb25-42fa-b0a1-01bb72442734","Type":"ContainerStarted","Data":"11965f4467c1ced115a3de0f78d899d9df18d45ff3159f0e8fecc41b5d53b82b"}
Jul 10 13:55:50.171471 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:50.171089    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:55:50.191786 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:55:50.191721    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9" podStartSLOduration=2.059126794 podStartE2EDuration="7.191707394s" totalImagesPullingTime="4.087361294s" totalInitContainerRuntime="1.045219306s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:55:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:55:50.190208912 +0000 UTC m=+359.107253174" watchObservedRunningTime="2026-07-10 13:55:50.191707394 +0000 UTC m=+359.108751656"
Jul 10 13:56:01.178331 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:01.178292    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-z5tc9"
Jul 10 13:56:03.988874 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:03.988830    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"]
Jul 10 13:56:03.997833 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:03.997801    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.000739 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.000719    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 13:56:04.000986 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.000973    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 13:56:04.007436 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.007409    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"]
Jul 10 13:56:04.067474 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.067436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2v7p\" (UniqueName: \"kubernetes.io/projected/f2b7856f-8704-4a74-83b7-a86037deeb1b-kube-api-access-d2v7p\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.067664 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.067509    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2b7856f-8704-4a74-83b7-a86037deeb1b-tls-certs\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.067664 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.067529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2b7856f-8704-4a74-83b7-a86037deeb1b-tmp\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.168785 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.168723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2b7856f-8704-4a74-83b7-a86037deeb1b-tls-certs\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.168785 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.168785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2b7856f-8704-4a74-83b7-a86037deeb1b-tmp\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.169032 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.168834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2v7p\" (UniqueName: \"kubernetes.io/projected/f2b7856f-8704-4a74-83b7-a86037deeb1b-kube-api-access-d2v7p\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.171555 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.171525    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2b7856f-8704-4a74-83b7-a86037deeb1b-tmp\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.171788 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.171769    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2b7856f-8704-4a74-83b7-a86037deeb1b-tls-certs\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.184156 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.184134    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2v7p\" (UniqueName: \"kubernetes.io/projected/f2b7856f-8704-4a74-83b7-a86037deeb1b-kube-api-access-d2v7p\") pod \"kube-auth-proxy-6c9db8d9c-sdr7p\" (UID: \"f2b7856f-8704-4a74-83b7-a86037deeb1b\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.308137 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.308063    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"
Jul 10 13:56:04.447010 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:04.446979    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p"]
Jul 10 13:56:04.448724 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:56:04.448697    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b7856f_8704_4a74_83b7_a86037deeb1b.slice/crio-e9d948d7800e4b1894da8aed3040d848cca70e77c0b86ea689d2e93f6fa57f48 WatchSource:0}: Error finding container e9d948d7800e4b1894da8aed3040d848cca70e77c0b86ea689d2e93f6fa57f48: Status 404 returned error can't find the container with id e9d948d7800e4b1894da8aed3040d848cca70e77c0b86ea689d2e93f6fa57f48
Jul 10 13:56:05.241795 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.241732    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p" event={"ID":"f2b7856f-8704-4a74-83b7-a86037deeb1b","Type":"ContainerStarted","Data":"e9d948d7800e4b1894da8aed3040d848cca70e77c0b86ea689d2e93f6fa57f48"}
Jul 10 13:56:05.374671 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.374641    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"]
Jul 10 13:56:05.378343 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.378312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.380516 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.380492    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 13:56:05.380618 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.380515    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m2wwt\""
Jul 10 13:56:05.380786 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.380740    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 13:56:05.380786 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.380768    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 13:56:05.380954 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.380903    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 13:56:05.391075 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.391055    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"]
Jul 10 13:56:05.480727 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.480697    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.480877 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.480730    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.480877 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.480783    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-local-certs\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.480877 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.480829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-token\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.480877 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.480855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5vxc\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-kube-api-access-w5vxc\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.481017 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.480891    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.481017 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.480922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-cacerts\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.582105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.582042    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-cacerts\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.582105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.582079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.582105 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.582098    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.582314 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.582190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-local-certs\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.582314 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.582215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-token\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.582314 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.582234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5vxc\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-kube-api-access-w5vxc\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.582314 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.582279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.582897 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.582838    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.584518 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.584494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-local-certs\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.584644 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.584562    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.584644 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.584607    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.584773 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.584703    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-cacerts\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.589711 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.589673    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-token\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.590174 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.590151    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5vxc\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-kube-api-access-w5vxc\") pod \"istiod-openshift-gateway-7574459656-h7dc5\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.689607 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.689583    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:05.826467 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:05.826443    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"]
Jul 10 13:56:05.828403 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:56:05.828380    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae134d63_365a_4c9d_8d9c_0e8bfdb3f830.slice/crio-6a1f32a6565e37bd29813cf9513c184d402bf8d86b602143c7736bb9a6b481e5 WatchSource:0}: Error finding container 6a1f32a6565e37bd29813cf9513c184d402bf8d86b602143c7736bb9a6b481e5: Status 404 returned error can't find the container with id 6a1f32a6565e37bd29813cf9513c184d402bf8d86b602143c7736bb9a6b481e5
Jul 10 13:56:06.248978 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:06.248941    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5" event={"ID":"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830","Type":"ContainerStarted","Data":"6a1f32a6565e37bd29813cf9513c184d402bf8d86b602143c7736bb9a6b481e5"}
Jul 10 13:56:08.527500 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:08.527453    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 13:56:08.527804 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:08.527537    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 13:56:09.267564 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:09.267520    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5" event={"ID":"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830","Type":"ContainerStarted","Data":"d3109f490283f3ab027056c0df6513ca9a273d5688f965defd853879aed11b22"}
Jul 10 13:56:09.267910 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:09.267879    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:09.269982 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:09.269945    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p" event={"ID":"f2b7856f-8704-4a74-83b7-a86037deeb1b","Type":"ContainerStarted","Data":"cf886898069f9c4c0a3ae9bdda9c945041d9f1a53289edf5a69059581ea91940"}
Jul 10 13:56:09.270102 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:09.270025    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-h7dc5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 13:56:09.270102 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:09.270066    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5" podUID="ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 13:56:09.288470 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:09.288421    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5" podStartSLOduration=1.5915446260000001 podStartE2EDuration="4.288406773s" totalImagesPullingTime="2.696862147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:56:09.286463436 +0000 UTC m=+378.203507724" watchObservedRunningTime="2026-07-10 13:56:09.288406773 +0000 UTC m=+378.205451036"
Jul 10 13:56:10.275357 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:10.275325    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:10.295910 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:10.295861    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-sdr7p" podStartSLOduration=3.272500646 podStartE2EDuration="7.295845318s" totalImagesPullingTime="4.023344672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:56:09.304524899 +0000 UTC m=+378.221569162" watchObservedRunningTime="2026-07-10 13:56:10.295845318 +0000 UTC m=+379.212889580"
Jul 10 13:56:14.176604 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.176567    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"]
Jul 10 13:56:14.179954 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.179938    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"]
Jul 10 13:56:14.180075 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.180055    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:14.183501 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.183484    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:14.185996 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.185976    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jm6z8\""
Jul 10 13:56:14.186121 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.186104    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 10 13:56:14.187950 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.187934    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gvn79\""
Jul 10 13:56:14.188238 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.188219    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 10 13:56:14.199470 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.199449    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"]
Jul 10 13:56:14.201456 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.201435    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"]
Jul 10 13:56:14.265002 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.264976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j98wd\" (UniqueName: \"kubernetes.io/projected/6e6284d2-b576-406c-a78c-c2f0687dead6-kube-api-access-j98wd\") pod \"kserve-controller-manager-d6f4b65b8-lthcp\" (UID: \"6e6284d2-b576-406c-a78c-c2f0687dead6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:14.265104 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.265022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e6284d2-b576-406c-a78c-c2f0687dead6-cert\") pod \"kserve-controller-manager-d6f4b65b8-lthcp\" (UID: \"6e6284d2-b576-406c-a78c-c2f0687dead6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:14.265104 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.265053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qq62w\" (UID: \"bb2085e6-52eb-43b0-bd70-ef30a9f0727f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:14.265104 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.265069    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzltl\" (UniqueName: \"kubernetes.io/projected/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-kube-api-access-rzltl\") pod \"llmisvc-controller-manager-777c6bd7d5-qq62w\" (UID: \"bb2085e6-52eb-43b0-bd70-ef30a9f0727f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:14.365715 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.365690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qq62w\" (UID: \"bb2085e6-52eb-43b0-bd70-ef30a9f0727f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:14.365849 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.365718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzltl\" (UniqueName: \"kubernetes.io/projected/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-kube-api-access-rzltl\") pod \"llmisvc-controller-manager-777c6bd7d5-qq62w\" (UID: \"bb2085e6-52eb-43b0-bd70-ef30a9f0727f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:14.365849 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.365787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j98wd\" (UniqueName: \"kubernetes.io/projected/6e6284d2-b576-406c-a78c-c2f0687dead6-kube-api-access-j98wd\") pod \"kserve-controller-manager-d6f4b65b8-lthcp\" (UID: \"6e6284d2-b576-406c-a78c-c2f0687dead6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:14.365849 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.365823    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e6284d2-b576-406c-a78c-c2f0687dead6-cert\") pod \"kserve-controller-manager-d6f4b65b8-lthcp\" (UID: \"6e6284d2-b576-406c-a78c-c2f0687dead6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:14.366022 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:56:14.365848    2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 10 13:56:14.366022 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:56:14.365933    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-cert podName:bb2085e6-52eb-43b0-bd70-ef30a9f0727f nodeName:}" failed. No retries permitted until 2026-07-10 13:56:14.865911073 +0000 UTC m=+383.782955316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-cert") pod "llmisvc-controller-manager-777c6bd7d5-qq62w" (UID: "bb2085e6-52eb-43b0-bd70-ef30a9f0727f") : secret "llmisvc-webhook-server-cert" not found
Jul 10 13:56:14.368206 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.368188    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e6284d2-b576-406c-a78c-c2f0687dead6-cert\") pod \"kserve-controller-manager-d6f4b65b8-lthcp\" (UID: \"6e6284d2-b576-406c-a78c-c2f0687dead6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:14.377889 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.377868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j98wd\" (UniqueName: \"kubernetes.io/projected/6e6284d2-b576-406c-a78c-c2f0687dead6-kube-api-access-j98wd\") pod \"kserve-controller-manager-d6f4b65b8-lthcp\" (UID: \"6e6284d2-b576-406c-a78c-c2f0687dead6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:14.378815 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.378798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzltl\" (UniqueName: \"kubernetes.io/projected/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-kube-api-access-rzltl\") pod \"llmisvc-controller-manager-777c6bd7d5-qq62w\" (UID: \"bb2085e6-52eb-43b0-bd70-ef30a9f0727f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:14.497726 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.497699    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:14.629720 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.629695    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"]
Jul 10 13:56:14.632226 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:56:14.632193    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6284d2_b576_406c_a78c_c2f0687dead6.slice/crio-5f5de798200919a445c2a3dc6f84b245f88adeddda9a1796335822cfa4f5d1f0 WatchSource:0}: Error finding container 5f5de798200919a445c2a3dc6f84b245f88adeddda9a1796335822cfa4f5d1f0: Status 404 returned error can't find the container with id 5f5de798200919a445c2a3dc6f84b245f88adeddda9a1796335822cfa4f5d1f0
Jul 10 13:56:14.870348 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.870264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qq62w\" (UID: \"bb2085e6-52eb-43b0-bd70-ef30a9f0727f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:14.872581 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:14.872553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb2085e6-52eb-43b0-bd70-ef30a9f0727f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qq62w\" (UID: \"bb2085e6-52eb-43b0-bd70-ef30a9f0727f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:15.091251 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:15.091220    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:15.228238 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:56:15.228199    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb2085e6_52eb_43b0_bd70_ef30a9f0727f.slice/crio-32ff7e73995bb14dc6f522e7bb24e5128b75e4460f9d5fad77d9a483b58d416a WatchSource:0}: Error finding container 32ff7e73995bb14dc6f522e7bb24e5128b75e4460f9d5fad77d9a483b58d416a: Status 404 returned error can't find the container with id 32ff7e73995bb14dc6f522e7bb24e5128b75e4460f9d5fad77d9a483b58d416a
Jul 10 13:56:15.232960 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:15.231962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"]
Jul 10 13:56:15.297714 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:15.297678    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w" event={"ID":"bb2085e6-52eb-43b0-bd70-ef30a9f0727f","Type":"ContainerStarted","Data":"32ff7e73995bb14dc6f522e7bb24e5128b75e4460f9d5fad77d9a483b58d416a"}
Jul 10 13:56:15.299019 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:15.298990    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp" event={"ID":"6e6284d2-b576-406c-a78c-c2f0687dead6","Type":"ContainerStarted","Data":"5f5de798200919a445c2a3dc6f84b245f88adeddda9a1796335822cfa4f5d1f0"}
Jul 10 13:56:17.814222 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:17.814183    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"]
Jul 10 13:56:17.814762 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:17.814426    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5" podUID="ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" containerName="discovery" containerID="cri-o://d3109f490283f3ab027056c0df6513ca9a273d5688f965defd853879aed11b22" gracePeriod=30
Jul 10 13:56:18.315571 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.315521    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp" event={"ID":"6e6284d2-b576-406c-a78c-c2f0687dead6","Type":"ContainerStarted","Data":"e28b76f2e0010a178b97deeaadd6f1ea3f1c3167da6ceeaf067a734571e4f063"}
Jul 10 13:56:18.315779 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.315600    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:18.317307 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.317283    2570 generic.go:356] "Generic (PLEG): container finished" podID="ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" containerID="d3109f490283f3ab027056c0df6513ca9a273d5688f965defd853879aed11b22" exitCode=0
Jul 10 13:56:18.317423 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.317332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5" event={"ID":"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830","Type":"ContainerDied","Data":"d3109f490283f3ab027056c0df6513ca9a273d5688f965defd853879aed11b22"}
Jul 10 13:56:18.333574 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.333516    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp" podStartSLOduration=1.718225534 podStartE2EDuration="4.333494228s" totalImagesPullingTime="2.615268694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:56:18.332325357 +0000 UTC m=+387.249369626" watchObservedRunningTime="2026-07-10 13:56:18.333494228 +0000 UTC m=+387.250538493"
Jul 10 13:56:18.584133 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.584107    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:18.708325 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.708294    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-kubeconfig\") pod \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") "
Jul 10 13:56:18.708325 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.708327    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-token\") pod \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") "
Jul 10 13:56:18.708519 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.708382    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-local-certs\") pod \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") "
Jul 10 13:56:18.708519 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.708398    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5vxc\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-kube-api-access-w5vxc\") pod \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") "
Jul 10 13:56:18.708519 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.708418    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-dns-cert\") pod \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") "
Jul 10 13:56:18.708519 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.708453    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-ca-configmap\") pod \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") "
Jul 10 13:56:18.708519 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.708511    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-cacerts\") pod \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\" (UID: \"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830\") "
Jul 10 13:56:18.709682 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.709640    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" (UID: "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:56:18.711123 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.711070    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" (UID: "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:56:18.711262 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.711129    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-local-certs" (OuterVolumeSpecName: "local-certs") pod "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" (UID: "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:56:18.711262 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.711221    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" (UID: "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:56:18.711447 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.711407    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-kube-api-access-w5vxc" (OuterVolumeSpecName: "kube-api-access-w5vxc") pod "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" (UID: "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830"). InnerVolumeSpecName "kube-api-access-w5vxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:56:18.711558 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.711540    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" (UID: "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:56:18.711621 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.711554    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-cacerts" (OuterVolumeSpecName: "cacerts") pod "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" (UID: "ae134d63-365a-4c9d-8d9c-0e8bfdb3f830"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:56:18.809513 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.809480    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-local-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:56:18.809513 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.809510    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5vxc\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-kube-api-access-w5vxc\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:56:18.809513 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.809520    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-dns-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:56:18.809738 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.809529    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-csr-ca-configmap\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:56:18.809738 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.809539    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-cacerts\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:56:18.809738 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.809548    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-kubeconfig\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:56:18.809738 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:18.809556    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830-istio-token\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:56:19.322971 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.322940    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"
Jul 10 13:56:19.323390 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.322979    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5" event={"ID":"ae134d63-365a-4c9d-8d9c-0e8bfdb3f830","Type":"ContainerDied","Data":"6a1f32a6565e37bd29813cf9513c184d402bf8d86b602143c7736bb9a6b481e5"}
Jul 10 13:56:19.323390 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.323045    2570 scope.go:117] "RemoveContainer" containerID="d3109f490283f3ab027056c0df6513ca9a273d5688f965defd853879aed11b22"
Jul 10 13:56:19.324701 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.324671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w" event={"ID":"bb2085e6-52eb-43b0-bd70-ef30a9f0727f","Type":"ContainerStarted","Data":"ef55ccf10e8cb440a9b6393ad4f19b42dd6d5c3f92534e1fad63bcb805cecbee"}
Jul 10 13:56:19.324907 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.324886    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:56:19.350560 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.350519    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w" podStartSLOduration=1.964707923 podStartE2EDuration="5.350507019s" totalImagesPullingTime="3.385799096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:56:19.348520197 +0000 UTC m=+388.265564451" watchObservedRunningTime="2026-07-10 13:56:19.350507019 +0000 UTC m=+388.267551283"
Jul 10 13:56:19.364847 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.364826    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"]
Jul 10 13:56:19.369327 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.369305    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h7dc5"]
Jul 10 13:56:19.565253 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:19.565224    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" path="/var/lib/kubelet/pods/ae134d63-365a-4c9d-8d9c-0e8bfdb3f830/volumes"
Jul 10 13:56:49.330000 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:49.329971    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lthcp"
Jul 10 13:56:50.332655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:56:50.332625    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qq62w"
Jul 10 13:57:04.780363 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.780330    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l4dr"]
Jul 10 13:57:04.780717 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.780645    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" containerName="discovery"
Jul 10 13:57:04.780717 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.780655    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" containerName="discovery"
Jul 10 13:57:04.780717 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.780711    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae134d63-365a-4c9d-8d9c-0e8bfdb3f830" containerName="discovery"
Jul 10 13:57:04.785104 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.785087    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr"
Jul 10 13:57:04.787338 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.787315    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bf95v\""
Jul 10 13:57:04.787611 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.787586    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 13:57:04.787611 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.787597    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 13:57:04.792392 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.792364    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l4dr"]
Jul 10 13:57:04.854816 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.854781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt75x\" (UniqueName: \"kubernetes.io/projected/bfe27ef7-3bc0-4572-b208-29dfe62a0097-kube-api-access-rt75x\") pod \"kuadrant-operator-catalog-5l4dr\" (UID: \"bfe27ef7-3bc0-4572-b208-29dfe62a0097\") " pod="kuadrant-system/kuadrant-operator-catalog-5l4dr"
Jul 10 13:57:04.955118 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.955089    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt75x\" (UniqueName: \"kubernetes.io/projected/bfe27ef7-3bc0-4572-b208-29dfe62a0097-kube-api-access-rt75x\") pod \"kuadrant-operator-catalog-5l4dr\" (UID: \"bfe27ef7-3bc0-4572-b208-29dfe62a0097\") " pod="kuadrant-system/kuadrant-operator-catalog-5l4dr"
Jul 10 13:57:04.963057 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:04.963032    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt75x\" (UniqueName: \"kubernetes.io/projected/bfe27ef7-3bc0-4572-b208-29dfe62a0097-kube-api-access-rt75x\") pod \"kuadrant-operator-catalog-5l4dr\" (UID: \"bfe27ef7-3bc0-4572-b208-29dfe62a0097\") " pod="kuadrant-system/kuadrant-operator-catalog-5l4dr"
Jul 10 13:57:05.096573 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.096497    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr"
Jul 10 13:57:05.123796 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.123769    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l4dr"]
Jul 10 13:57:05.222417 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.222378    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l4dr"]
Jul 10 13:57:05.225415 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:05.225389    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe27ef7_3bc0_4572_b208_29dfe62a0097.slice/crio-ac98fe1ed808bb9012eb9f318cdec0f39fec3ed15db4f0e522e44d74dc4130ef WatchSource:0}: Error finding container ac98fe1ed808bb9012eb9f318cdec0f39fec3ed15db4f0e522e44d74dc4130ef: Status 404 returned error can't find the container with id ac98fe1ed808bb9012eb9f318cdec0f39fec3ed15db4f0e522e44d74dc4130ef
Jul 10 13:57:05.332807 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.332785    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6jwv7"]
Jul 10 13:57:05.335585 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.335569    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:05.344620 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.344601    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6jwv7"]
Jul 10 13:57:05.459698 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.459673    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdzc\" (UniqueName: \"kubernetes.io/projected/f256bfaa-1d4a-47b2-a6c0-93a6a1248f42-kube-api-access-hzdzc\") pod \"kuadrant-operator-catalog-6jwv7\" (UID: \"f256bfaa-1d4a-47b2-a6c0-93a6a1248f42\") " pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:05.535878 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.535849    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr" event={"ID":"bfe27ef7-3bc0-4572-b208-29dfe62a0097","Type":"ContainerStarted","Data":"ac98fe1ed808bb9012eb9f318cdec0f39fec3ed15db4f0e522e44d74dc4130ef"}
Jul 10 13:57:05.562764 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.562377    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdzc\" (UniqueName: \"kubernetes.io/projected/f256bfaa-1d4a-47b2-a6c0-93a6a1248f42-kube-api-access-hzdzc\") pod \"kuadrant-operator-catalog-6jwv7\" (UID: \"f256bfaa-1d4a-47b2-a6c0-93a6a1248f42\") " pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:05.573227 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.573200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdzc\" (UniqueName: \"kubernetes.io/projected/f256bfaa-1d4a-47b2-a6c0-93a6a1248f42-kube-api-access-hzdzc\") pod \"kuadrant-operator-catalog-6jwv7\" (UID: \"f256bfaa-1d4a-47b2-a6c0-93a6a1248f42\") " pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:05.644894 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.644867    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:05.770880 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:05.770856    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6jwv7"]
Jul 10 13:57:05.773233 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:05.773210    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf256bfaa_1d4a_47b2_a6c0_93a6a1248f42.slice/crio-1ffc2e5d5ecbb62320ce39f1615b39acb1f1fcc5d8381040e91d43fa32359483 WatchSource:0}: Error finding container 1ffc2e5d5ecbb62320ce39f1615b39acb1f1fcc5d8381040e91d43fa32359483: Status 404 returned error can't find the container with id 1ffc2e5d5ecbb62320ce39f1615b39acb1f1fcc5d8381040e91d43fa32359483
Jul 10 13:57:06.542457 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:06.542417    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7" event={"ID":"f256bfaa-1d4a-47b2-a6c0-93a6a1248f42","Type":"ContainerStarted","Data":"1ffc2e5d5ecbb62320ce39f1615b39acb1f1fcc5d8381040e91d43fa32359483"}
Jul 10 13:57:07.548466 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.548362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr" event={"ID":"bfe27ef7-3bc0-4572-b208-29dfe62a0097","Type":"ContainerStarted","Data":"2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9"}
Jul 10 13:57:07.548466 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.548383    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr" podUID="bfe27ef7-3bc0-4572-b208-29dfe62a0097" containerName="registry-server" containerID="cri-o://2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9" gracePeriod=2
Jul 10 13:57:07.550012 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.549975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7" event={"ID":"f256bfaa-1d4a-47b2-a6c0-93a6a1248f42","Type":"ContainerStarted","Data":"54357e66d03715b565fcc97195762b797f3341582d5dfe43fe6dc744a757768c"}
Jul 10 13:57:07.565931 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.565892    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr" podStartSLOduration=1.49572435 podStartE2EDuration="3.56588042s" totalImagesPullingTime="2.07015607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:57:07.564517201 +0000 UTC m=+436.481561464" watchObservedRunningTime="2026-07-10 13:57:07.56588042 +0000 UTC m=+436.482924683"
Jul 10 13:57:07.581291 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.581253    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7" podStartSLOduration=1.055751183 podStartE2EDuration="2.58124159s" totalImagesPullingTime="1.525490407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:57:07.580669565 +0000 UTC m=+436.497713831" watchObservedRunningTime="2026-07-10 13:57:07.58124159 +0000 UTC m=+436.498285861"
Jul 10 13:57:07.790728 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.790704    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr"
Jul 10 13:57:07.884829 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.884736    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt75x\" (UniqueName: \"kubernetes.io/projected/bfe27ef7-3bc0-4572-b208-29dfe62a0097-kube-api-access-rt75x\") pod \"bfe27ef7-3bc0-4572-b208-29dfe62a0097\" (UID: \"bfe27ef7-3bc0-4572-b208-29dfe62a0097\") "
Jul 10 13:57:07.886779 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.886758    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe27ef7-3bc0-4572-b208-29dfe62a0097-kube-api-access-rt75x" (OuterVolumeSpecName: "kube-api-access-rt75x") pod "bfe27ef7-3bc0-4572-b208-29dfe62a0097" (UID: "bfe27ef7-3bc0-4572-b208-29dfe62a0097"). InnerVolumeSpecName "kube-api-access-rt75x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:57:07.986062 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:07.986040    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt75x\" (UniqueName: \"kubernetes.io/projected/bfe27ef7-3bc0-4572-b208-29dfe62a0097-kube-api-access-rt75x\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:08.555537 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.555507    2570 generic.go:356] "Generic (PLEG): container finished" podID="bfe27ef7-3bc0-4572-b208-29dfe62a0097" containerID="2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9" exitCode=0
Jul 10 13:57:08.555900 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.555545    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr"
Jul 10 13:57:08.555900 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.555595    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr" event={"ID":"bfe27ef7-3bc0-4572-b208-29dfe62a0097","Type":"ContainerDied","Data":"2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9"}
Jul 10 13:57:08.555900 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.555642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5l4dr" event={"ID":"bfe27ef7-3bc0-4572-b208-29dfe62a0097","Type":"ContainerDied","Data":"ac98fe1ed808bb9012eb9f318cdec0f39fec3ed15db4f0e522e44d74dc4130ef"}
Jul 10 13:57:08.555900 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.555664    2570 scope.go:117] "RemoveContainer" containerID="2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9"
Jul 10 13:57:08.565077 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.565062    2570 scope.go:117] "RemoveContainer" containerID="2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9"
Jul 10 13:57:08.565296 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:57:08.565279    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9\": container with ID starting with 2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9 not found: ID does not exist" containerID="2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9"
Jul 10 13:57:08.565355 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.565307    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9"} err="failed to get container status \"2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9\": rpc error: code = NotFound desc = could not find container \"2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9\": container with ID starting with 2637b338188d27c0715202207d1e129ec7683c70dcdc47cd7ae7bee5cff758f9 not found: ID does not exist"
Jul 10 13:57:08.576463 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.576416    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l4dr"]
Jul 10 13:57:08.581091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:08.581070    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5l4dr"]
Jul 10 13:57:09.568611 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:09.568580    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe27ef7-3bc0-4572-b208-29dfe62a0097" path="/var/lib/kubelet/pods/bfe27ef7-3bc0-4572-b208-29dfe62a0097/volumes"
Jul 10 13:57:09.957473 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:09.957441    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-755854dc8d-dgs82"]
Jul 10 13:57:09.957908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:09.957875    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe27ef7-3bc0-4572-b208-29dfe62a0097" containerName="registry-server"
Jul 10 13:57:09.957908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:09.957901    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe27ef7-3bc0-4572-b208-29dfe62a0097" containerName="registry-server"
Jul 10 13:57:09.958061 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:09.957994    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfe27ef7-3bc0-4572-b208-29dfe62a0097" containerName="registry-server"
Jul 10 13:57:09.961957 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:09.961934    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:09.970843 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:09.970820    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755854dc8d-dgs82"]
Jul 10 13:57:10.104230 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.104201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86v44\" (UniqueName: \"kubernetes.io/projected/1f519337-77c8-4d01-ae0d-f3e1936885e5-kube-api-access-86v44\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.104380 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.104238    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-oauth-serving-cert\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.104380 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.104262    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-service-ca\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.104455 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.104372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-serving-cert\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.104455 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.104414    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-config\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.104455 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.104432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-trusted-ca-bundle\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.104593 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.104477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-oauth-config\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.205600 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.205568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-serving-cert\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.205600 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.205613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-config\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.205843 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.205628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-trusted-ca-bundle\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.205843 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.205659    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-oauth-config\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.205937 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.205833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86v44\" (UniqueName: \"kubernetes.io/projected/1f519337-77c8-4d01-ae0d-f3e1936885e5-kube-api-access-86v44\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.205937 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.205890    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-oauth-serving-cert\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.206029 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.205949    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-service-ca\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.206537 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.206512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-config\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.206646 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.206621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-oauth-serving-cert\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.206679 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.206642    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-service-ca\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.206679 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.206652    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f519337-77c8-4d01-ae0d-f3e1936885e5-trusted-ca-bundle\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.208185 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.208133    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-oauth-config\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.208265 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.208211    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f519337-77c8-4d01-ae0d-f3e1936885e5-console-serving-cert\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.213936 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.213919    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86v44\" (UniqueName: \"kubernetes.io/projected/1f519337-77c8-4d01-ae0d-f3e1936885e5-kube-api-access-86v44\") pod \"console-755854dc8d-dgs82\" (UID: \"1f519337-77c8-4d01-ae0d-f3e1936885e5\") " pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.271467 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.271444    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:10.403362 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.403331    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755854dc8d-dgs82"]
Jul 10 13:57:10.406400 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:10.406367    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f519337_77c8_4d01_ae0d_f3e1936885e5.slice/crio-13df15cb34d3e3752e862ef3bfe7820f5f997ba38d153d0b15c44767bb7e38a2 WatchSource:0}: Error finding container 13df15cb34d3e3752e862ef3bfe7820f5f997ba38d153d0b15c44767bb7e38a2: Status 404 returned error can't find the container with id 13df15cb34d3e3752e862ef3bfe7820f5f997ba38d153d0b15c44767bb7e38a2
Jul 10 13:57:10.572736 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.572651    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755854dc8d-dgs82" event={"ID":"1f519337-77c8-4d01-ae0d-f3e1936885e5","Type":"ContainerStarted","Data":"e9dc88196e723f65a5745f03b20b47a9743afe93315fe3751f2944aeb8b5ffbe"}
Jul 10 13:57:10.572736 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.572703    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755854dc8d-dgs82" event={"ID":"1f519337-77c8-4d01-ae0d-f3e1936885e5","Type":"ContainerStarted","Data":"13df15cb34d3e3752e862ef3bfe7820f5f997ba38d153d0b15c44767bb7e38a2"}
Jul 10 13:57:10.591853 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:10.591804    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-755854dc8d-dgs82" podStartSLOduration=1.5917897989999998 podStartE2EDuration="1.591789799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:57:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:57:10.590567241 +0000 UTC m=+439.507611505" watchObservedRunningTime="2026-07-10 13:57:10.591789799 +0000 UTC m=+439.508834061"
Jul 10 13:57:15.645036 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:15.644959    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:15.645036 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:15.645010    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:15.667312 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:15.667289    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:16.620277 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:16.620244    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6jwv7"
Jul 10 13:57:20.181587 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.181545    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"]
Jul 10 13:57:20.191402 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.191370    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.193905 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.193858    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tpptj\""
Jul 10 13:57:20.194281 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.194259    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"]
Jul 10 13:57:20.271654 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.271628    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:20.271790 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.271676    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:20.276406 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.276382    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:20.290075 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.290039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.290158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.290095    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.290158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.290129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4cgp\" (UniqueName: \"kubernetes.io/projected/c3dcc56f-8cc1-4878-b983-a9f36de788dd-kube-api-access-p4cgp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.390833 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.390791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4cgp\" (UniqueName: \"kubernetes.io/projected/c3dcc56f-8cc1-4878-b983-a9f36de788dd-kube-api-access-p4cgp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.390947 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.390895    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.391179 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.391107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.391285 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.391269    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.391457 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.391438    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.399045 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.399020    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4cgp\" (UniqueName: \"kubernetes.io/projected/c3dcc56f-8cc1-4878-b983-a9f36de788dd-kube-api-access-p4cgp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.502232 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.502210    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:20.619365 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.619338    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-755854dc8d-dgs82"
Jul 10 13:57:20.627896 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.627868    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"]
Jul 10 13:57:20.630706 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:20.630684    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3dcc56f_8cc1_4878_b983_a9f36de788dd.slice/crio-c9636e829f745296b3fdcdb5a9a4db5d729f0f7f9984dacade3b8d6185630fd4 WatchSource:0}: Error finding container c9636e829f745296b3fdcdb5a9a4db5d729f0f7f9984dacade3b8d6185630fd4: Status 404 returned error can't find the container with id c9636e829f745296b3fdcdb5a9a4db5d729f0f7f9984dacade3b8d6185630fd4
Jul 10 13:57:20.666289 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.666263    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7c556b8c-wcj99"]
Jul 10 13:57:20.779896 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.779840    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"]
Jul 10 13:57:20.783264 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.783245    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:20.793863 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.793842    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"]
Jul 10 13:57:20.896760 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.896714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnlrm\" (UniqueName: \"kubernetes.io/projected/733fc345-1153-431f-a9c0-c3e3bc6bb192-kube-api-access-vnlrm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:20.896882 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.896794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:20.896882 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.896816    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:20.997919 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.997889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnlrm\" (UniqueName: \"kubernetes.io/projected/733fc345-1153-431f-a9c0-c3e3bc6bb192-kube-api-access-vnlrm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:20.998036 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.997934    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:20.998036 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.997956    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:20.998260 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.998240    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:20.998297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:20.998286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:21.006020 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.006000    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnlrm\" (UniqueName: \"kubernetes.io/projected/733fc345-1153-431f-a9c0-c3e3bc6bb192-kube-api-access-vnlrm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:21.118443 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.118383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:21.241337 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.241308    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"]
Jul 10 13:57:21.245865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.245845    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.259390 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.259366    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"]
Jul 10 13:57:21.274004 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.273984    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"]
Jul 10 13:57:21.275924 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:21.275905    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733fc345_1153_431f_a9c0_c3e3bc6bb192.slice/crio-354bb1b94af4a51c036101872960594c37af592a5598e0d10e750f37aaf982c9 WatchSource:0}: Error finding container 354bb1b94af4a51c036101872960594c37af592a5598e0d10e750f37aaf982c9: Status 404 returned error can't find the container with id 354bb1b94af4a51c036101872960594c37af592a5598e0d10e750f37aaf982c9
Jul 10 13:57:21.400370 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.400341    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.400461 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.400372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f75v\" (UniqueName: \"kubernetes.io/projected/a2bedd52-f074-4c17-9706-bd8699585559-kube-api-access-2f75v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.400503 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.400460    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.501484 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.501455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.501597 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.501491    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f75v\" (UniqueName: \"kubernetes.io/projected/a2bedd52-f074-4c17-9706-bd8699585559-kube-api-access-2f75v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.501597 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.501548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.501876 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.501853    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.501956 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.501900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.510756 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.510726    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f75v\" (UniqueName: \"kubernetes.io/projected/a2bedd52-f074-4c17-9706-bd8699585559-kube-api-access-2f75v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.555230 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.555206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:21.589025 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.589000    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"]
Jul 10 13:57:21.592808 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.592789    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.602948 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.602924    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"]
Jul 10 13:57:21.624062 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.623989    2570 generic.go:356] "Generic (PLEG): container finished" podID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerID="9779164fee862c0d0935a95a133bb66c84c334c58e0c07bb7e4da0da1af5b9de" exitCode=0
Jul 10 13:57:21.624180 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.624078    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc" event={"ID":"c3dcc56f-8cc1-4878-b983-a9f36de788dd","Type":"ContainerDied","Data":"9779164fee862c0d0935a95a133bb66c84c334c58e0c07bb7e4da0da1af5b9de"}
Jul 10 13:57:21.624180 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.624138    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc" event={"ID":"c3dcc56f-8cc1-4878-b983-a9f36de788dd","Type":"ContainerStarted","Data":"c9636e829f745296b3fdcdb5a9a4db5d729f0f7f9984dacade3b8d6185630fd4"}
Jul 10 13:57:21.625813 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.625789    2570 generic.go:356] "Generic (PLEG): container finished" podID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerID="08428deeb0db2ffad1149c04b089041d0c06cf905d4e3992f2b643514fbfd6f9" exitCode=0
Jul 10 13:57:21.625912 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.625871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6" event={"ID":"733fc345-1153-431f-a9c0-c3e3bc6bb192","Type":"ContainerDied","Data":"08428deeb0db2ffad1149c04b089041d0c06cf905d4e3992f2b643514fbfd6f9"}
Jul 10 13:57:21.625975 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.625915    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6" event={"ID":"733fc345-1153-431f-a9c0-c3e3bc6bb192","Type":"ContainerStarted","Data":"354bb1b94af4a51c036101872960594c37af592a5598e0d10e750f37aaf982c9"}
Jul 10 13:57:21.698541 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.698519    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"]
Jul 10 13:57:21.700675 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:21.700650    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bedd52_f074_4c17_9706_bd8699585559.slice/crio-c5b20e71c53251e7e88fe51474f26f286a6874ee5ca62d1bd22f1c46934c6291 WatchSource:0}: Error finding container c5b20e71c53251e7e88fe51474f26f286a6874ee5ca62d1bd22f1c46934c6291: Status 404 returned error can't find the container with id c5b20e71c53251e7e88fe51474f26f286a6874ee5ca62d1bd22f1c46934c6291
Jul 10 13:57:21.702737 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.702711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.702863 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.702845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.702929 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.702895    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xbs8\" (UniqueName: \"kubernetes.io/projected/9b2948fe-4932-4e1f-b62c-b5452d865d6a-kube-api-access-6xbs8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.804395 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.804369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xbs8\" (UniqueName: \"kubernetes.io/projected/9b2948fe-4932-4e1f-b62c-b5452d865d6a-kube-api-access-6xbs8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.804503 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.804446    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.804503 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.804484    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.804801 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.804780    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.804878 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.804828    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.812286 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.812264    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xbs8\" (UniqueName: \"kubernetes.io/projected/9b2948fe-4932-4e1f-b62c-b5452d865d6a-kube-api-access-6xbs8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:21.904094 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:21.904046    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:22.031438 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.031416    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"]
Jul 10 13:57:22.033671 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:22.033649    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2948fe_4932_4e1f_b62c_b5452d865d6a.slice/crio-17550b110008a494b666e9c75eafdcdafe2f62114c90a52f70fd91b91a267c37 WatchSource:0}: Error finding container 17550b110008a494b666e9c75eafdcdafe2f62114c90a52f70fd91b91a267c37: Status 404 returned error can't find the container with id 17550b110008a494b666e9c75eafdcdafe2f62114c90a52f70fd91b91a267c37
Jul 10 13:57:22.633509 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.633480    2570 generic.go:356] "Generic (PLEG): container finished" podID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerID="47cb6452087c4da2d6dbeeda64c324279e7d7f108fc376a7ce80c9cc3831e27f" exitCode=0
Jul 10 13:57:22.633867 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.633530    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc" event={"ID":"c3dcc56f-8cc1-4878-b983-a9f36de788dd","Type":"ContainerDied","Data":"47cb6452087c4da2d6dbeeda64c324279e7d7f108fc376a7ce80c9cc3831e27f"}
Jul 10 13:57:22.635680 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.635654    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6" event={"ID":"733fc345-1153-431f-a9c0-c3e3bc6bb192","Type":"ContainerStarted","Data":"50c59016859f0086317b4aad2eba257a4def0a441a8ca922e3f4b857496ea726"}
Jul 10 13:57:22.637233 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.637211    2570 generic.go:356] "Generic (PLEG): container finished" podID="a2bedd52-f074-4c17-9706-bd8699585559" containerID="0391c07407515036bf84ceba853b43d35d4c4422199afddcefdc3776f0271c2d" exitCode=0
Jul 10 13:57:22.637345 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.637294    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb" event={"ID":"a2bedd52-f074-4c17-9706-bd8699585559","Type":"ContainerDied","Data":"0391c07407515036bf84ceba853b43d35d4c4422199afddcefdc3776f0271c2d"}
Jul 10 13:57:22.637345 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.637332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb" event={"ID":"a2bedd52-f074-4c17-9706-bd8699585559","Type":"ContainerStarted","Data":"c5b20e71c53251e7e88fe51474f26f286a6874ee5ca62d1bd22f1c46934c6291"}
Jul 10 13:57:22.638919 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.638894    2570 generic.go:356] "Generic (PLEG): container finished" podID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerID="fe35d93563259443d9ed59047335213dad133e6d2e0c46214bc5fbd7cfc93b10" exitCode=0
Jul 10 13:57:22.639027 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.638962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb" event={"ID":"9b2948fe-4932-4e1f-b62c-b5452d865d6a","Type":"ContainerDied","Data":"fe35d93563259443d9ed59047335213dad133e6d2e0c46214bc5fbd7cfc93b10"}
Jul 10 13:57:22.639027 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:22.638997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb" event={"ID":"9b2948fe-4932-4e1f-b62c-b5452d865d6a","Type":"ContainerStarted","Data":"17550b110008a494b666e9c75eafdcdafe2f62114c90a52f70fd91b91a267c37"}
Jul 10 13:57:23.646817 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:23.646791    2570 generic.go:356] "Generic (PLEG): container finished" podID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerID="cc975d88bf6c70b8b60387be6f693bd9193abe2e151eb5070096539c2ecb9d95" exitCode=0
Jul 10 13:57:23.647124 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:23.646868    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc" event={"ID":"c3dcc56f-8cc1-4878-b983-a9f36de788dd","Type":"ContainerDied","Data":"cc975d88bf6c70b8b60387be6f693bd9193abe2e151eb5070096539c2ecb9d95"}
Jul 10 13:57:23.648609 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:23.648584    2570 generic.go:356] "Generic (PLEG): container finished" podID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerID="50c59016859f0086317b4aad2eba257a4def0a441a8ca922e3f4b857496ea726" exitCode=0
Jul 10 13:57:23.648706 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:23.648656    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6" event={"ID":"733fc345-1153-431f-a9c0-c3e3bc6bb192","Type":"ContainerDied","Data":"50c59016859f0086317b4aad2eba257a4def0a441a8ca922e3f4b857496ea726"}
Jul 10 13:57:24.655868 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.655830    2570 generic.go:356] "Generic (PLEG): container finished" podID="a2bedd52-f074-4c17-9706-bd8699585559" containerID="088d2c7c2eb81fb94b5ac7dc779ae29bccde33e63355cbd4ec43fc36d405eafb" exitCode=0
Jul 10 13:57:24.656277 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.655883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb" event={"ID":"a2bedd52-f074-4c17-9706-bd8699585559","Type":"ContainerDied","Data":"088d2c7c2eb81fb94b5ac7dc779ae29bccde33e63355cbd4ec43fc36d405eafb"}
Jul 10 13:57:24.657754 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.657717    2570 generic.go:356] "Generic (PLEG): container finished" podID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerID="ceecf17de7fbb4f596a86b7f4e4d99375c1812d3d51e82490310bb45e979c743" exitCode=0
Jul 10 13:57:24.657842 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.657774    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb" event={"ID":"9b2948fe-4932-4e1f-b62c-b5452d865d6a","Type":"ContainerDied","Data":"ceecf17de7fbb4f596a86b7f4e4d99375c1812d3d51e82490310bb45e979c743"}
Jul 10 13:57:24.660205 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.660184    2570 generic.go:356] "Generic (PLEG): container finished" podID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerID="ba66aadce420b9190efee3a37ce4b494b959f2be3a631ccd6e79216c89524925" exitCode=0
Jul 10 13:57:24.660295 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.660235    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6" event={"ID":"733fc345-1153-431f-a9c0-c3e3bc6bb192","Type":"ContainerDied","Data":"ba66aadce420b9190efee3a37ce4b494b959f2be3a631ccd6e79216c89524925"}
Jul 10 13:57:24.812433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.812407    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:24.931603 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.931533    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-bundle\") pod \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") "
Jul 10 13:57:24.931603 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.931587    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-util\") pod \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") "
Jul 10 13:57:24.931786 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.931638    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4cgp\" (UniqueName: \"kubernetes.io/projected/c3dcc56f-8cc1-4878-b983-a9f36de788dd-kube-api-access-p4cgp\") pod \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\" (UID: \"c3dcc56f-8cc1-4878-b983-a9f36de788dd\") "
Jul 10 13:57:24.932075 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.932041    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-bundle" (OuterVolumeSpecName: "bundle") pod "c3dcc56f-8cc1-4878-b983-a9f36de788dd" (UID: "c3dcc56f-8cc1-4878-b983-a9f36de788dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:57:24.933640 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.933615    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3dcc56f-8cc1-4878-b983-a9f36de788dd-kube-api-access-p4cgp" (OuterVolumeSpecName: "kube-api-access-p4cgp") pod "c3dcc56f-8cc1-4878-b983-a9f36de788dd" (UID: "c3dcc56f-8cc1-4878-b983-a9f36de788dd"). InnerVolumeSpecName "kube-api-access-p4cgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:57:24.937215 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:24.937179    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-util" (OuterVolumeSpecName: "util") pod "c3dcc56f-8cc1-4878-b983-a9f36de788dd" (UID: "c3dcc56f-8cc1-4878-b983-a9f36de788dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:57:25.033175 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.033141    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:25.033175 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.033168    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4cgp\" (UniqueName: \"kubernetes.io/projected/c3dcc56f-8cc1-4878-b983-a9f36de788dd-kube-api-access-p4cgp\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:25.033175 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.033182    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3dcc56f-8cc1-4878-b983-a9f36de788dd-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:25.668330 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.668300    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc"
Jul 10 13:57:25.668694 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.668330    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc" event={"ID":"c3dcc56f-8cc1-4878-b983-a9f36de788dd","Type":"ContainerDied","Data":"c9636e829f745296b3fdcdb5a9a4db5d729f0f7f9984dacade3b8d6185630fd4"}
Jul 10 13:57:25.668694 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.668375    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9636e829f745296b3fdcdb5a9a4db5d729f0f7f9984dacade3b8d6185630fd4"
Jul 10 13:57:25.670986 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.670961    2570 generic.go:356] "Generic (PLEG): container finished" podID="a2bedd52-f074-4c17-9706-bd8699585559" containerID="8cac9dc4d3ade3e2fbcd19c3372c3eed4cc3b82c87b809638f1a5c9bc060ba66" exitCode=0
Jul 10 13:57:25.671121 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.671033    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb" event={"ID":"a2bedd52-f074-4c17-9706-bd8699585559","Type":"ContainerDied","Data":"8cac9dc4d3ade3e2fbcd19c3372c3eed4cc3b82c87b809638f1a5c9bc060ba66"}
Jul 10 13:57:25.673323 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.673295    2570 generic.go:356] "Generic (PLEG): container finished" podID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerID="8aa0a504bf6d924aa664e1aef737c37949f940a72fc072576637dc0afa4ce704" exitCode=0
Jul 10 13:57:25.673443 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.673375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb" event={"ID":"9b2948fe-4932-4e1f-b62c-b5452d865d6a","Type":"ContainerDied","Data":"8aa0a504bf6d924aa664e1aef737c37949f940a72fc072576637dc0afa4ce704"}
Jul 10 13:57:25.805574 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.805550    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:25.939840 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.939809    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnlrm\" (UniqueName: \"kubernetes.io/projected/733fc345-1153-431f-a9c0-c3e3bc6bb192-kube-api-access-vnlrm\") pod \"733fc345-1153-431f-a9c0-c3e3bc6bb192\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") "
Jul 10 13:57:25.940004 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.939905    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-bundle\") pod \"733fc345-1153-431f-a9c0-c3e3bc6bb192\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") "
Jul 10 13:57:25.940004 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.939933    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-util\") pod \"733fc345-1153-431f-a9c0-c3e3bc6bb192\" (UID: \"733fc345-1153-431f-a9c0-c3e3bc6bb192\") "
Jul 10 13:57:25.940318 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.940294    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-bundle" (OuterVolumeSpecName: "bundle") pod "733fc345-1153-431f-a9c0-c3e3bc6bb192" (UID: "733fc345-1153-431f-a9c0-c3e3bc6bb192"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:57:25.941838 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.941819    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733fc345-1153-431f-a9c0-c3e3bc6bb192-kube-api-access-vnlrm" (OuterVolumeSpecName: "kube-api-access-vnlrm") pod "733fc345-1153-431f-a9c0-c3e3bc6bb192" (UID: "733fc345-1153-431f-a9c0-c3e3bc6bb192"). InnerVolumeSpecName "kube-api-access-vnlrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:57:25.945529 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:25.945492    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-util" (OuterVolumeSpecName: "util") pod "733fc345-1153-431f-a9c0-c3e3bc6bb192" (UID: "733fc345-1153-431f-a9c0-c3e3bc6bb192"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:57:26.041405 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.041319    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:26.041405 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.041360    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/733fc345-1153-431f-a9c0-c3e3bc6bb192-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:26.041405 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.041376    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnlrm\" (UniqueName: \"kubernetes.io/projected/733fc345-1153-431f-a9c0-c3e3bc6bb192-kube-api-access-vnlrm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:26.680473 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.680445    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6"
Jul 10 13:57:26.680873 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.680440    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6" event={"ID":"733fc345-1153-431f-a9c0-c3e3bc6bb192","Type":"ContainerDied","Data":"354bb1b94af4a51c036101872960594c37af592a5598e0d10e750f37aaf982c9"}
Jul 10 13:57:26.680873 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.680574    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="354bb1b94af4a51c036101872960594c37af592a5598e0d10e750f37aaf982c9"
Jul 10 13:57:26.816834 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.816812    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:26.847394 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.847372    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:26.948778 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.948733    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f75v\" (UniqueName: \"kubernetes.io/projected/a2bedd52-f074-4c17-9706-bd8699585559-kube-api-access-2f75v\") pod \"a2bedd52-f074-4c17-9706-bd8699585559\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") "
Jul 10 13:57:26.948911 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.948820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-bundle\") pod \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") "
Jul 10 13:57:26.948911 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.948841    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-util\") pod \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") "
Jul 10 13:57:26.948911 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.948862    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xbs8\" (UniqueName: \"kubernetes.io/projected/9b2948fe-4932-4e1f-b62c-b5452d865d6a-kube-api-access-6xbs8\") pod \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\" (UID: \"9b2948fe-4932-4e1f-b62c-b5452d865d6a\") "
Jul 10 13:57:26.948911 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.948890    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-bundle\") pod \"a2bedd52-f074-4c17-9706-bd8699585559\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") "
Jul 10 13:57:26.949079 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.948915    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-util\") pod \"a2bedd52-f074-4c17-9706-bd8699585559\" (UID: \"a2bedd52-f074-4c17-9706-bd8699585559\") "
Jul 10 13:57:26.949441 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.949413    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-bundle" (OuterVolumeSpecName: "bundle") pod "a2bedd52-f074-4c17-9706-bd8699585559" (UID: "a2bedd52-f074-4c17-9706-bd8699585559"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:57:26.949590 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.949567    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-bundle" (OuterVolumeSpecName: "bundle") pod "9b2948fe-4932-4e1f-b62c-b5452d865d6a" (UID: "9b2948fe-4932-4e1f-b62c-b5452d865d6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:57:26.951019 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.950993    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2bedd52-f074-4c17-9706-bd8699585559-kube-api-access-2f75v" (OuterVolumeSpecName: "kube-api-access-2f75v") pod "a2bedd52-f074-4c17-9706-bd8699585559" (UID: "a2bedd52-f074-4c17-9706-bd8699585559"). InnerVolumeSpecName "kube-api-access-2f75v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:57:26.951240 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.951216    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b2948fe-4932-4e1f-b62c-b5452d865d6a-kube-api-access-6xbs8" (OuterVolumeSpecName: "kube-api-access-6xbs8") pod "9b2948fe-4932-4e1f-b62c-b5452d865d6a" (UID: "9b2948fe-4932-4e1f-b62c-b5452d865d6a"). InnerVolumeSpecName "kube-api-access-6xbs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:57:26.954783 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.954764    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-util" (OuterVolumeSpecName: "util") pod "9b2948fe-4932-4e1f-b62c-b5452d865d6a" (UID: "9b2948fe-4932-4e1f-b62c-b5452d865d6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:57:26.954975 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:26.954957    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-util" (OuterVolumeSpecName: "util") pod "a2bedd52-f074-4c17-9706-bd8699585559" (UID: "a2bedd52-f074-4c17-9706-bd8699585559"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:57:27.049899 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.049875    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f75v\" (UniqueName: \"kubernetes.io/projected/a2bedd52-f074-4c17-9706-bd8699585559-kube-api-access-2f75v\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:27.049899 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.049897    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:27.050027 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.049909    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b2948fe-4932-4e1f-b62c-b5452d865d6a-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:27.050027 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.049917    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xbs8\" (UniqueName: \"kubernetes.io/projected/9b2948fe-4932-4e1f-b62c-b5452d865d6a-kube-api-access-6xbs8\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:27.050027 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.049925    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:27.050027 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.049932    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2bedd52-f074-4c17-9706-bd8699585559-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:27.687465 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.687432    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb"
Jul 10 13:57:27.687465 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.687445    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb" event={"ID":"a2bedd52-f074-4c17-9706-bd8699585559","Type":"ContainerDied","Data":"c5b20e71c53251e7e88fe51474f26f286a6874ee5ca62d1bd22f1c46934c6291"}
Jul 10 13:57:27.687865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.687488    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5b20e71c53251e7e88fe51474f26f286a6874ee5ca62d1bd22f1c46934c6291"
Jul 10 13:57:27.689524 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.689497    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb" event={"ID":"9b2948fe-4932-4e1f-b62c-b5452d865d6a","Type":"ContainerDied","Data":"17550b110008a494b666e9c75eafdcdafe2f62114c90a52f70fd91b91a267c37"}
Jul 10 13:57:27.689641 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.689535    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17550b110008a494b666e9c75eafdcdafe2f62114c90a52f70fd91b91a267c37"
Jul 10 13:57:27.689684 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:27.689643    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb"
Jul 10 13:57:36.245446 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245405    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"]
Jul 10 13:57:36.245930 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245911    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2bedd52-f074-4c17-9706-bd8699585559" containerName="extract"
Jul 10 13:57:36.245972 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245933    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2bedd52-f074-4c17-9706-bd8699585559" containerName="extract"
Jul 10 13:57:36.245972 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245945    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2bedd52-f074-4c17-9706-bd8699585559" containerName="util"
Jul 10 13:57:36.245972 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245955    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2bedd52-f074-4c17-9706-bd8699585559" containerName="util"
Jul 10 13:57:36.245972 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245970    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerName="util"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245979    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerName="util"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245992    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerName="extract"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.245999    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerName="extract"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246011    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerName="util"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246018    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerName="util"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246029    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerName="util"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246037    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerName="util"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246046    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerName="pull"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246053    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerName="pull"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246067    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerName="pull"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246075    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerName="pull"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246084    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerName="extract"
Jul 10 13:57:36.246091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246091    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerName="extract"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246099    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerName="pull"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246107    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerName="pull"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246129    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2bedd52-f074-4c17-9706-bd8699585559" containerName="pull"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246138    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2bedd52-f074-4c17-9706-bd8699585559" containerName="pull"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246148    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerName="extract"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246155    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerName="extract"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246245    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2bedd52-f074-4c17-9706-bd8699585559" containerName="extract"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246258    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3dcc56f-8cc1-4878-b983-a9f36de788dd" containerName="extract"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246268    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b2948fe-4932-4e1f-b62c-b5452d865d6a" containerName="extract"
Jul 10 13:57:36.246492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.246278    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="733fc345-1153-431f-a9c0-c3e3bc6bb192" containerName="extract"
Jul 10 13:57:36.250569 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.250551    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:57:36.254463 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.254440    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h2x8m\""
Jul 10 13:57:36.263185 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.263163    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"]
Jul 10 13:57:36.423283 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.423244    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h67kt\" (UniqueName: \"kubernetes.io/projected/450d5db5-c385-4155-8a41-c7dddc3ba9d3-kube-api-access-h67kt\") pod \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" (UID: \"450d5db5-c385-4155-8a41-c7dddc3ba9d3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:57:36.524847 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.524754    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h67kt\" (UniqueName: \"kubernetes.io/projected/450d5db5-c385-4155-8a41-c7dddc3ba9d3-kube-api-access-h67kt\") pod \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" (UID: \"450d5db5-c385-4155-8a41-c7dddc3ba9d3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:57:36.540561 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.540532    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h67kt\" (UniqueName: \"kubernetes.io/projected/450d5db5-c385-4155-8a41-c7dddc3ba9d3-kube-api-access-h67kt\") pod \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" (UID: \"450d5db5-c385-4155-8a41-c7dddc3ba9d3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:57:36.560187 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.560162    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:57:36.757490 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:36.757470    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"]
Jul 10 13:57:36.760117 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:36.760091    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450d5db5_c385_4155_8a41_c7dddc3ba9d3.slice/crio-0dcaedd07cd7daf8a328fecb77b56a550bbbf986c469feda1d6a63e39da726e9 WatchSource:0}: Error finding container 0dcaedd07cd7daf8a328fecb77b56a550bbbf986c469feda1d6a63e39da726e9: Status 404 returned error can't find the container with id 0dcaedd07cd7daf8a328fecb77b56a550bbbf986c469feda1d6a63e39da726e9
Jul 10 13:57:37.739424 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:37.739392    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq" event={"ID":"450d5db5-c385-4155-8a41-c7dddc3ba9d3","Type":"ContainerStarted","Data":"0dcaedd07cd7daf8a328fecb77b56a550bbbf986c469feda1d6a63e39da726e9"}
Jul 10 13:57:38.747002 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:38.746920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq" event={"ID":"450d5db5-c385-4155-8a41-c7dddc3ba9d3","Type":"ContainerStarted","Data":"0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936"}
Jul 10 13:57:38.747415 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:38.747076    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:57:38.766558 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:38.766515    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq" podStartSLOduration=1.053290331 podStartE2EDuration="2.766501731s" totalImagesPullingTime="1.7132114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:57:38.764259155 +0000 UTC m=+467.681303419" watchObservedRunningTime="2026-07-10 13:57:38.766501731 +0000 UTC m=+467.683546065"
Jul 10 13:57:39.709862 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:39.709827    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"]
Jul 10 13:57:39.713261 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:39.713245    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"
Jul 10 13:57:39.717226 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:39.717199    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4cx7n\""
Jul 10 13:57:39.717537 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:39.717523    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 10 13:57:39.727373 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:39.727353    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"]
Jul 10 13:57:39.749560 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:39.749536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqxt2\" (UniqueName: \"kubernetes.io/projected/e9fa8974-9bb3-434c-b059-e4c8be330c00-kube-api-access-xqxt2\") pod \"dns-operator-controller-manager-864dd78c4c-hcs26\" (UID: \"e9fa8974-9bb3-434c-b059-e4c8be330c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"
Jul 10 13:57:39.850631 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:39.850602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqxt2\" (UniqueName: \"kubernetes.io/projected/e9fa8974-9bb3-434c-b059-e4c8be330c00-kube-api-access-xqxt2\") pod \"dns-operator-controller-manager-864dd78c4c-hcs26\" (UID: \"e9fa8974-9bb3-434c-b059-e4c8be330c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"
Jul 10 13:57:39.862620 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:39.862600    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqxt2\" (UniqueName: \"kubernetes.io/projected/e9fa8974-9bb3-434c-b059-e4c8be330c00-kube-api-access-xqxt2\") pod \"dns-operator-controller-manager-864dd78c4c-hcs26\" (UID: \"e9fa8974-9bb3-434c-b059-e4c8be330c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"
Jul 10 13:57:40.024131 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:40.024058    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"
Jul 10 13:57:40.180943 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:40.180914    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"]
Jul 10 13:57:40.184149 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:40.184123    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fa8974_9bb3_434c_b059_e4c8be330c00.slice/crio-c0bcf0c98892e3fc6504853f8218fcc66cb4057b183abf8257e4b0634b1561b3 WatchSource:0}: Error finding container c0bcf0c98892e3fc6504853f8218fcc66cb4057b183abf8257e4b0634b1561b3: Status 404 returned error can't find the container with id c0bcf0c98892e3fc6504853f8218fcc66cb4057b183abf8257e4b0634b1561b3
Jul 10 13:57:40.760735 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:40.760693    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26" event={"ID":"e9fa8974-9bb3-434c-b059-e4c8be330c00","Type":"ContainerStarted","Data":"c0bcf0c98892e3fc6504853f8218fcc66cb4057b183abf8257e4b0634b1561b3"}
Jul 10 13:57:42.773244 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:42.773209    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26" event={"ID":"e9fa8974-9bb3-434c-b059-e4c8be330c00","Type":"ContainerStarted","Data":"a751417f1018f5505989d2c68abda7a1d5117e0170bda097769da8644b2b51f0"}
Jul 10 13:57:42.773610 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:42.773281    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"
Jul 10 13:57:42.796686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:42.796638    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26" podStartSLOduration=1.611837983 podStartE2EDuration="3.796622916s" totalImagesPullingTime="2.184784933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:57:42.795174328 +0000 UTC m=+471.712218604" watchObservedRunningTime="2026-07-10 13:57:42.796622916 +0000 UTC m=+471.713667170"
Jul 10 13:57:43.530228 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:43.530196    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-msm95"]
Jul 10 13:57:43.538547 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:43.538518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95"
Jul 10 13:57:43.541147 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:43.541128    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tsfbr\""
Jul 10 13:57:43.545492 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:43.545466    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-msm95"]
Jul 10 13:57:43.577740 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:43.577715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtfzs\" (UniqueName: \"kubernetes.io/projected/9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d-kube-api-access-vtfzs\") pod \"authorino-operator-75cc8d5cb7-msm95\" (UID: \"9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95"
Jul 10 13:57:43.678346 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:43.678314    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtfzs\" (UniqueName: \"kubernetes.io/projected/9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d-kube-api-access-vtfzs\") pod \"authorino-operator-75cc8d5cb7-msm95\" (UID: \"9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95"
Jul 10 13:57:43.701210 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:43.701183    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtfzs\" (UniqueName: \"kubernetes.io/projected/9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d-kube-api-access-vtfzs\") pod \"authorino-operator-75cc8d5cb7-msm95\" (UID: \"9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95"
Jul 10 13:57:43.850099 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:43.850041    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95"
Jul 10 13:57:44.041178 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:44.041151    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-msm95"]
Jul 10 13:57:44.042417 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:44.042381    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a817fbe_f0c5_406e_9cf8_b0c5b01ac88d.slice/crio-76ae753cd201715379cac7a8677119a3f2f1e7f58fa5f1db8685dd9f05500b17 WatchSource:0}: Error finding container 76ae753cd201715379cac7a8677119a3f2f1e7f58fa5f1db8685dd9f05500b17: Status 404 returned error can't find the container with id 76ae753cd201715379cac7a8677119a3f2f1e7f58fa5f1db8685dd9f05500b17
Jul 10 13:57:44.786704 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:44.786668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95" event={"ID":"9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d","Type":"ContainerStarted","Data":"76ae753cd201715379cac7a8677119a3f2f1e7f58fa5f1db8685dd9f05500b17"}
Jul 10 13:57:45.701709 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:45.701667    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d7c556b8c-wcj99" podUID="59750426-10e9-4a66-afce-9dc170f383fa" containerName="console" containerID="cri-o://7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042" gracePeriod=15
Jul 10 13:57:46.411162 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.411137    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:57:46.508871 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.508845    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-oauth-serving-cert\") pod \"59750426-10e9-4a66-afce-9dc170f383fa\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") "
Jul 10 13:57:46.508957 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.508896    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-oauth-config\") pod \"59750426-10e9-4a66-afce-9dc170f383fa\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") "
Jul 10 13:57:46.508957 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.508914    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-serving-cert\") pod \"59750426-10e9-4a66-afce-9dc170f383fa\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") "
Jul 10 13:57:46.508957 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.508936    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-trusted-ca-bundle\") pod \"59750426-10e9-4a66-afce-9dc170f383fa\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") "
Jul 10 13:57:46.508957 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.508952    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-service-ca\") pod \"59750426-10e9-4a66-afce-9dc170f383fa\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") "
Jul 10 13:57:46.509130 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.508969    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-console-config\") pod \"59750426-10e9-4a66-afce-9dc170f383fa\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") "
Jul 10 13:57:46.509130 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.508999    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzfbz\" (UniqueName: \"kubernetes.io/projected/59750426-10e9-4a66-afce-9dc170f383fa-kube-api-access-lzfbz\") pod \"59750426-10e9-4a66-afce-9dc170f383fa\" (UID: \"59750426-10e9-4a66-afce-9dc170f383fa\") "
Jul 10 13:57:46.509337 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.509300    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59750426-10e9-4a66-afce-9dc170f383fa" (UID: "59750426-10e9-4a66-afce-9dc170f383fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:57:46.509419 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.509345    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59750426-10e9-4a66-afce-9dc170f383fa" (UID: "59750426-10e9-4a66-afce-9dc170f383fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:57:46.509419 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.509375    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-console-config" (OuterVolumeSpecName: "console-config") pod "59750426-10e9-4a66-afce-9dc170f383fa" (UID: "59750426-10e9-4a66-afce-9dc170f383fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:57:46.509419 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.509385    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "59750426-10e9-4a66-afce-9dc170f383fa" (UID: "59750426-10e9-4a66-afce-9dc170f383fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:57:46.510963 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.510934    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59750426-10e9-4a66-afce-9dc170f383fa" (UID: "59750426-10e9-4a66-afce-9dc170f383fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:57:46.511097 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.511074    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59750426-10e9-4a66-afce-9dc170f383fa" (UID: "59750426-10e9-4a66-afce-9dc170f383fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:57:46.511163 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.511149    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59750426-10e9-4a66-afce-9dc170f383fa-kube-api-access-lzfbz" (OuterVolumeSpecName: "kube-api-access-lzfbz") pod "59750426-10e9-4a66-afce-9dc170f383fa" (UID: "59750426-10e9-4a66-afce-9dc170f383fa"). InnerVolumeSpecName "kube-api-access-lzfbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:57:46.610702 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.610661    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:46.610702 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.610688    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-trusted-ca-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:46.610702 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.610703    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:46.610908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.610716    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-console-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:46.610908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.610727    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzfbz\" (UniqueName: \"kubernetes.io/projected/59750426-10e9-4a66-afce-9dc170f383fa-kube-api-access-lzfbz\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:46.610908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.610754    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59750426-10e9-4a66-afce-9dc170f383fa-oauth-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:46.610908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.610768    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59750426-10e9-4a66-afce-9dc170f383fa-console-oauth-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:57:46.798439 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.798407    2570 generic.go:356] "Generic (PLEG): container finished" podID="59750426-10e9-4a66-afce-9dc170f383fa" containerID="7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042" exitCode=0
Jul 10 13:57:46.798888 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.798458    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7c556b8c-wcj99"
Jul 10 13:57:46.798888 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.798500    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7c556b8c-wcj99" event={"ID":"59750426-10e9-4a66-afce-9dc170f383fa","Type":"ContainerDied","Data":"7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042"}
Jul 10 13:57:46.798888 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.798588    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7c556b8c-wcj99" event={"ID":"59750426-10e9-4a66-afce-9dc170f383fa","Type":"ContainerDied","Data":"ad547cbd223f32e6f33361472d08f6e97eb5344b7a9dbb9076ea89bd695f50d2"}
Jul 10 13:57:46.798888 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.798617    2570 scope.go:117] "RemoveContainer" containerID="7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042"
Jul 10 13:57:46.800293 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.800261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95" event={"ID":"9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d","Type":"ContainerStarted","Data":"5e341f049e6d4516530de10b975831c70befbc0f8f9de81c0a69af7aa2124584"}
Jul 10 13:57:46.800401 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.800385    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95"
Jul 10 13:57:46.807868 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.807849    2570 scope.go:117] "RemoveContainer" containerID="7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042"
Jul 10 13:57:46.808122 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:57:46.808104    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042\": container with ID starting with 7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042 not found: ID does not exist" containerID="7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042"
Jul 10 13:57:46.808164 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.808131    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042"} err="failed to get container status \"7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042\": rpc error: code = NotFound desc = could not find container \"7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042\": container with ID starting with 7a3ae9083423f6212b49c4ce8c910d56e5a0c21cc08819dfde7e20393c04a042 not found: ID does not exist"
Jul 10 13:57:46.826232 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.826190    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95" podStartSLOduration=1.425716155 podStartE2EDuration="3.826177653s" totalImagesPullingTime="2.400461498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:57:46.825384237 +0000 UTC m=+475.742428500" watchObservedRunningTime="2026-07-10 13:57:46.826177653 +0000 UTC m=+475.743221915"
Jul 10 13:57:46.850004 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.849982    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7c556b8c-wcj99"]
Jul 10 13:57:46.859509 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:46.859488    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7c556b8c-wcj99"]
Jul 10 13:57:47.564758 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:47.564717    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59750426-10e9-4a66-afce-9dc170f383fa" path="/var/lib/kubelet/pods/59750426-10e9-4a66-afce-9dc170f383fa/volumes"
Jul 10 13:57:48.118935 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.118903    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"]
Jul 10 13:57:48.119416 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.119395    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59750426-10e9-4a66-afce-9dc170f383fa" containerName="console"
Jul 10 13:57:48.119501 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.119418    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="59750426-10e9-4a66-afce-9dc170f383fa" containerName="console"
Jul 10 13:57:48.119572 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.119527    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="59750426-10e9-4a66-afce-9dc170f383fa" containerName="console"
Jul 10 13:57:48.124207 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.124185    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:48.126611 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.126588    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68m97\""
Jul 10 13:57:48.134875 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.134851    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"]
Jul 10 13:57:48.223463 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.223422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ce021a-a671-44c2-9abe-a26de56cc735-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" (UID: \"a7ce021a-a671-44c2-9abe-a26de56cc735\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:48.223463 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.223462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrcj5\" (UniqueName: \"kubernetes.io/projected/a7ce021a-a671-44c2-9abe-a26de56cc735-kube-api-access-lrcj5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" (UID: \"a7ce021a-a671-44c2-9abe-a26de56cc735\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:48.324878 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.324836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ce021a-a671-44c2-9abe-a26de56cc735-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" (UID: \"a7ce021a-a671-44c2-9abe-a26de56cc735\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:48.324878 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.324881    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrcj5\" (UniqueName: \"kubernetes.io/projected/a7ce021a-a671-44c2-9abe-a26de56cc735-kube-api-access-lrcj5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" (UID: \"a7ce021a-a671-44c2-9abe-a26de56cc735\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:48.325233 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.325210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ce021a-a671-44c2-9abe-a26de56cc735-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" (UID: \"a7ce021a-a671-44c2-9abe-a26de56cc735\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:48.338575 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.338545    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrcj5\" (UniqueName: \"kubernetes.io/projected/a7ce021a-a671-44c2-9abe-a26de56cc735-kube-api-access-lrcj5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" (UID: \"a7ce021a-a671-44c2-9abe-a26de56cc735\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:48.434608 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.434524    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:48.577158 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.577128    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"]
Jul 10 13:57:48.579177 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:57:48.579150    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ce021a_a671_44c2_9abe_a26de56cc735.slice/crio-53b178dabf1a286a1a3a61b405c42a538f3526ca8e70ff8d65cd66256a35bfaa WatchSource:0}: Error finding container 53b178dabf1a286a1a3a61b405c42a538f3526ca8e70ff8d65cd66256a35bfaa: Status 404 returned error can't find the container with id 53b178dabf1a286a1a3a61b405c42a538f3526ca8e70ff8d65cd66256a35bfaa
Jul 10 13:57:48.813022 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:48.812953    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4" event={"ID":"a7ce021a-a671-44c2-9abe-a26de56cc735","Type":"ContainerStarted","Data":"53b178dabf1a286a1a3a61b405c42a538f3526ca8e70ff8d65cd66256a35bfaa"}
Jul 10 13:57:49.754699 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:49.754658    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:57:53.780810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:53.780781    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hcs26"
Jul 10 13:57:55.856711 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:55.856668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4" event={"ID":"a7ce021a-a671-44c2-9abe-a26de56cc735","Type":"ContainerStarted","Data":"f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0"}
Jul 10 13:57:55.857092 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:55.856731    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:57:55.878359 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:55.878305    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4" podStartSLOduration=1.417788785 podStartE2EDuration="7.87829035s" totalImagesPullingTime="6.460501565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:57:55.875231808 +0000 UTC m=+484.792276071" watchObservedRunningTime="2026-07-10 13:57:55.87829035 +0000 UTC m=+484.795334612"
Jul 10 13:57:57.809117 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:57:57.809086    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-msm95"
Jul 10 13:58:06.864698 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:06.864667    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.633881 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.633849    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"]
Jul 10 13:58:08.634254 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.634013    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" containerName="manager" containerID="cri-o://f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0" gracePeriod=2
Jul 10 13:58:08.644247 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.644217    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"]
Jul 10 13:58:08.670020 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.669974    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"]
Jul 10 13:58:08.670286 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.670230    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" containerName="manager" containerID="cri-o://0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936" gracePeriod=2
Jul 10 13:58:08.672227 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.672204    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"]
Jul 10 13:58:08.672342 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.672273    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.672576 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.672562    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" containerName="manager"
Jul 10 13:58:08.672576 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.672577    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" containerName="manager"
Jul 10 13:58:08.672715 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.672647    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" containerName="manager"
Jul 10 13:58:08.676130 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.676110    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:08.679574 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.679550    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"]
Jul 10 13:58:08.684478 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.684455    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"]
Jul 10 13:58:08.693513 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.693489    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"]
Jul 10 13:58:08.694036 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.694017    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" containerName="manager"
Jul 10 13:58:08.694036 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.694037    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" containerName="manager"
Jul 10 13:58:08.694149 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.694115    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" containerName="manager"
Jul 10 13:58:08.697578 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.697554    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"
Jul 10 13:58:08.709941 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.708289    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:08.709941 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.709829    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.711856 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.711829    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:08.713226 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.713200    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"]
Jul 10 13:58:08.727133 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.727104    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.797162 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.797137    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31118821-f3ce-4b88-a415-bb955ee2e0ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rm2bg\" (UID: \"31118821-f3ce-4b88-a415-bb955ee2e0ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:08.797255 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.797182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nrd9\" (UniqueName: \"kubernetes.io/projected/31118821-f3ce-4b88-a415-bb955ee2e0ed-kube-api-access-2nrd9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rm2bg\" (UID: \"31118821-f3ce-4b88-a415-bb955ee2e0ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:08.797255 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.797207    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlb6k\" (UniqueName: \"kubernetes.io/projected/c5d55f70-0b69-481d-a828-84f3ac5eb024-kube-api-access-wlb6k\") pod \"limitador-operator-controller-manager-859d7b78bd-d9bql\" (UID: \"c5d55f70-0b69-481d-a828-84f3ac5eb024\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"
Jul 10 13:58:08.898430 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.898395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlb6k\" (UniqueName: \"kubernetes.io/projected/c5d55f70-0b69-481d-a828-84f3ac5eb024-kube-api-access-wlb6k\") pod \"limitador-operator-controller-manager-859d7b78bd-d9bql\" (UID: \"c5d55f70-0b69-481d-a828-84f3ac5eb024\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"
Jul 10 13:58:08.898566 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.898547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31118821-f3ce-4b88-a415-bb955ee2e0ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rm2bg\" (UID: \"31118821-f3ce-4b88-a415-bb955ee2e0ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:08.898646 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.898607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nrd9\" (UniqueName: \"kubernetes.io/projected/31118821-f3ce-4b88-a415-bb955ee2e0ed-kube-api-access-2nrd9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rm2bg\" (UID: \"31118821-f3ce-4b88-a415-bb955ee2e0ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:08.898961 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.898934    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31118821-f3ce-4b88-a415-bb955ee2e0ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rm2bg\" (UID: \"31118821-f3ce-4b88-a415-bb955ee2e0ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:08.909276 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.909254    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nrd9\" (UniqueName: \"kubernetes.io/projected/31118821-f3ce-4b88-a415-bb955ee2e0ed-kube-api-access-2nrd9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rm2bg\" (UID: \"31118821-f3ce-4b88-a415-bb955ee2e0ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:08.909382 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.909327    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlb6k\" (UniqueName: \"kubernetes.io/projected/c5d55f70-0b69-481d-a828-84f3ac5eb024-kube-api-access-wlb6k\") pod \"limitador-operator-controller-manager-859d7b78bd-d9bql\" (UID: \"c5d55f70-0b69-481d-a828-84f3ac5eb024\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"
Jul 10 13:58:08.915136 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.915117    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.917163 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.917148    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:08.917249 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.917228    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:08.919174 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.919150    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.921358 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.921334    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:08.923332 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.923308    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.924288 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.924265    2570 generic.go:356] "Generic (PLEG): container finished" podID="a7ce021a-a671-44c2-9abe-a26de56cc735" containerID="f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0" exitCode=0
Jul 10 13:58:08.924346 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.924297    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.924392 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.924361    2570 scope.go:117] "RemoveContainer" containerID="f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0"
Jul 10 13:58:08.925585 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.925561    2570 generic.go:356] "Generic (PLEG): container finished" podID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" containerID="0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936" exitCode=0
Jul 10 13:58:08.925667 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.925595    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:08.927665 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.927644    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:08.929424 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.929403    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.931538 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.931518    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:08.932963 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.932949    2570 scope.go:117] "RemoveContainer" containerID="f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0"
Jul 10 13:58:08.933192 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.933174    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0\": container with ID starting with f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0 not found: ID does not exist" containerID="f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0"
Jul 10 13:58:08.933229 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.933201    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0"} err="failed to get container status \"f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0\": rpc error: code = NotFound desc = could not find container \"f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0\": container with ID starting with f5d4a4c9d118c606dd65697d77b68f27cd52e647fef517631c6cb8e1927f62d0 not found: ID does not exist"
Jul 10 13:58:08.933229 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.933216    2570 scope.go:117] "RemoveContainer" containerID="0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936"
Jul 10 13:58:08.935442 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.935412    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:08.940835 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.940819    2570 scope.go:117] "RemoveContainer" containerID="0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936"
Jul 10 13:58:08.941088 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:08.941068    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936\": container with ID starting with 0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936 not found: ID does not exist" containerID="0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936"
Jul 10 13:58:08.941146 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.941096    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936"} err="failed to get container status \"0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936\": rpc error: code = NotFound desc = could not find container \"0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936\": container with ID starting with 0f6f700742b41629cc5adf66104155f1d2560212474dd26dddb667c3139b1936 not found: ID does not exist"
Jul 10 13:58:08.999262 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.999237    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ce021a-a671-44c2-9abe-a26de56cc735-extensions-socket-volume\") pod \"a7ce021a-a671-44c2-9abe-a26de56cc735\" (UID: \"a7ce021a-a671-44c2-9abe-a26de56cc735\") "
Jul 10 13:58:08.999352 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.999271    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrcj5\" (UniqueName: \"kubernetes.io/projected/a7ce021a-a671-44c2-9abe-a26de56cc735-kube-api-access-lrcj5\") pod \"a7ce021a-a671-44c2-9abe-a26de56cc735\" (UID: \"a7ce021a-a671-44c2-9abe-a26de56cc735\") "
Jul 10 13:58:08.999352 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.999313    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h67kt\" (UniqueName: \"kubernetes.io/projected/450d5db5-c385-4155-8a41-c7dddc3ba9d3-kube-api-access-h67kt\") pod \"450d5db5-c385-4155-8a41-c7dddc3ba9d3\" (UID: \"450d5db5-c385-4155-8a41-c7dddc3ba9d3\") "
Jul 10 13:58:08.999687 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:08.999658    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ce021a-a671-44c2-9abe-a26de56cc735-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a7ce021a-a671-44c2-9abe-a26de56cc735" (UID: "a7ce021a-a671-44c2-9abe-a26de56cc735"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:58:09.001312 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.001285    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/450d5db5-c385-4155-8a41-c7dddc3ba9d3-kube-api-access-h67kt" (OuterVolumeSpecName: "kube-api-access-h67kt") pod "450d5db5-c385-4155-8a41-c7dddc3ba9d3" (UID: "450d5db5-c385-4155-8a41-c7dddc3ba9d3"). InnerVolumeSpecName "kube-api-access-h67kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:58:09.001312 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.001311    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ce021a-a671-44c2-9abe-a26de56cc735-kube-api-access-lrcj5" (OuterVolumeSpecName: "kube-api-access-lrcj5") pod "a7ce021a-a671-44c2-9abe-a26de56cc735" (UID: "a7ce021a-a671-44c2-9abe-a26de56cc735"). InnerVolumeSpecName "kube-api-access-lrcj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:58:09.056530 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.056491    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:09.062124 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.062101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"
Jul 10 13:58:09.100965 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.100929    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h67kt\" (UniqueName: \"kubernetes.io/projected/450d5db5-c385-4155-8a41-c7dddc3ba9d3-kube-api-access-h67kt\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:58:09.100965 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.100961    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ce021a-a671-44c2-9abe-a26de56cc735-extensions-socket-volume\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:58:09.101201 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.100978    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrcj5\" (UniqueName: \"kubernetes.io/projected/a7ce021a-a671-44c2-9abe-a26de56cc735-kube-api-access-lrcj5\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:58:09.204869 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.204833    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"]
Jul 10 13:58:09.206100 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:58:09.206011    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d55f70_0b69_481d_a828_84f3ac5eb024.slice/crio-b01a24e4e9f5a42a7c8586f7ed561372a432bb036246f8012134ab528286b3ca WatchSource:0}: Error finding container b01a24e4e9f5a42a7c8586f7ed561372a432bb036246f8012134ab528286b3ca: Status 404 returned error can't find the container with id b01a24e4e9f5a42a7c8586f7ed561372a432bb036246f8012134ab528286b3ca
Jul 10 13:58:09.224367 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.224287    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"]
Jul 10 13:58:09.228325 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:58:09.228296    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31118821_f3ce_4b88_a415_bb955ee2e0ed.slice/crio-88cc4a968429af0aac9ef5c31b8e6801ad22de3dbfbb7aac78c2c747fd8b1172 WatchSource:0}: Error finding container 88cc4a968429af0aac9ef5c31b8e6801ad22de3dbfbb7aac78c2c747fd8b1172: Status 404 returned error can't find the container with id 88cc4a968429af0aac9ef5c31b8e6801ad22de3dbfbb7aac78c2c747fd8b1172
Jul 10 13:58:09.264971 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:09.264938    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:09.266706 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:09.266681    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:09.268573 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:09.268547    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n4cp4\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n4cp4"
Jul 10 13:58:09.270219 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:09.270196    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ndmvq\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ndmvq"
Jul 10 13:58:09.565151 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.565121    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="450d5db5-c385-4155-8a41-c7dddc3ba9d3" path="/var/lib/kubelet/pods/450d5db5-c385-4155-8a41-c7dddc3ba9d3/volumes"
Jul 10 13:58:09.565459 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.565446    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7ce021a-a671-44c2-9abe-a26de56cc735" path="/var/lib/kubelet/pods/a7ce021a-a671-44c2-9abe-a26de56cc735/volumes"
Jul 10 13:58:09.932444 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.932346    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg" event={"ID":"31118821-f3ce-4b88-a415-bb955ee2e0ed","Type":"ContainerStarted","Data":"d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07"}
Jul 10 13:58:09.932444 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.932420    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:09.932882 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.932452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg" event={"ID":"31118821-f3ce-4b88-a415-bb955ee2e0ed","Type":"ContainerStarted","Data":"88cc4a968429af0aac9ef5c31b8e6801ad22de3dbfbb7aac78c2c747fd8b1172"}
Jul 10 13:58:09.933927 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.933902    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql" event={"ID":"c5d55f70-0b69-481d-a828-84f3ac5eb024","Type":"ContainerStarted","Data":"2fd5ae4e511b62977f67110d024a077c18f34bf1b133dcea30d39f2575781f9d"}
Jul 10 13:58:09.934063 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.933946    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql" event={"ID":"c5d55f70-0b69-481d-a828-84f3ac5eb024","Type":"ContainerStarted","Data":"b01a24e4e9f5a42a7c8586f7ed561372a432bb036246f8012134ab528286b3ca"}
Jul 10 13:58:09.934063 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.933984    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"
Jul 10 13:58:09.954154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.954099    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg" podStartSLOduration=1.954083975 podStartE2EDuration="1.954083975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:58:09.95158646 +0000 UTC m=+498.868630729" watchObservedRunningTime="2026-07-10 13:58:09.954083975 +0000 UTC m=+498.871128265"
Jul 10 13:58:09.974390 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:09.974341    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql" podStartSLOduration=1.974319415 podStartE2EDuration="1.974319415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:58:09.971982873 +0000 UTC m=+498.889027138" watchObservedRunningTime="2026-07-10 13:58:09.974319415 +0000 UTC m=+498.891363678"
Jul 10 13:58:20.943300 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:20.943263    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:20.943739 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:20.943504    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d9bql"
Jul 10 13:58:37.236121 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.236085    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"]
Jul 10 13:58:37.236553 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.236304    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg" podUID="31118821-f3ce-4b88-a415-bb955ee2e0ed" containerName="manager" containerID="cri-o://d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07" gracePeriod=10
Jul 10 13:58:37.460497 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.460460    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"]
Jul 10 13:58:37.463201 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.463178    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:37.480865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.480840    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"]
Jul 10 13:58:37.492000 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.491948    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:37.629099 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.629076    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nrd9\" (UniqueName: \"kubernetes.io/projected/31118821-f3ce-4b88-a415-bb955ee2e0ed-kube-api-access-2nrd9\") pod \"31118821-f3ce-4b88-a415-bb955ee2e0ed\" (UID: \"31118821-f3ce-4b88-a415-bb955ee2e0ed\") "
Jul 10 13:58:37.629235 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.629111    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31118821-f3ce-4b88-a415-bb955ee2e0ed-extensions-socket-volume\") pod \"31118821-f3ce-4b88-a415-bb955ee2e0ed\" (UID: \"31118821-f3ce-4b88-a415-bb955ee2e0ed\") "
Jul 10 13:58:37.629235 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.629218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5qnjs\" (UID: \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:37.629315 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.629255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzq5h\" (UniqueName: \"kubernetes.io/projected/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-kube-api-access-gzq5h\") pod \"kuadrant-operator-controller-manager-86878c769f-5qnjs\" (UID: \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:37.629550 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.629529    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31118821-f3ce-4b88-a415-bb955ee2e0ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31118821-f3ce-4b88-a415-bb955ee2e0ed" (UID: "31118821-f3ce-4b88-a415-bb955ee2e0ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:58:37.631221 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.631196    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31118821-f3ce-4b88-a415-bb955ee2e0ed-kube-api-access-2nrd9" (OuterVolumeSpecName: "kube-api-access-2nrd9") pod "31118821-f3ce-4b88-a415-bb955ee2e0ed" (UID: "31118821-f3ce-4b88-a415-bb955ee2e0ed"). InnerVolumeSpecName "kube-api-access-2nrd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:58:37.729716 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.729687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5qnjs\" (UID: \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:37.729851 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.729771    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq5h\" (UniqueName: \"kubernetes.io/projected/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-kube-api-access-gzq5h\") pod \"kuadrant-operator-controller-manager-86878c769f-5qnjs\" (UID: \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:37.729851 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.729822    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nrd9\" (UniqueName: \"kubernetes.io/projected/31118821-f3ce-4b88-a415-bb955ee2e0ed-kube-api-access-2nrd9\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:58:37.729851 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.729839    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31118821-f3ce-4b88-a415-bb955ee2e0ed-extensions-socket-volume\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:58:37.730162 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.730048    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5qnjs\" (UID: \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:37.740389 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.740363    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzq5h\" (UniqueName: \"kubernetes.io/projected/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-kube-api-access-gzq5h\") pod \"kuadrant-operator-controller-manager-86878c769f-5qnjs\" (UID: \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:37.789856 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.789808    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:37.920910 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:37.920878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"]
Jul 10 13:58:37.923618 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:58:37.923587    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5a24a0_7dea_4076_8b2a_b1047a7bc995.slice/crio-6f54590feac447aedae2db782a49550091012fbf739eb01efcb426ce00a462a7 WatchSource:0}: Error finding container 6f54590feac447aedae2db782a49550091012fbf739eb01efcb426ce00a462a7: Status 404 returned error can't find the container with id 6f54590feac447aedae2db782a49550091012fbf739eb01efcb426ce00a462a7
Jul 10 13:58:38.103848 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.103736    2570 generic.go:356] "Generic (PLEG): container finished" podID="31118821-f3ce-4b88-a415-bb955ee2e0ed" containerID="d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07" exitCode=0
Jul 10 13:58:38.103848 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.103795    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"
Jul 10 13:58:38.103848 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.103825    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg" event={"ID":"31118821-f3ce-4b88-a415-bb955ee2e0ed","Type":"ContainerDied","Data":"d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07"}
Jul 10 13:58:38.104091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.103879    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg" event={"ID":"31118821-f3ce-4b88-a415-bb955ee2e0ed","Type":"ContainerDied","Data":"88cc4a968429af0aac9ef5c31b8e6801ad22de3dbfbb7aac78c2c747fd8b1172"}
Jul 10 13:58:38.104091 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.103908    2570 scope.go:117] "RemoveContainer" containerID="d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07"
Jul 10 13:58:38.105791 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.105766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs" event={"ID":"9b5a24a0-7dea-4076-8b2a-b1047a7bc995","Type":"ContainerStarted","Data":"692e04a3459864a6d4aeb92b4914b8900113df1d629c3798cb743b8a26d76956"}
Jul 10 13:58:38.105893 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.105815    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs" event={"ID":"9b5a24a0-7dea-4076-8b2a-b1047a7bc995","Type":"ContainerStarted","Data":"6f54590feac447aedae2db782a49550091012fbf739eb01efcb426ce00a462a7"}
Jul 10 13:58:38.105893 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.105846    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:38.113150 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.113131    2570 scope.go:117] "RemoveContainer" containerID="d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07"
Jul 10 13:58:38.113376 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:58:38.113356    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07\": container with ID starting with d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07 not found: ID does not exist" containerID="d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07"
Jul 10 13:58:38.113430 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.113391    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07"} err="failed to get container status \"d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07\": rpc error: code = NotFound desc = could not find container \"d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07\": container with ID starting with d329d66daf1e8cd8a64a7ced8618e3ea8702799a3d9d2f34ebf5f48d4ea78a07 not found: ID does not exist"
Jul 10 13:58:38.129174 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.129150    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"]
Jul 10 13:58:38.132621 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.132600    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rm2bg"]
Jul 10 13:58:38.149934 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:38.149899    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs" podStartSLOduration=1.149885937 podStartE2EDuration="1.149885937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:58:38.148458878 +0000 UTC m=+527.065503141" watchObservedRunningTime="2026-07-10 13:58:38.149885937 +0000 UTC m=+527.066930200"
Jul 10 13:58:39.564980 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:39.564947    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31118821-f3ce-4b88-a415-bb955ee2e0ed" path="/var/lib/kubelet/pods/31118821-f3ce-4b88-a415-bb955ee2e0ed/volumes"
Jul 10 13:58:49.115660 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:49.115580    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 13:58:58.047587 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.047556    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j68hs"]
Jul 10 13:58:58.048077 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.047944    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31118821-f3ce-4b88-a415-bb955ee2e0ed" containerName="manager"
Jul 10 13:58:58.048077 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.047957    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="31118821-f3ce-4b88-a415-bb955ee2e0ed" containerName="manager"
Jul 10 13:58:58.048077 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.048019    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="31118821-f3ce-4b88-a415-bb955ee2e0ed" containerName="manager"
Jul 10 13:58:58.052453 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.052437    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:58:58.054930 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.054905    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 13:58:58.055072 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.055056    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tpptj\""
Jul 10 13:58:58.061354 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.061331    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j68hs"]
Jul 10 13:58:58.083203 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.083172    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctl9t\" (UniqueName: \"kubernetes.io/projected/a70171ee-53de-4682-a9ce-492c73f449de-kube-api-access-ctl9t\") pod \"limitador-limitador-64c94fd64f-j68hs\" (UID: \"a70171ee-53de-4682-a9ce-492c73f449de\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:58:58.083334 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.083274    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a70171ee-53de-4682-a9ce-492c73f449de-config-file\") pod \"limitador-limitador-64c94fd64f-j68hs\" (UID: \"a70171ee-53de-4682-a9ce-492c73f449de\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:58:58.137540 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.137509    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j68hs"]
Jul 10 13:58:58.184171 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.184141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl9t\" (UniqueName: \"kubernetes.io/projected/a70171ee-53de-4682-a9ce-492c73f449de-kube-api-access-ctl9t\") pod \"limitador-limitador-64c94fd64f-j68hs\" (UID: \"a70171ee-53de-4682-a9ce-492c73f449de\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:58:58.184316 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.184192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a70171ee-53de-4682-a9ce-492c73f449de-config-file\") pod \"limitador-limitador-64c94fd64f-j68hs\" (UID: \"a70171ee-53de-4682-a9ce-492c73f449de\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:58:58.184831 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.184814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a70171ee-53de-4682-a9ce-492c73f449de-config-file\") pod \"limitador-limitador-64c94fd64f-j68hs\" (UID: \"a70171ee-53de-4682-a9ce-492c73f449de\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:58:58.192669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.192641    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctl9t\" (UniqueName: \"kubernetes.io/projected/a70171ee-53de-4682-a9ce-492c73f449de-kube-api-access-ctl9t\") pod \"limitador-limitador-64c94fd64f-j68hs\" (UID: \"a70171ee-53de-4682-a9ce-492c73f449de\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:58:58.363680 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.363603    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:58:58.509197 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.509176    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j68hs"]
Jul 10 13:58:58.511171 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:58:58.511135    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70171ee_53de_4682_a9ce_492c73f449de.slice/crio-3195978f08086ddcc630bacfeb1eba8d5778b4d743d0e77c1cc86fb91874025e WatchSource:0}: Error finding container 3195978f08086ddcc630bacfeb1eba8d5778b4d743d0e77c1cc86fb91874025e: Status 404 returned error can't find the container with id 3195978f08086ddcc630bacfeb1eba8d5778b4d743d0e77c1cc86fb91874025e
Jul 10 13:58:58.848709 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.848678    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fsrsn"]
Jul 10 13:58:58.853958 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.853938    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fsrsn"
Jul 10 13:58:58.856513 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.856492    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hh8xv\""
Jul 10 13:58:58.859477 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.859452    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fsrsn"]
Jul 10 13:58:58.889863 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.889838    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrmqp\" (UniqueName: \"kubernetes.io/projected/c6d5c271-e6f9-422d-bb06-33f7dbee5fad-kube-api-access-zrmqp\") pod \"authorino-58cd955675-fsrsn\" (UID: \"c6d5c271-e6f9-422d-bb06-33f7dbee5fad\") " pod="kuadrant-system/authorino-58cd955675-fsrsn"
Jul 10 13:58:58.963221 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.963193    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-qrmgj"]
Jul 10 13:58:58.966547 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.966530    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qrmgj"
Jul 10 13:58:58.974011 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.973991    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qrmgj"]
Jul 10 13:58:58.991422 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.990551    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmqp\" (UniqueName: \"kubernetes.io/projected/c6d5c271-e6f9-422d-bb06-33f7dbee5fad-kube-api-access-zrmqp\") pod \"authorino-58cd955675-fsrsn\" (UID: \"c6d5c271-e6f9-422d-bb06-33f7dbee5fad\") " pod="kuadrant-system/authorino-58cd955675-fsrsn"
Jul 10 13:58:58.991422 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.990767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkpdd\" (UniqueName: \"kubernetes.io/projected/0ea0a906-b407-49c7-adea-c34077001908-kube-api-access-zkpdd\") pod \"authorino-75d556bd77-qrmgj\" (UID: \"0ea0a906-b407-49c7-adea-c34077001908\") " pod="kuadrant-system/authorino-75d556bd77-qrmgj"
Jul 10 13:58:58.999424 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:58.999397    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmqp\" (UniqueName: \"kubernetes.io/projected/c6d5c271-e6f9-422d-bb06-33f7dbee5fad-kube-api-access-zrmqp\") pod \"authorino-58cd955675-fsrsn\" (UID: \"c6d5c271-e6f9-422d-bb06-33f7dbee5fad\") " pod="kuadrant-system/authorino-58cd955675-fsrsn"
Jul 10 13:58:59.092211 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:59.092180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkpdd\" (UniqueName: \"kubernetes.io/projected/0ea0a906-b407-49c7-adea-c34077001908-kube-api-access-zkpdd\") pod \"authorino-75d556bd77-qrmgj\" (UID: \"0ea0a906-b407-49c7-adea-c34077001908\") " pod="kuadrant-system/authorino-75d556bd77-qrmgj"
Jul 10 13:58:59.099884 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:59.099834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkpdd\" (UniqueName: \"kubernetes.io/projected/0ea0a906-b407-49c7-adea-c34077001908-kube-api-access-zkpdd\") pod \"authorino-75d556bd77-qrmgj\" (UID: \"0ea0a906-b407-49c7-adea-c34077001908\") " pod="kuadrant-system/authorino-75d556bd77-qrmgj"
Jul 10 13:58:59.165213 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:59.165187    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fsrsn"
Jul 10 13:58:59.248556 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:59.248042    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs" event={"ID":"a70171ee-53de-4682-a9ce-492c73f449de","Type":"ContainerStarted","Data":"3195978f08086ddcc630bacfeb1eba8d5778b4d743d0e77c1cc86fb91874025e"}
Jul 10 13:58:59.276332 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:59.276103    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qrmgj"
Jul 10 13:58:59.347457 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:59.346293    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fsrsn"]
Jul 10 13:58:59.480934 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:58:59.480869    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qrmgj"]
Jul 10 13:58:59.485111 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:58:59.485069    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ea0a906_b407_49c7_adea_c34077001908.slice/crio-821d4c40b093af50fbfd94529344684e1211bf4db60b7d22f1c3e22f1b97725d WatchSource:0}: Error finding container 821d4c40b093af50fbfd94529344684e1211bf4db60b7d22f1c3e22f1b97725d: Status 404 returned error can't find the container with id 821d4c40b093af50fbfd94529344684e1211bf4db60b7d22f1c3e22f1b97725d
Jul 10 13:59:00.264396 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:00.262961    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qrmgj" event={"ID":"0ea0a906-b407-49c7-adea-c34077001908","Type":"ContainerStarted","Data":"821d4c40b093af50fbfd94529344684e1211bf4db60b7d22f1c3e22f1b97725d"}
Jul 10 13:59:00.264991 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:00.264940    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fsrsn" event={"ID":"c6d5c271-e6f9-422d-bb06-33f7dbee5fad","Type":"ContainerStarted","Data":"ba490c8533c6d13262041b83564f7f0d46a979a1b0eb8c2a19437dd39dcd0afb"}
Jul 10 13:59:04.297328 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:04.297283    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs" event={"ID":"a70171ee-53de-4682-a9ce-492c73f449de","Type":"ContainerStarted","Data":"98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828"}
Jul 10 13:59:04.297840 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:04.297391    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:59:04.300856 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:04.300813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qrmgj" event={"ID":"0ea0a906-b407-49c7-adea-c34077001908","Type":"ContainerStarted","Data":"cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82"}
Jul 10 13:59:04.302806 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:04.302779    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fsrsn" event={"ID":"c6d5c271-e6f9-422d-bb06-33f7dbee5fad","Type":"ContainerStarted","Data":"b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569"}
Jul 10 13:59:04.318242 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:04.318194    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs" podStartSLOduration=1.104380825 podStartE2EDuration="6.318179454s" totalImagesPullingTime="5.213798629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:59:04.316968703 +0000 UTC m=+553.234012964" watchObservedRunningTime="2026-07-10 13:59:04.318179454 +0000 UTC m=+553.235223717"
Jul 10 13:59:04.334393 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:04.334341    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-qrmgj" podStartSLOduration=2.081773027 podStartE2EDuration="6.334319131s" totalImagesPullingTime="4.252546104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:59:04.33188704 +0000 UTC m=+553.248931304" watchObservedRunningTime="2026-07-10 13:59:04.334319131 +0000 UTC m=+553.251363394"
Jul 10 13:59:04.348525 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:04.348476    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fsrsn" podStartSLOduration=1.9740214759999999 podStartE2EDuration="6.348460998s" totalImagesPullingTime="4.374439522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:59:04.345486445 +0000 UTC m=+553.262530712" watchObservedRunningTime="2026-07-10 13:59:04.348460998 +0000 UTC m=+553.265505261"
Jul 10 13:59:04.376578 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:04.376542    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fsrsn"]
Jul 10 13:59:06.315165 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:06.315126    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fsrsn" podUID="c6d5c271-e6f9-422d-bb06-33f7dbee5fad" containerName="authorino" containerID="cri-o://b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569" gracePeriod=30
Jul 10 13:59:06.559913 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:06.559883    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fsrsn"
Jul 10 13:59:06.661608 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:06.661534    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrmqp\" (UniqueName: \"kubernetes.io/projected/c6d5c271-e6f9-422d-bb06-33f7dbee5fad-kube-api-access-zrmqp\") pod \"c6d5c271-e6f9-422d-bb06-33f7dbee5fad\" (UID: \"c6d5c271-e6f9-422d-bb06-33f7dbee5fad\") "
Jul 10 13:59:06.663394 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:06.663370    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6d5c271-e6f9-422d-bb06-33f7dbee5fad-kube-api-access-zrmqp" (OuterVolumeSpecName: "kube-api-access-zrmqp") pod "c6d5c271-e6f9-422d-bb06-33f7dbee5fad" (UID: "c6d5c271-e6f9-422d-bb06-33f7dbee5fad"). InnerVolumeSpecName "kube-api-access-zrmqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:59:06.762601 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:06.762574    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrmqp\" (UniqueName: \"kubernetes.io/projected/c6d5c271-e6f9-422d-bb06-33f7dbee5fad-kube-api-access-zrmqp\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:59:07.321437 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.321404    2570 generic.go:356] "Generic (PLEG): container finished" podID="c6d5c271-e6f9-422d-bb06-33f7dbee5fad" containerID="b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569" exitCode=0
Jul 10 13:59:07.321437 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.321439    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fsrsn"
Jul 10 13:59:07.321908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.321487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fsrsn" event={"ID":"c6d5c271-e6f9-422d-bb06-33f7dbee5fad","Type":"ContainerDied","Data":"b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569"}
Jul 10 13:59:07.321908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.321537    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fsrsn" event={"ID":"c6d5c271-e6f9-422d-bb06-33f7dbee5fad","Type":"ContainerDied","Data":"ba490c8533c6d13262041b83564f7f0d46a979a1b0eb8c2a19437dd39dcd0afb"}
Jul 10 13:59:07.321908 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.321550    2570 scope.go:117] "RemoveContainer" containerID="b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569"
Jul 10 13:59:07.330535 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.330518    2570 scope.go:117] "RemoveContainer" containerID="b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569"
Jul 10 13:59:07.330805 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:59:07.330788    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569\": container with ID starting with b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569 not found: ID does not exist" containerID="b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569"
Jul 10 13:59:07.330853 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.330813    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569"} err="failed to get container status \"b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569\": rpc error: code = NotFound desc = could not find container \"b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569\": container with ID starting with b8f0e51d3057faad4510692b801fe2facfd17af35005af96d14d40217361f569 not found: ID does not exist"
Jul 10 13:59:07.344692 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.344669    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fsrsn"]
Jul 10 13:59:07.348605 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.348586    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fsrsn"]
Jul 10 13:59:07.565794 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:07.565739    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6d5c271-e6f9-422d-bb06-33f7dbee5fad" path="/var/lib/kubelet/pods/c6d5c271-e6f9-422d-bb06-33f7dbee5fad/volumes"
Jul 10 13:59:13.391307 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:13.391277    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j68hs"]
Jul 10 13:59:13.391669 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:13.391460    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs" podUID="a70171ee-53de-4682-a9ce-492c73f449de" containerName="limitador" containerID="cri-o://98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828" gracePeriod=30
Jul 10 13:59:13.392080 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:13.392037    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:59:13.939402 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:13.939378    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:59:14.024235 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.024170    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctl9t\" (UniqueName: \"kubernetes.io/projected/a70171ee-53de-4682-a9ce-492c73f449de-kube-api-access-ctl9t\") pod \"a70171ee-53de-4682-a9ce-492c73f449de\" (UID: \"a70171ee-53de-4682-a9ce-492c73f449de\") "
Jul 10 13:59:14.024348 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.024257    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a70171ee-53de-4682-a9ce-492c73f449de-config-file\") pod \"a70171ee-53de-4682-a9ce-492c73f449de\" (UID: \"a70171ee-53de-4682-a9ce-492c73f449de\") "
Jul 10 13:59:14.024579 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.024558    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70171ee-53de-4682-a9ce-492c73f449de-config-file" (OuterVolumeSpecName: "config-file") pod "a70171ee-53de-4682-a9ce-492c73f449de" (UID: "a70171ee-53de-4682-a9ce-492c73f449de"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:59:14.026057 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.026038    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70171ee-53de-4682-a9ce-492c73f449de-kube-api-access-ctl9t" (OuterVolumeSpecName: "kube-api-access-ctl9t") pod "a70171ee-53de-4682-a9ce-492c73f449de" (UID: "a70171ee-53de-4682-a9ce-492c73f449de"). InnerVolumeSpecName "kube-api-access-ctl9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:59:14.125157 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.125129    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctl9t\" (UniqueName: \"kubernetes.io/projected/a70171ee-53de-4682-a9ce-492c73f449de-kube-api-access-ctl9t\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:59:14.125157 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.125154    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a70171ee-53de-4682-a9ce-492c73f449de-config-file\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:59:14.361937 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.361867    2570 generic.go:356] "Generic (PLEG): container finished" podID="a70171ee-53de-4682-a9ce-492c73f449de" containerID="98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828" exitCode=0
Jul 10 13:59:14.361937 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.361907    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs"
Jul 10 13:59:14.362080 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.361949    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs" event={"ID":"a70171ee-53de-4682-a9ce-492c73f449de","Type":"ContainerDied","Data":"98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828"}
Jul 10 13:59:14.362080 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.361999    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j68hs" event={"ID":"a70171ee-53de-4682-a9ce-492c73f449de","Type":"ContainerDied","Data":"3195978f08086ddcc630bacfeb1eba8d5778b4d743d0e77c1cc86fb91874025e"}
Jul 10 13:59:14.362080 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.362028    2570 scope.go:117] "RemoveContainer" containerID="98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828"
Jul 10 13:59:14.371587 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.371572    2570 scope.go:117] "RemoveContainer" containerID="98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828"
Jul 10 13:59:14.371861 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:59:14.371841    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828\": container with ID starting with 98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828 not found: ID does not exist" containerID="98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828"
Jul 10 13:59:14.371946 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.371879    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828"} err="failed to get container status \"98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828\": rpc error: code = NotFound desc = could not find container \"98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828\": container with ID starting with 98f0a40a8449d3468555ed8417b53c129b8ad2abd625173e8a27d07751856828 not found: ID does not exist"
Jul 10 13:59:14.385498 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.385475    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j68hs"]
Jul 10 13:59:14.392096 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:14.392073    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j68hs"]
Jul 10 13:59:15.565023 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:15.564992    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a70171ee-53de-4682-a9ce-492c73f449de" path="/var/lib/kubelet/pods/a70171ee-53de-4682-a9ce-492c73f449de/volumes"
Jul 10 13:59:17.271502 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.271471    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"]
Jul 10 13:59:17.271881 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.271867    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70171ee-53de-4682-a9ce-492c73f449de" containerName="limitador"
Jul 10 13:59:17.271881 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.271882    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70171ee-53de-4682-a9ce-492c73f449de" containerName="limitador"
Jul 10 13:59:17.271965 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.271900    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d5c271-e6f9-422d-bb06-33f7dbee5fad" containerName="authorino"
Jul 10 13:59:17.271965 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.271905    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d5c271-e6f9-422d-bb06-33f7dbee5fad" containerName="authorino"
Jul 10 13:59:17.272024 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.271971    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70171ee-53de-4682-a9ce-492c73f449de" containerName="limitador"
Jul 10 13:59:17.272024 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.271983    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6d5c271-e6f9-422d-bb06-33f7dbee5fad" containerName="authorino"
Jul 10 13:59:17.274952 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.274936    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:17.277430 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.277410    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-blknx\""
Jul 10 13:59:17.277928 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.277912    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 13:59:17.278160 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.278139    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 10 13:59:17.278258 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.278238    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 13:59:17.284128 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.284106    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"]
Jul 10 13:59:17.351698 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.351665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf2cq\" (UniqueName: \"kubernetes.io/projected/6990b1b9-1a4a-4458-a499-ba8db6636c3c-kube-api-access-kf2cq\") pod \"postgres-69fb4594cf-j9nzc\" (UID: \"6990b1b9-1a4a-4458-a499-ba8db6636c3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:17.351860 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.351708    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6990b1b9-1a4a-4458-a499-ba8db6636c3c-data\") pod \"postgres-69fb4594cf-j9nzc\" (UID: \"6990b1b9-1a4a-4458-a499-ba8db6636c3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:17.452894 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.452855    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2cq\" (UniqueName: \"kubernetes.io/projected/6990b1b9-1a4a-4458-a499-ba8db6636c3c-kube-api-access-kf2cq\") pod \"postgres-69fb4594cf-j9nzc\" (UID: \"6990b1b9-1a4a-4458-a499-ba8db6636c3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:17.453089 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.452903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6990b1b9-1a4a-4458-a499-ba8db6636c3c-data\") pod \"postgres-69fb4594cf-j9nzc\" (UID: \"6990b1b9-1a4a-4458-a499-ba8db6636c3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:17.453283 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.453262    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6990b1b9-1a4a-4458-a499-ba8db6636c3c-data\") pod \"postgres-69fb4594cf-j9nzc\" (UID: \"6990b1b9-1a4a-4458-a499-ba8db6636c3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:17.462076 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.462054    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf2cq\" (UniqueName: \"kubernetes.io/projected/6990b1b9-1a4a-4458-a499-ba8db6636c3c-kube-api-access-kf2cq\") pod \"postgres-69fb4594cf-j9nzc\" (UID: \"6990b1b9-1a4a-4458-a499-ba8db6636c3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:17.586254 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.586191    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:17.716469 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:17.716445    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"]
Jul 10 13:59:17.718461 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:59:17.718433    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6990b1b9_1a4a_4458_a499_ba8db6636c3c.slice/crio-5ae71369970606d9471cfe63b72d1ec0dbe74b5d78edcc86460f030ead8c54e6 WatchSource:0}: Error finding container 5ae71369970606d9471cfe63b72d1ec0dbe74b5d78edcc86460f030ead8c54e6: Status 404 returned error can't find the container with id 5ae71369970606d9471cfe63b72d1ec0dbe74b5d78edcc86460f030ead8c54e6
Jul 10 13:59:18.386208 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:18.386165    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc" event={"ID":"6990b1b9-1a4a-4458-a499-ba8db6636c3c","Type":"ContainerStarted","Data":"5ae71369970606d9471cfe63b72d1ec0dbe74b5d78edcc86460f030ead8c54e6"}
Jul 10 13:59:23.421686 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:23.421648    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc" event={"ID":"6990b1b9-1a4a-4458-a499-ba8db6636c3c","Type":"ContainerStarted","Data":"568f1b634974623e9ff93ce8296c23b349eb7d5ff356fd76d4b18cadde4c0571"}
Jul 10 13:59:23.422103 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:23.421781    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:23.446049 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:23.445993    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc" podStartSLOduration=1.753105264 podStartE2EDuration="6.445973871s" totalImagesPullingTime="4.692868607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:59:23.443918979 +0000 UTC m=+572.360963241" watchObservedRunningTime="2026-07-10 13:59:23.445973871 +0000 UTC m=+572.363018138"
Jul 10 13:59:29.456794 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:29.456762    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-j9nzc"
Jul 10 13:59:30.076595 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.076560    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x4drf"]
Jul 10 13:59:30.082964 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.082941    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x4drf"
Jul 10 13:59:30.093816 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.093793    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x4drf"]
Jul 10 13:59:30.263861 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.263788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7hb\" (UniqueName: \"kubernetes.io/projected/0a4a6ae9-bd19-4562-8d6e-9632a8bf858d-kube-api-access-jj7hb\") pod \"authorino-5d4b67c446-x4drf\" (UID: \"0a4a6ae9-bd19-4562-8d6e-9632a8bf858d\") " pod="kuadrant-system/authorino-5d4b67c446-x4drf"
Jul 10 13:59:30.315120 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.315092    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x4drf"]
Jul 10 13:59:30.315313 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:59:30.315294    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jj7hb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-x4drf" podUID="0a4a6ae9-bd19-4562-8d6e-9632a8bf858d"
Jul 10 13:59:30.347201 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.347173    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59dd77b67d-h98zl"]
Jul 10 13:59:30.350932 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.350913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dd77b67d-h98zl"
Jul 10 13:59:30.364629 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.364607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7hb\" (UniqueName: \"kubernetes.io/projected/0a4a6ae9-bd19-4562-8d6e-9632a8bf858d-kube-api-access-jj7hb\") pod \"authorino-5d4b67c446-x4drf\" (UID: \"0a4a6ae9-bd19-4562-8d6e-9632a8bf858d\") " pod="kuadrant-system/authorino-5d4b67c446-x4drf"
Jul 10 13:59:30.365919 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.365898    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59dd77b67d-h98zl"]
Jul 10 13:59:30.377446 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.377423    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7hb\" (UniqueName: \"kubernetes.io/projected/0a4a6ae9-bd19-4562-8d6e-9632a8bf858d-kube-api-access-jj7hb\") pod \"authorino-5d4b67c446-x4drf\" (UID: \"0a4a6ae9-bd19-4562-8d6e-9632a8bf858d\") " pod="kuadrant-system/authorino-5d4b67c446-x4drf"
Jul 10 13:59:30.457602 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.457579    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x4drf"
Jul 10 13:59:30.464893 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.464875    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x4drf"
Jul 10 13:59:30.465192 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.465179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbq8\" (UniqueName: \"kubernetes.io/projected/00115a11-fd02-4e58-b88a-712095f4d852-kube-api-access-lhbq8\") pod \"authorino-59dd77b67d-h98zl\" (UID: \"00115a11-fd02-4e58-b88a-712095f4d852\") " pod="kuadrant-system/authorino-59dd77b67d-h98zl"
Jul 10 13:59:30.566154 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.566100    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj7hb\" (UniqueName: \"kubernetes.io/projected/0a4a6ae9-bd19-4562-8d6e-9632a8bf858d-kube-api-access-jj7hb\") pod \"0a4a6ae9-bd19-4562-8d6e-9632a8bf858d\" (UID: \"0a4a6ae9-bd19-4562-8d6e-9632a8bf858d\") "
Jul 10 13:59:30.566250 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.566177    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbq8\" (UniqueName: \"kubernetes.io/projected/00115a11-fd02-4e58-b88a-712095f4d852-kube-api-access-lhbq8\") pod \"authorino-59dd77b67d-h98zl\" (UID: \"00115a11-fd02-4e58-b88a-712095f4d852\") " pod="kuadrant-system/authorino-59dd77b67d-h98zl"
Jul 10 13:59:30.568214 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.568190    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a4a6ae9-bd19-4562-8d6e-9632a8bf858d-kube-api-access-jj7hb" (OuterVolumeSpecName: "kube-api-access-jj7hb") pod "0a4a6ae9-bd19-4562-8d6e-9632a8bf858d" (UID: "0a4a6ae9-bd19-4562-8d6e-9632a8bf858d"). InnerVolumeSpecName "kube-api-access-jj7hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:59:30.582463 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.582441    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbq8\" (UniqueName: \"kubernetes.io/projected/00115a11-fd02-4e58-b88a-712095f4d852-kube-api-access-lhbq8\") pod \"authorino-59dd77b67d-h98zl\" (UID: \"00115a11-fd02-4e58-b88a-712095f4d852\") " pod="kuadrant-system/authorino-59dd77b67d-h98zl"
Jul 10 13:59:30.620591 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.620569    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dd77b67d-h98zl"]
Jul 10 13:59:30.620810 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.620795    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dd77b67d-h98zl"
Jul 10 13:59:30.667576 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.667538    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj7hb\" (UniqueName: \"kubernetes.io/projected/0a4a6ae9-bd19-4562-8d6e-9632a8bf858d-kube-api-access-jj7hb\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:59:30.765486 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:30.765460    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dd77b67d-h98zl"]
Jul 10 13:59:30.767322 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:59:30.767292    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00115a11_fd02_4e58_b88a_712095f4d852.slice/crio-d81bb68fc34a6154ac754e685dce758ea2af2c020e99c3234ad292b4f28de334 WatchSource:0}: Error finding container d81bb68fc34a6154ac754e685dce758ea2af2c020e99c3234ad292b4f28de334: Status 404 returned error can't find the container with id d81bb68fc34a6154ac754e685dce758ea2af2c020e99c3234ad292b4f28de334
Jul 10 13:59:31.464793 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.464734    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dd77b67d-h98zl" event={"ID":"00115a11-fd02-4e58-b88a-712095f4d852","Type":"ContainerStarted","Data":"8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424"}
Jul 10 13:59:31.465168 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.464786    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59dd77b67d-h98zl" podUID="00115a11-fd02-4e58-b88a-712095f4d852" containerName="authorino" containerID="cri-o://8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424" gracePeriod=30
Jul 10 13:59:31.465168 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.464809    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dd77b67d-h98zl" event={"ID":"00115a11-fd02-4e58-b88a-712095f4d852","Type":"ContainerStarted","Data":"d81bb68fc34a6154ac754e685dce758ea2af2c020e99c3234ad292b4f28de334"}
Jul 10 13:59:31.465168 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.464795    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x4drf"
Jul 10 13:59:31.494077 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.494037    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59dd77b67d-h98zl" podStartSLOduration=0.914793586 podStartE2EDuration="1.494022702s" totalImagesPullingTime="579.229116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:59:31.487483002 +0000 UTC m=+580.404527265" watchObservedRunningTime="2026-07-10 13:59:31.494022702 +0000 UTC m=+580.411066964"
Jul 10 13:59:31.532801 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.532770    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x4drf"]
Jul 10 13:59:31.534784 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.534737    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x4drf"]
Jul 10 13:59:31.565538 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.565511    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a4a6ae9-bd19-4562-8d6e-9632a8bf858d" path="/var/lib/kubelet/pods/0a4a6ae9-bd19-4562-8d6e-9632a8bf858d/volumes"
Jul 10 13:59:31.769403 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.769380    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dd77b67d-h98zl"
Jul 10 13:59:31.878040 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.877976    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhbq8\" (UniqueName: \"kubernetes.io/projected/00115a11-fd02-4e58-b88a-712095f4d852-kube-api-access-lhbq8\") pod \"00115a11-fd02-4e58-b88a-712095f4d852\" (UID: \"00115a11-fd02-4e58-b88a-712095f4d852\") "
Jul 10 13:59:31.879902 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.879873    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00115a11-fd02-4e58-b88a-712095f4d852-kube-api-access-lhbq8" (OuterVolumeSpecName: "kube-api-access-lhbq8") pod "00115a11-fd02-4e58-b88a-712095f4d852" (UID: "00115a11-fd02-4e58-b88a-712095f4d852"). InnerVolumeSpecName "kube-api-access-lhbq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:59:31.978433 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:31.978409    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhbq8\" (UniqueName: \"kubernetes.io/projected/00115a11-fd02-4e58-b88a-712095f4d852-kube-api-access-lhbq8\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:59:32.471245 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.471208    2570 generic.go:356] "Generic (PLEG): container finished" podID="00115a11-fd02-4e58-b88a-712095f4d852" containerID="8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424" exitCode=0
Jul 10 13:59:32.471655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.471255    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dd77b67d-h98zl"
Jul 10 13:59:32.471655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.471255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dd77b67d-h98zl" event={"ID":"00115a11-fd02-4e58-b88a-712095f4d852","Type":"ContainerDied","Data":"8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424"}
Jul 10 13:59:32.471655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.471304    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dd77b67d-h98zl" event={"ID":"00115a11-fd02-4e58-b88a-712095f4d852","Type":"ContainerDied","Data":"d81bb68fc34a6154ac754e685dce758ea2af2c020e99c3234ad292b4f28de334"}
Jul 10 13:59:32.471655 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.471327    2570 scope.go:117] "RemoveContainer" containerID="8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424"
Jul 10 13:59:32.480524 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.480506    2570 scope.go:117] "RemoveContainer" containerID="8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424"
Jul 10 13:59:32.480820 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:59:32.480800    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424\": container with ID starting with 8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424 not found: ID does not exist" containerID="8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424"
Jul 10 13:59:32.480871 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.480830    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424"} err="failed to get container status \"8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424\": rpc error: code = NotFound desc = could not find container \"8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424\": container with ID starting with 8e7a099a8355d48a222d22ab467acbe712f4ea1667230a0713dfb95f4bd6f424 not found: ID does not exist"
Jul 10 13:59:32.496913 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.496885    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dd77b67d-h98zl"]
Jul 10 13:59:32.504040 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:32.504022    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59dd77b67d-h98zl"]
Jul 10 13:59:33.565456 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:33.565421    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00115a11-fd02-4e58-b88a-712095f4d852" path="/var/lib/kubelet/pods/00115a11-fd02-4e58-b88a-712095f4d852/volumes"
Jul 10 13:59:34.537184 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:34.537151    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qrmgj"]
Jul 10 13:59:34.537353 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:34.537326    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-qrmgj" podUID="0ea0a906-b407-49c7-adea-c34077001908" containerName="authorino" containerID="cri-o://cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82" gracePeriod=30
Jul 10 13:59:35.358778 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.358735    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qrmgj"
Jul 10 13:59:35.489297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.489221    2570 generic.go:356] "Generic (PLEG): container finished" podID="0ea0a906-b407-49c7-adea-c34077001908" containerID="cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82" exitCode=0
Jul 10 13:59:35.489297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.489259    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qrmgj"
Jul 10 13:59:35.489297 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.489285    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qrmgj" event={"ID":"0ea0a906-b407-49c7-adea-c34077001908","Type":"ContainerDied","Data":"cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82"}
Jul 10 13:59:35.489508 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.489316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qrmgj" event={"ID":"0ea0a906-b407-49c7-adea-c34077001908","Type":"ContainerDied","Data":"821d4c40b093af50fbfd94529344684e1211bf4db60b7d22f1c3e22f1b97725d"}
Jul 10 13:59:35.489508 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.489335    2570 scope.go:117] "RemoveContainer" containerID="cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82"
Jul 10 13:59:35.498136 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.498116    2570 scope.go:117] "RemoveContainer" containerID="cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82"
Jul 10 13:59:35.498376 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:59:35.498357    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82\": container with ID starting with cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82 not found: ID does not exist" containerID="cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82"
Jul 10 13:59:35.498422 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.498385    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82"} err="failed to get container status \"cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82\": rpc error: code = NotFound desc = could not find container \"cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82\": container with ID starting with cb9f1824b2b62320c6cb5c7b767a93be556617e231b312853c8561b1c58ebe82 not found: ID does not exist"
Jul 10 13:59:35.508901 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.508878    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkpdd\" (UniqueName: \"kubernetes.io/projected/0ea0a906-b407-49c7-adea-c34077001908-kube-api-access-zkpdd\") pod \"0ea0a906-b407-49c7-adea-c34077001908\" (UID: \"0ea0a906-b407-49c7-adea-c34077001908\") "
Jul 10 13:59:35.510673 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.510652    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea0a906-b407-49c7-adea-c34077001908-kube-api-access-zkpdd" (OuterVolumeSpecName: "kube-api-access-zkpdd") pod "0ea0a906-b407-49c7-adea-c34077001908" (UID: "0ea0a906-b407-49c7-adea-c34077001908"). InnerVolumeSpecName "kube-api-access-zkpdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:59:35.609678 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.609650    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkpdd\" (UniqueName: \"kubernetes.io/projected/0ea0a906-b407-49c7-adea-c34077001908-kube-api-access-zkpdd\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:59:35.821565 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.821498    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qrmgj"]
Jul 10 13:59:35.830299 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:35.830266    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qrmgj"]
Jul 10 13:59:37.564943 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:37.564914    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea0a906-b407-49c7-adea-c34077001908" path="/var/lib/kubelet/pods/0ea0a906-b407-49c7-adea-c34077001908/volumes"
Jul 10 13:59:39.408443 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.408414    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5ff69f4f6c-4wltw"]
Jul 10 13:59:39.408820 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.408805    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea0a906-b407-49c7-adea-c34077001908" containerName="authorino"
Jul 10 13:59:39.408820 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.408820    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea0a906-b407-49c7-adea-c34077001908" containerName="authorino"
Jul 10 13:59:39.408922 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.408834    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00115a11-fd02-4e58-b88a-712095f4d852" containerName="authorino"
Jul 10 13:59:39.408922 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.408840    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="00115a11-fd02-4e58-b88a-712095f4d852" containerName="authorino"
Jul 10 13:59:39.408922 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.408895    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="00115a11-fd02-4e58-b88a-712095f4d852" containerName="authorino"
Jul 10 13:59:39.408922 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.408906    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea0a906-b407-49c7-adea-c34077001908" containerName="authorino"
Jul 10 13:59:39.411381 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.411364    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:39.414270 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.414247    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9r797\""
Jul 10 13:59:39.414680 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.414656    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 13:59:39.414986 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.414972    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 13:59:39.424676 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.424653    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ff69f4f6c-4wltw"]
Jul 10 13:59:39.537582 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.537550    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62b4p\" (UniqueName: \"kubernetes.io/projected/917838e9-9781-41b7-a5ec-921078a0b99f-kube-api-access-62b4p\") pod \"maas-controller-5ff69f4f6c-4wltw\" (UID: \"917838e9-9781-41b7-a5ec-921078a0b99f\") " pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:39.537769 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.537617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/917838e9-9781-41b7-a5ec-921078a0b99f-webhook-cert\") pod \"maas-controller-5ff69f4f6c-4wltw\" (UID: \"917838e9-9781-41b7-a5ec-921078a0b99f\") " pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:39.586130 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.586102    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55bb89bdd-dcmfl"]
Jul 10 13:59:39.588441 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.588422    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:39.600172 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.600151    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bb89bdd-dcmfl"]
Jul 10 13:59:39.638223 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.638200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/917838e9-9781-41b7-a5ec-921078a0b99f-webhook-cert\") pod \"maas-controller-5ff69f4f6c-4wltw\" (UID: \"917838e9-9781-41b7-a5ec-921078a0b99f\") " pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:39.638341 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.638254    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62b4p\" (UniqueName: \"kubernetes.io/projected/917838e9-9781-41b7-a5ec-921078a0b99f-kube-api-access-62b4p\") pod \"maas-controller-5ff69f4f6c-4wltw\" (UID: \"917838e9-9781-41b7-a5ec-921078a0b99f\") " pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:39.640587 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.640556    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/917838e9-9781-41b7-a5ec-921078a0b99f-webhook-cert\") pod \"maas-controller-5ff69f4f6c-4wltw\" (UID: \"917838e9-9781-41b7-a5ec-921078a0b99f\") " pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:39.648879 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.648852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62b4p\" (UniqueName: \"kubernetes.io/projected/917838e9-9781-41b7-a5ec-921078a0b99f-kube-api-access-62b4p\") pod \"maas-controller-5ff69f4f6c-4wltw\" (UID: \"917838e9-9781-41b7-a5ec-921078a0b99f\") " pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:39.721865 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.721844    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:39.739145 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.739116    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-webhook-cert\") pod \"maas-controller-55bb89bdd-dcmfl\" (UID: \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\") " pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:39.739287 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.739259    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs2z7\" (UniqueName: \"kubernetes.io/projected/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-kube-api-access-bs2z7\") pod \"maas-controller-55bb89bdd-dcmfl\" (UID: \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\") " pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:39.839967 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.839929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-webhook-cert\") pod \"maas-controller-55bb89bdd-dcmfl\" (UID: \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\") " pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:39.840119 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.840062    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs2z7\" (UniqueName: \"kubernetes.io/projected/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-kube-api-access-bs2z7\") pod \"maas-controller-55bb89bdd-dcmfl\" (UID: \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\") " pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:39.842313 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.842287    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-webhook-cert\") pod \"maas-controller-55bb89bdd-dcmfl\" (UID: \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\") " pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:39.852255 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.852233    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs2z7\" (UniqueName: \"kubernetes.io/projected/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-kube-api-access-bs2z7\") pod \"maas-controller-55bb89bdd-dcmfl\" (UID: \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\") " pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:39.863907 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.862823    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ff69f4f6c-4wltw"]
Jul 10 13:59:39.898998 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:39.898970    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:40.045013 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:40.044990    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bb89bdd-dcmfl"]
Jul 10 13:59:40.049114 ip-10-0-137-35 kubenswrapper[2570]: W0710 13:59:40.046176    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30df5ab_07b0_4c1a_a5b1_b4ce29f0ef18.slice/crio-2fa529c8a5a61f8ff0647a6c85645732dc8987083626ce87e8a5c74bfb0eff06 WatchSource:0}: Error finding container 2fa529c8a5a61f8ff0647a6c85645732dc8987083626ce87e8a5c74bfb0eff06: Status 404 returned error can't find the container with id 2fa529c8a5a61f8ff0647a6c85645732dc8987083626ce87e8a5c74bfb0eff06
Jul 10 13:59:40.522070 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:40.522021    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bb89bdd-dcmfl" event={"ID":"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18","Type":"ContainerStarted","Data":"2fa529c8a5a61f8ff0647a6c85645732dc8987083626ce87e8a5c74bfb0eff06"}
Jul 10 13:59:40.524025 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:40.523988    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw" event={"ID":"917838e9-9781-41b7-a5ec-921078a0b99f","Type":"ContainerStarted","Data":"cb1ede47e81a37b2a7ed7b165d03132beab709c84479e940ea88e96abd0d357c"}
Jul 10 13:59:42.538783 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:42.538728    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bb89bdd-dcmfl" event={"ID":"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18","Type":"ContainerStarted","Data":"88c97c5c2226794ea7da80150f5310ae93c0f3e6a73d2403f472299c0191617a"}
Jul 10 13:59:42.539243 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:42.538826    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:42.540422 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:42.540400    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw" event={"ID":"917838e9-9781-41b7-a5ec-921078a0b99f","Type":"ContainerStarted","Data":"2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c"}
Jul 10 13:59:42.540546 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:42.540532    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:42.564022 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:42.563981    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55bb89bdd-dcmfl" podStartSLOduration=1.663433073 podStartE2EDuration="3.563968226s" totalImagesPullingTime="1.900535153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:59:42.560715563 +0000 UTC m=+591.477759839" watchObservedRunningTime="2026-07-10 13:59:42.563968226 +0000 UTC m=+591.481012503"
Jul 10 13:59:42.581681 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:42.581639    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw" podStartSLOduration=1.5047754370000002 podStartE2EDuration="3.5816235s" totalImagesPullingTime="2.076848063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:59:42.581586128 +0000 UTC m=+591.498630396" watchObservedRunningTime="2026-07-10 13:59:42.5816235 +0000 UTC m=+591.498667764"
Jul 10 13:59:53.550365 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.550319    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 13:59:53.552762 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.550500    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:53.638375 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.638343    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5ff69f4f6c-4wltw"]
Jul 10 13:59:53.638565 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.638514    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw" podUID="917838e9-9781-41b7-a5ec-921078a0b99f" containerName="manager" containerID="cri-o://2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c" gracePeriod=30
Jul 10 13:59:53.639737 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.639713    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 13:59:53.641411 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.641388    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 13:59:53.886819 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.886796    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:53.946068 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.946043    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62b4p\" (UniqueName: \"kubernetes.io/projected/917838e9-9781-41b7-a5ec-921078a0b99f-kube-api-access-62b4p\") pod \"917838e9-9781-41b7-a5ec-921078a0b99f\" (UID: \"917838e9-9781-41b7-a5ec-921078a0b99f\") "
Jul 10 13:59:53.946198 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.946099    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/917838e9-9781-41b7-a5ec-921078a0b99f-webhook-cert\") pod \"917838e9-9781-41b7-a5ec-921078a0b99f\" (UID: \"917838e9-9781-41b7-a5ec-921078a0b99f\") "
Jul 10 13:59:53.948312 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.948279    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/917838e9-9781-41b7-a5ec-921078a0b99f-kube-api-access-62b4p" (OuterVolumeSpecName: "kube-api-access-62b4p") pod "917838e9-9781-41b7-a5ec-921078a0b99f" (UID: "917838e9-9781-41b7-a5ec-921078a0b99f"). InnerVolumeSpecName "kube-api-access-62b4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:59:53.948417 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:53.948284    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/917838e9-9781-41b7-a5ec-921078a0b99f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "917838e9-9781-41b7-a5ec-921078a0b99f" (UID: "917838e9-9781-41b7-a5ec-921078a0b99f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:59:54.047192 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.047164    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/917838e9-9781-41b7-a5ec-921078a0b99f-webhook-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:59:54.047192 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.047189    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62b4p\" (UniqueName: \"kubernetes.io/projected/917838e9-9781-41b7-a5ec-921078a0b99f-kube-api-access-62b4p\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 13:59:54.604240 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.604205    2570 generic.go:356] "Generic (PLEG): container finished" podID="917838e9-9781-41b7-a5ec-921078a0b99f" containerID="2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c" exitCode=0
Jul 10 13:59:54.604631 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.604245    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw"
Jul 10 13:59:54.604631 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.604289    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw" event={"ID":"917838e9-9781-41b7-a5ec-921078a0b99f","Type":"ContainerDied","Data":"2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c"}
Jul 10 13:59:54.604631 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.604336    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ff69f4f6c-4wltw" event={"ID":"917838e9-9781-41b7-a5ec-921078a0b99f","Type":"ContainerDied","Data":"cb1ede47e81a37b2a7ed7b165d03132beab709c84479e940ea88e96abd0d357c"}
Jul 10 13:59:54.604631 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.604369    2570 scope.go:117] "RemoveContainer" containerID="2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c"
Jul 10 13:59:54.613796 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.613777    2570 scope.go:117] "RemoveContainer" containerID="2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c"
Jul 10 13:59:54.614038 ip-10-0-137-35 kubenswrapper[2570]: E0710 13:59:54.614020    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c\": container with ID starting with 2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c not found: ID does not exist" containerID="2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c"
Jul 10 13:59:54.614096 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.614052    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c"} err="failed to get container status \"2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c\": rpc error: code = NotFound desc = could not find container \"2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c\": container with ID starting with 2c0b2c5038fed572a78fc23f85fa5934f1056580247f5a3eecffe8b6dec23e4c not found: ID does not exist"
Jul 10 13:59:54.629727 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.629700    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5ff69f4f6c-4wltw"]
Jul 10 13:59:54.632490 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:54.632471    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5ff69f4f6c-4wltw"]
Jul 10 13:59:55.567757 ip-10-0-137-35 kubenswrapper[2570]: I0710 13:59:55.567711    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="917838e9-9781-41b7-a5ec-921078a0b99f" path="/var/lib/kubelet/pods/917838e9-9781-41b7-a5ec-921078a0b99f/volumes"
Jul 10 14:00:16.122829 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.122733    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-796c584757-9tvg7"]
Jul 10 14:00:16.123373 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.123329    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="917838e9-9781-41b7-a5ec-921078a0b99f" containerName="manager"
Jul 10 14:00:16.123373 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.123349    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="917838e9-9781-41b7-a5ec-921078a0b99f" containerName="manager"
Jul 10 14:00:16.123491 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.123440    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="917838e9-9781-41b7-a5ec-921078a0b99f" containerName="manager"
Jul 10 14:00:16.125533 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.125510    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.128362 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.128342    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 14:00:16.131380 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.131364    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:00:16.144782 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.144739    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-796c584757-9tvg7"]
Jul 10 14:00:16.226072 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.226044    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/719414ca-0c64-4a33-bb51-6319c99d50ca-maas-api-tls\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.226185 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.226097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/719414ca-0c64-4a33-bb51-6319c99d50ca-openshift-service-ca\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.226227 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.226188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnkwm\" (UniqueName: \"kubernetes.io/projected/719414ca-0c64-4a33-bb51-6319c99d50ca-kube-api-access-rnkwm\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.327199 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.327170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/719414ca-0c64-4a33-bb51-6319c99d50ca-openshift-service-ca\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.327311 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.327228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnkwm\" (UniqueName: \"kubernetes.io/projected/719414ca-0c64-4a33-bb51-6319c99d50ca-kube-api-access-rnkwm\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.327311 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.327246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/719414ca-0c64-4a33-bb51-6319c99d50ca-maas-api-tls\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.327866 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.327841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/719414ca-0c64-4a33-bb51-6319c99d50ca-openshift-service-ca\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.329504 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.329478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/719414ca-0c64-4a33-bb51-6319c99d50ca-maas-api-tls\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.337705 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.337685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnkwm\" (UniqueName: \"kubernetes.io/projected/719414ca-0c64-4a33-bb51-6319c99d50ca-kube-api-access-rnkwm\") pod \"maas-api-796c584757-9tvg7\" (UID: \"719414ca-0c64-4a33-bb51-6319c99d50ca\") " pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.435784 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.435691    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:16.579981 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.579954    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-796c584757-9tvg7"]
Jul 10 14:00:16.581656 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:00:16.581629    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719414ca_0c64_4a33_bb51_6319c99d50ca.slice/crio-516dc291dfa249f816e991afc42f6f095fe6f62a4107cbbb576fabcd26d32e1d WatchSource:0}: Error finding container 516dc291dfa249f816e991afc42f6f095fe6f62a4107cbbb576fabcd26d32e1d: Status 404 returned error can't find the container with id 516dc291dfa249f816e991afc42f6f095fe6f62a4107cbbb576fabcd26d32e1d
Jul 10 14:00:16.582972 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.582955    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:00:16.719298 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.719263    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7" event={"ID":"719414ca-0c64-4a33-bb51-6319c99d50ca","Type":"ContainerStarted","Data":"516dc291dfa249f816e991afc42f6f095fe6f62a4107cbbb576fabcd26d32e1d"}
Jul 10 14:00:16.787504 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.787468    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h2h96"]
Jul 10 14:00:16.790715 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.790694    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:16.792976 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.792951    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 14:00:16.793124 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.793110    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gb49j\""
Jul 10 14:00:16.795011 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.794986    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5vgkx"]
Jul 10 14:00:16.797642 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.797620    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:16.801500 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.801479    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h2h96"]
Jul 10 14:00:16.808881 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.808679    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5vgkx"]
Jul 10 14:00:16.931086 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.931041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7rr\" (UniqueName: \"kubernetes.io/projected/312d4b84-85a0-4ae6-b991-897acfefdf2f-kube-api-access-4v7rr\") pod \"payload-processing-58f86c7798-5vgkx\" (UID: \"312d4b84-85a0-4ae6-b991-897acfefdf2f\") " pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:16.931236 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.931116    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312d4b84-85a0-4ae6-b991-897acfefdf2f-plugins-config-volume\") pod \"payload-processing-58f86c7798-5vgkx\" (UID: \"312d4b84-85a0-4ae6-b991-897acfefdf2f\") " pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:16.931236 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.931148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33227a06-da0c-450e-8581-f9bfa6dcc1e8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h2h96\" (UID: \"33227a06-da0c-450e-8581-f9bfa6dcc1e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:16.931236 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:16.931164    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcr5v\" (UniqueName: \"kubernetes.io/projected/33227a06-da0c-450e-8581-f9bfa6dcc1e8-kube-api-access-zcr5v\") pod \"payload-pre-processing-7964457696-h2h96\" (UID: \"33227a06-da0c-450e-8581-f9bfa6dcc1e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:17.032345 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.032253    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312d4b84-85a0-4ae6-b991-897acfefdf2f-plugins-config-volume\") pod \"payload-processing-58f86c7798-5vgkx\" (UID: \"312d4b84-85a0-4ae6-b991-897acfefdf2f\") " pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:17.032345 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.032325    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33227a06-da0c-450e-8581-f9bfa6dcc1e8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h2h96\" (UID: \"33227a06-da0c-450e-8581-f9bfa6dcc1e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:17.032558 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.032365    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcr5v\" (UniqueName: \"kubernetes.io/projected/33227a06-da0c-450e-8581-f9bfa6dcc1e8-kube-api-access-zcr5v\") pod \"payload-pre-processing-7964457696-h2h96\" (UID: \"33227a06-da0c-450e-8581-f9bfa6dcc1e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:17.032558 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.032429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7rr\" (UniqueName: \"kubernetes.io/projected/312d4b84-85a0-4ae6-b991-897acfefdf2f-kube-api-access-4v7rr\") pod \"payload-processing-58f86c7798-5vgkx\" (UID: \"312d4b84-85a0-4ae6-b991-897acfefdf2f\") " pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:17.033130 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.033105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312d4b84-85a0-4ae6-b991-897acfefdf2f-plugins-config-volume\") pod \"payload-processing-58f86c7798-5vgkx\" (UID: \"312d4b84-85a0-4ae6-b991-897acfefdf2f\") " pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:17.033130 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.033117    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33227a06-da0c-450e-8581-f9bfa6dcc1e8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h2h96\" (UID: \"33227a06-da0c-450e-8581-f9bfa6dcc1e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:17.042589 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.042563    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7rr\" (UniqueName: \"kubernetes.io/projected/312d4b84-85a0-4ae6-b991-897acfefdf2f-kube-api-access-4v7rr\") pod \"payload-processing-58f86c7798-5vgkx\" (UID: \"312d4b84-85a0-4ae6-b991-897acfefdf2f\") " pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:17.042801 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.042783    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcr5v\" (UniqueName: \"kubernetes.io/projected/33227a06-da0c-450e-8581-f9bfa6dcc1e8-kube-api-access-zcr5v\") pod \"payload-pre-processing-7964457696-h2h96\" (UID: \"33227a06-da0c-450e-8581-f9bfa6dcc1e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:17.105636 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.105609    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:17.114098 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.114073    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:17.255245 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.255219    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h2h96"]
Jul 10 14:00:17.256697 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:00:17.256664    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33227a06_da0c_450e_8581_f9bfa6dcc1e8.slice/crio-3bdce92fa24d534aa7d3b4deed768319a558f9375ad8fa9a036174cd44d52b1b WatchSource:0}: Error finding container 3bdce92fa24d534aa7d3b4deed768319a558f9375ad8fa9a036174cd44d52b1b: Status 404 returned error can't find the container with id 3bdce92fa24d534aa7d3b4deed768319a558f9375ad8fa9a036174cd44d52b1b
Jul 10 14:00:17.276569 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.276549    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5vgkx"]
Jul 10 14:00:17.278319 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:00:17.278297    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod312d4b84_85a0_4ae6_b991_897acfefdf2f.slice/crio-bdcf74e457e069d46c1ce154b84a1bdebad0080f86c10839b4796dc9d7d2ae1b WatchSource:0}: Error finding container bdcf74e457e069d46c1ce154b84a1bdebad0080f86c10839b4796dc9d7d2ae1b: Status 404 returned error can't find the container with id bdcf74e457e069d46c1ce154b84a1bdebad0080f86c10839b4796dc9d7d2ae1b
Jul 10 14:00:17.726787 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.726740    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-h2h96" event={"ID":"33227a06-da0c-450e-8581-f9bfa6dcc1e8","Type":"ContainerStarted","Data":"3bdce92fa24d534aa7d3b4deed768319a558f9375ad8fa9a036174cd44d52b1b"}
Jul 10 14:00:17.727881 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:17.727858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-5vgkx" event={"ID":"312d4b84-85a0-4ae6-b991-897acfefdf2f","Type":"ContainerStarted","Data":"bdcf74e457e069d46c1ce154b84a1bdebad0080f86c10839b4796dc9d7d2ae1b"}
Jul 10 14:00:18.738639 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:18.738598    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7" event={"ID":"719414ca-0c64-4a33-bb51-6319c99d50ca","Type":"ContainerStarted","Data":"0e82c8d45b0e02da268994d9346bfd1a8a9c9f7b86a2e12d8cbbfefbc145586e"}
Jul 10 14:00:18.739148 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:18.738789    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:18.765160 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:18.765106    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7" podStartSLOduration=1.100129521 podStartE2EDuration="2.765086303s" totalImagesPullingTime="1.664956782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:00:18.763904128 +0000 UTC m=+627.680948391" watchObservedRunningTime="2026-07-10 14:00:18.765086303 +0000 UTC m=+627.682130569"
Jul 10 14:00:19.745814 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:19.745774    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-5vgkx" event={"ID":"312d4b84-85a0-4ae6-b991-897acfefdf2f","Type":"ContainerStarted","Data":"489a70e0c5dd3f3e826304c5b63042103dd5be04c926a0b13fa9caac0f779286"}
Jul 10 14:00:19.746259 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:19.745844    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:19.747608 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:19.747584    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-h2h96" event={"ID":"33227a06-da0c-450e-8581-f9bfa6dcc1e8","Type":"ContainerStarted","Data":"fea3eb26df823d2fa013600d047320b55d24c0a1a77bc40d5e69497c2d3b2a12"}
Jul 10 14:00:19.747826 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:19.747810    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:19.770539 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:19.770496    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-5vgkx" podStartSLOduration=1.783370833 podStartE2EDuration="3.770482515s" totalImagesPullingTime="1.987111682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:00:19.767684779 +0000 UTC m=+628.684729042" watchObservedRunningTime="2026-07-10 14:00:19.770482515 +0000 UTC m=+628.687526778"
Jul 10 14:00:19.798473 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:19.798418    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-h2h96" podStartSLOduration=1.7874430449999998 podStartE2EDuration="3.79839977s" totalImagesPullingTime="2.010956725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:00:19.795190703 +0000 UTC m=+628.712234965" watchObservedRunningTime="2026-07-10 14:00:19.79839977 +0000 UTC m=+628.715444034"
Jul 10 14:00:24.752935 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:24.752906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-796c584757-9tvg7"
Jul 10 14:00:30.755828 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:30.755794    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-h2h96"
Jul 10 14:00:30.756183 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:30.755878    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-5vgkx"
Jul 10 14:00:47.026367 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.026335    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"]
Jul 10 14:00:47.029955 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.029935    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.035576 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.035556    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 14:00:47.037037 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.036862    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 10 14:00:47.037037 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.036960    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 14:00:47.037037 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.036980    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2k477\""
Jul 10 14:00:47.050216 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.050191    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"]
Jul 10 14:00:47.083795 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.083767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.083900 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.083798    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db781036-d853-4152-8d03-b95b13c87308-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.083900 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.083882    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5mtl\" (UniqueName: \"kubernetes.io/projected/db781036-d853-4152-8d03-b95b13c87308-kube-api-access-x5mtl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.083985 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.083943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.083985 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.083973    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.084063 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.083997    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.184739 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.184700    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5mtl\" (UniqueName: \"kubernetes.io/projected/db781036-d853-4152-8d03-b95b13c87308-kube-api-access-x5mtl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.184935 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.184788    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.184935 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.184810    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.184935 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.184828    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.184935 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.184846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.184935 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.184867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db781036-d853-4152-8d03-b95b13c87308-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.185277 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.185254    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.185369 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.185303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.185369 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.185358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.187066 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.187045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db781036-d853-4152-8d03-b95b13c87308-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.187368 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.187348    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db781036-d853-4152-8d03-b95b13c87308-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.196166 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.196141    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5mtl\" (UniqueName: \"kubernetes.io/projected/db781036-d853-4152-8d03-b95b13c87308-kube-api-access-x5mtl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh\" (UID: \"db781036-d853-4152-8d03-b95b13c87308\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.339668 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.339575    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:00:47.513528 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.513502    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"]
Jul 10 14:00:47.515438 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:00:47.515409    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb781036_d853_4152_8d03_b95b13c87308.slice/crio-9dab9eb5d8ed08964adc272c723335f8fae352a9a491302e62de68e8d0ee34bd WatchSource:0}: Error finding container 9dab9eb5d8ed08964adc272c723335f8fae352a9a491302e62de68e8d0ee34bd: Status 404 returned error can't find the container with id 9dab9eb5d8ed08964adc272c723335f8fae352a9a491302e62de68e8d0ee34bd
Jul 10 14:00:47.906359 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:00:47.906315    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh" event={"ID":"db781036-d853-4152-8d03-b95b13c87308","Type":"ContainerStarted","Data":"9dab9eb5d8ed08964adc272c723335f8fae352a9a491302e62de68e8d0ee34bd"}
Jul 10 14:01:06.719421 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.719386    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"]
Jul 10 14:01:06.723032 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.723011    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.726052 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.726035    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 14:01:06.739776 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.739736    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"]
Jul 10 14:01:06.838677 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.838643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.838879 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.838686    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43f16045-3166-4725-a7a2-55f18dedcdc8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.838879 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.838723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.838879 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.838790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.838879 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.838867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.839131 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.838908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd4r6\" (UniqueName: \"kubernetes.io/projected/43f16045-3166-4725-a7a2-55f18dedcdc8-kube-api-access-qd4r6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.940118 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43f16045-3166-4725-a7a2-55f18dedcdc8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.940330 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940144    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.940330 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.940330 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.940330 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940278    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd4r6\" (UniqueName: \"kubernetes.io/projected/43f16045-3166-4725-a7a2-55f18dedcdc8-kube-api-access-qd4r6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.940560 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.940714 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940691    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.940826 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.941027 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.940971    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.943064 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.943041    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43f16045-3166-4725-a7a2-55f18dedcdc8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.943245 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.943223    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43f16045-3166-4725-a7a2-55f18dedcdc8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:06.950438 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:06.950414    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd4r6\" (UniqueName: \"kubernetes.io/projected/43f16045-3166-4725-a7a2-55f18dedcdc8-kube-api-access-qd4r6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvk78\" (UID: \"43f16045-3166-4725-a7a2-55f18dedcdc8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:07.020904 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:07.020848    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh" event={"ID":"db781036-d853-4152-8d03-b95b13c87308","Type":"ContainerStarted","Data":"a57327732b8cb0a5504076ff12ec6a69680a4321d7ea0c925a14927ffa5417c0"}
Jul 10 14:01:07.033146 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:07.033126    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:07.045537 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:07.045503    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh" podStartSLOduration=1.207111669 podStartE2EDuration="20.045488735s" totalImagesPullingTime="18.838377066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:01:07.044173742 +0000 UTC m=+675.961218005" watchObservedRunningTime="2026-07-10 14:01:07.045488735 +0000 UTC m=+675.962532998"
Jul 10 14:01:07.177080 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:07.177055    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"]
Jul 10 14:01:07.178704 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:01:07.178679    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f16045_3166_4725_a7a2_55f18dedcdc8.slice/crio-75af5e1aaf0ac662ad885de0a6da5b8433ff47d0e3d8bb01d20a6eca2d2c4b38 WatchSource:0}: Error finding container 75af5e1aaf0ac662ad885de0a6da5b8433ff47d0e3d8bb01d20a6eca2d2c4b38: Status 404 returned error can't find the container with id 75af5e1aaf0ac662ad885de0a6da5b8433ff47d0e3d8bb01d20a6eca2d2c4b38
Jul 10 14:01:07.340371 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:07.340300    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:01:07.340371 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:07.340368    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:01:07.352708 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:07.352685    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:01:08.028822 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:08.028787    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78" event={"ID":"43f16045-3166-4725-a7a2-55f18dedcdc8","Type":"ContainerStarted","Data":"43a38e42d488e00cb6efe96d96480eaccbd198239f98cd1ab52678143ea1081e"}
Jul 10 14:01:08.029219 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:08.028850    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78" event={"ID":"43f16045-3166-4725-a7a2-55f18dedcdc8","Type":"ContainerStarted","Data":"75af5e1aaf0ac662ad885de0a6da5b8433ff47d0e3d8bb01d20a6eca2d2c4b38"}
Jul 10 14:01:08.042015 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:08.041990    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh"
Jul 10 14:01:08.053009 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:08.052952    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78" podStartSLOduration=1.843903399 podStartE2EDuration="2.052936327s" totalImagesPullingTime="209.032928ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:01:08.052655013 +0000 UTC m=+676.969699267" watchObservedRunningTime="2026-07-10 14:01:08.052936327 +0000 UTC m=+676.969980590"
Jul 10 14:01:17.033270 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:17.033234    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:17.033686 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:17.033293    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:17.045552 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:17.045530    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:17.090226 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:17.090200    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvk78"
Jul 10 14:01:28.712442 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.712408    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"]
Jul 10 14:01:28.716077 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.716053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.719111 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.719094    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 10 14:01:28.726475 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.726452    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"]
Jul 10 14:01:28.818431 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.818401    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.818568 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.818439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.818568 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.818462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd5gk\" (UniqueName: \"kubernetes.io/projected/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-kube-api-access-pd5gk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.818568 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.818522    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.818568 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.818557    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.818705 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.818581    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.919434 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919397    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.919598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.919598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.919598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.919598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd5gk\" (UniqueName: \"kubernetes.io/projected/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-kube-api-access-pd5gk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.919859 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.919919 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919855    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.919919 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.920019 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.919970    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.921727 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.921680    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.922200 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.922178    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:28.927841 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:28.927820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd5gk\" (UniqueName: \"kubernetes.io/projected/8412d7bf-a41e-46eb-9d30-2f5d86e610c6-kube-api-access-pd5gk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5\" (UID: \"8412d7bf-a41e-46eb-9d30-2f5d86e610c6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:29.029177 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:29.029111    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:29.171515 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:29.171486    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"]
Jul 10 14:01:29.173207 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:01:29.173177    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8412d7bf_a41e_46eb_9d30_2f5d86e610c6.slice/crio-52487d3e55d2fcd6545b93531b697ecda69f686533865532fdb9b20f72b3ce51 WatchSource:0}: Error finding container 52487d3e55d2fcd6545b93531b697ecda69f686533865532fdb9b20f72b3ce51: Status 404 returned error can't find the container with id 52487d3e55d2fcd6545b93531b697ecda69f686533865532fdb9b20f72b3ce51
Jul 10 14:01:30.160688 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:30.160650    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5" event={"ID":"8412d7bf-a41e-46eb-9d30-2f5d86e610c6","Type":"ContainerStarted","Data":"8246c704f746658f3cecb27cee4926a5a679c388c5aaf5ee40770531ce9ea434"}
Jul 10 14:01:30.161061 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:30.160714    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5" event={"ID":"8412d7bf-a41e-46eb-9d30-2f5d86e610c6","Type":"ContainerStarted","Data":"52487d3e55d2fcd6545b93531b697ecda69f686533865532fdb9b20f72b3ce51"}
Jul 10 14:01:30.180226 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:30.180177    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5" podStartSLOduration=1.965032962 podStartE2EDuration="2.180163666s" totalImagesPullingTime="215.130704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:01:30.17870865 +0000 UTC m=+699.095753167" watchObservedRunningTime="2026-07-10 14:01:30.180163666 +0000 UTC m=+699.097207929"
Jul 10 14:01:39.030039 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:39.030005    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:39.030496 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:39.030067    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:39.042740 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:39.042714    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:39.220115 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:39.220089    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5"
Jul 10 14:01:44.101308 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.101272    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"]
Jul 10 14:01:44.105252 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.105233    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.107894 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.107872    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 10 14:01:44.115415 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.115394    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"]
Jul 10 14:01:44.258023 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.257938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.258023 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.257998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.258226 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.258096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.258226 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.258150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.258346 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.258270    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7740b8-2513-46e6-92fd-ce41d491e220-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.258346 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.258307    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k498k\" (UniqueName: \"kubernetes.io/projected/fe7740b8-2513-46e6-92fd-ce41d491e220-kube-api-access-k498k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.359401 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.359329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7740b8-2513-46e6-92fd-ce41d491e220-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.359401 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.359366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k498k\" (UniqueName: \"kubernetes.io/projected/fe7740b8-2513-46e6-92fd-ce41d491e220-kube-api-access-k498k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.359401 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.359394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.359658 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.359493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.359658 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.359571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.359658 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.359640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.359848 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.359791    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.360012 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.359991    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.360057 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.360038    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.361646 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.361627    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe7740b8-2513-46e6-92fd-ce41d491e220-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.362225 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.362207    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7740b8-2513-46e6-92fd-ce41d491e220-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.383567 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.383546    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k498k\" (UniqueName: \"kubernetes.io/projected/fe7740b8-2513-46e6-92fd-ce41d491e220-kube-api-access-k498k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb\" (UID: \"fe7740b8-2513-46e6-92fd-ce41d491e220\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.415480 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.415454    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:44.567314 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:44.567287    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"]
Jul 10 14:01:44.567806 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:01:44.567785    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe7740b8_2513_46e6_92fd_ce41d491e220.slice/crio-e81ff791f42ae47a5da1e7c235004c909fac8ff3f0b9446c2029ae98d614cba6 WatchSource:0}: Error finding container e81ff791f42ae47a5da1e7c235004c909fac8ff3f0b9446c2029ae98d614cba6: Status 404 returned error can't find the container with id e81ff791f42ae47a5da1e7c235004c909fac8ff3f0b9446c2029ae98d614cba6
Jul 10 14:01:45.250644 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:45.250608    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb" event={"ID":"fe7740b8-2513-46e6-92fd-ce41d491e220","Type":"ContainerStarted","Data":"761c583f894e78c0c45febca53a6e1b76dd22851166a9eba7b6a04729b17205c"}
Jul 10 14:01:45.251118 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:45.250659    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb" event={"ID":"fe7740b8-2513-46e6-92fd-ce41d491e220","Type":"ContainerStarted","Data":"e81ff791f42ae47a5da1e7c235004c909fac8ff3f0b9446c2029ae98d614cba6"}
Jul 10 14:01:45.269182 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:45.269137    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb" podStartSLOduration=1.074081633 podStartE2EDuration="1.26912268s" totalImagesPullingTime="195.041047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:01:45.268653861 +0000 UTC m=+714.185698123" watchObservedRunningTime="2026-07-10 14:01:45.26912268 +0000 UTC m=+714.186166942"
Jul 10 14:01:54.416121 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:54.416087    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:54.416589 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:54.416136    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:54.428916 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:54.428894    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:01:55.320545 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:01:55.320515    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb"
Jul 10 14:03:51.735397 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:51.735356    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55bb89bdd-dcmfl"]
Jul 10 14:03:51.735872 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:51.735550    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55bb89bdd-dcmfl" podUID="b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18" containerName="manager" containerID="cri-o://88c97c5c2226794ea7da80150f5310ae93c0f3e6a73d2403f472299c0191617a" gracePeriod=30
Jul 10 14:03:51.966890 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:51.966854    2570 generic.go:356] "Generic (PLEG): container finished" podID="b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18" containerID="88c97c5c2226794ea7da80150f5310ae93c0f3e6a73d2403f472299c0191617a" exitCode=0
Jul 10 14:03:51.967029 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:51.966913    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bb89bdd-dcmfl" event={"ID":"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18","Type":"ContainerDied","Data":"88c97c5c2226794ea7da80150f5310ae93c0f3e6a73d2403f472299c0191617a"}
Jul 10 14:03:51.989630 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:51.989578    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 14:03:52.064811 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.064776    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs2z7\" (UniqueName: \"kubernetes.io/projected/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-kube-api-access-bs2z7\") pod \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\" (UID: \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\") "
Jul 10 14:03:52.064960 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.064849    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-webhook-cert\") pod \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\" (UID: \"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18\") "
Jul 10 14:03:52.066860 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.066834    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18" (UID: "b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:03:52.066860 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.066837    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-kube-api-access-bs2z7" (OuterVolumeSpecName: "kube-api-access-bs2z7") pod "b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18" (UID: "b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18"). InnerVolumeSpecName "kube-api-access-bs2z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:03:52.165920 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.165892    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs2z7\" (UniqueName: \"kubernetes.io/projected/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-kube-api-access-bs2z7\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:03:52.165920 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.165918    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18-webhook-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:03:52.973786 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.973758    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bb89bdd-dcmfl"
Jul 10 14:03:52.973786 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.973774    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bb89bdd-dcmfl" event={"ID":"b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18","Type":"ContainerDied","Data":"2fa529c8a5a61f8ff0647a6c85645732dc8987083626ce87e8a5c74bfb0eff06"}
Jul 10 14:03:52.974228 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:52.973838    2570 scope.go:117] "RemoveContainer" containerID="88c97c5c2226794ea7da80150f5310ae93c0f3e6a73d2403f472299c0191617a"
Jul 10 14:03:53.000783 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.000709    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55bb89bdd-dcmfl"]
Jul 10 14:03:53.003269 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.003250    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55bb89bdd-dcmfl"]
Jul 10 14:03:53.565805 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.565772    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18" path="/var/lib/kubelet/pods/b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18/volumes"
Jul 10 14:03:53.786178 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.786149    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55bb89bdd-hc5k9"]
Jul 10 14:03:53.786661 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.786601    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18" containerName="manager"
Jul 10 14:03:53.786661 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.786628    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18" containerName="manager"
Jul 10 14:03:53.786907 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.786782    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b30df5ab-07b0-4c1a-a5b1-b4ce29f0ef18" containerName="manager"
Jul 10 14:03:53.790931 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.790913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:53.794500 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.794477    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 14:03:53.794500 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.794497    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9r797\""
Jul 10 14:03:53.794670 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.794630    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 14:03:53.797891 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.797869    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bb89bdd-hc5k9"]
Jul 10 14:03:53.882067 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.881996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htprw\" (UniqueName: \"kubernetes.io/projected/3e23fc1e-b600-4902-ae7e-5c0c97656c03-kube-api-access-htprw\") pod \"maas-controller-55bb89bdd-hc5k9\" (UID: \"3e23fc1e-b600-4902-ae7e-5c0c97656c03\") " pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:53.882187 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.882096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e23fc1e-b600-4902-ae7e-5c0c97656c03-webhook-cert\") pod \"maas-controller-55bb89bdd-hc5k9\" (UID: \"3e23fc1e-b600-4902-ae7e-5c0c97656c03\") " pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:53.983422 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.983390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htprw\" (UniqueName: \"kubernetes.io/projected/3e23fc1e-b600-4902-ae7e-5c0c97656c03-kube-api-access-htprw\") pod \"maas-controller-55bb89bdd-hc5k9\" (UID: \"3e23fc1e-b600-4902-ae7e-5c0c97656c03\") " pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:53.983848 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.983451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e23fc1e-b600-4902-ae7e-5c0c97656c03-webhook-cert\") pod \"maas-controller-55bb89bdd-hc5k9\" (UID: \"3e23fc1e-b600-4902-ae7e-5c0c97656c03\") " pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:53.985720 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.985696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e23fc1e-b600-4902-ae7e-5c0c97656c03-webhook-cert\") pod \"maas-controller-55bb89bdd-hc5k9\" (UID: \"3e23fc1e-b600-4902-ae7e-5c0c97656c03\") " pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:53.991153 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:53.991132    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htprw\" (UniqueName: \"kubernetes.io/projected/3e23fc1e-b600-4902-ae7e-5c0c97656c03-kube-api-access-htprw\") pod \"maas-controller-55bb89bdd-hc5k9\" (UID: \"3e23fc1e-b600-4902-ae7e-5c0c97656c03\") " pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:54.103040 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:54.103014    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:54.236198 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:54.236173    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bb89bdd-hc5k9"]
Jul 10 14:03:54.238169 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:03:54.238134    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e23fc1e_b600_4902_ae7e_5c0c97656c03.slice/crio-25b08846e78858790aeb1bdb567f0a71c38fe26b4e9db753ae9657ce22f5a26b WatchSource:0}: Error finding container 25b08846e78858790aeb1bdb567f0a71c38fe26b4e9db753ae9657ce22f5a26b: Status 404 returned error can't find the container with id 25b08846e78858790aeb1bdb567f0a71c38fe26b4e9db753ae9657ce22f5a26b
Jul 10 14:03:54.986931 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:54.986899    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bb89bdd-hc5k9" event={"ID":"3e23fc1e-b600-4902-ae7e-5c0c97656c03","Type":"ContainerStarted","Data":"0bb9360c5757d8a98e86b87bbc5d6082ebeb320abc341de9900b3ed19b36f49a"}
Jul 10 14:03:54.987311 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:54.986957    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bb89bdd-hc5k9" event={"ID":"3e23fc1e-b600-4902-ae7e-5c0c97656c03","Type":"ContainerStarted","Data":"25b08846e78858790aeb1bdb567f0a71c38fe26b4e9db753ae9657ce22f5a26b"}
Jul 10 14:03:54.987311 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:54.986999    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:03:55.012564 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:03:55.012524    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55bb89bdd-hc5k9" podStartSLOduration=1.467962913 podStartE2EDuration="2.01250687s" totalImagesPullingTime="544.543957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:03:55.012075897 +0000 UTC m=+843.929120162" watchObservedRunningTime="2026-07-10 14:03:55.01250687 +0000 UTC m=+843.929551164"
Jul 10 14:04:05.995710 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:04:05.995678    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55bb89bdd-hc5k9"
Jul 10 14:04:53.678458 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:04:53.678346    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:04:53.685881 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:04:53.685861    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:08:40.316604 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:40.316565    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"]
Jul 10 14:08:40.317173 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:40.316759    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs" podUID="9b5a24a0-7dea-4076-8b2a-b1047a7bc995" containerName="manager" containerID="cri-o://692e04a3459864a6d4aeb92b4914b8900113df1d629c3798cb743b8a26d76956" gracePeriod=10
Jul 10 14:08:43.622041 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:43.622008    2570 generic.go:356] "Generic (PLEG): container finished" podID="9b5a24a0-7dea-4076-8b2a-b1047a7bc995" containerID="692e04a3459864a6d4aeb92b4914b8900113df1d629c3798cb743b8a26d76956" exitCode=0
Jul 10 14:08:43.622400 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:43.622082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs" event={"ID":"9b5a24a0-7dea-4076-8b2a-b1047a7bc995","Type":"ContainerDied","Data":"692e04a3459864a6d4aeb92b4914b8900113df1d629c3798cb743b8a26d76956"}
Jul 10 14:08:43.770252 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:43.770229    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 14:08:43.900095 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:43.900023    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzq5h\" (UniqueName: \"kubernetes.io/projected/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-kube-api-access-gzq5h\") pod \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\" (UID: \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\") "
Jul 10 14:08:43.900095 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:43.900056    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-extensions-socket-volume\") pod \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\" (UID: \"9b5a24a0-7dea-4076-8b2a-b1047a7bc995\") "
Jul 10 14:08:43.900443 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:43.900418    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b5a24a0-7dea-4076-8b2a-b1047a7bc995" (UID: "9b5a24a0-7dea-4076-8b2a-b1047a7bc995"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:08:43.902120 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:43.902099    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-kube-api-access-gzq5h" (OuterVolumeSpecName: "kube-api-access-gzq5h") pod "9b5a24a0-7dea-4076-8b2a-b1047a7bc995" (UID: "9b5a24a0-7dea-4076-8b2a-b1047a7bc995"). InnerVolumeSpecName "kube-api-access-gzq5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:08:44.001085 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:44.001052    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzq5h\" (UniqueName: \"kubernetes.io/projected/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-kube-api-access-gzq5h\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:08:44.001085 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:44.001083    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b5a24a0-7dea-4076-8b2a-b1047a7bc995-extensions-socket-volume\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:08:44.629305 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:44.629275    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"
Jul 10 14:08:44.629777 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:44.629275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs" event={"ID":"9b5a24a0-7dea-4076-8b2a-b1047a7bc995","Type":"ContainerDied","Data":"6f54590feac447aedae2db782a49550091012fbf739eb01efcb426ce00a462a7"}
Jul 10 14:08:44.629777 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:44.629412    2570 scope.go:117] "RemoveContainer" containerID="692e04a3459864a6d4aeb92b4914b8900113df1d629c3798cb743b8a26d76956"
Jul 10 14:08:44.651923 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:44.651902    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"]
Jul 10 14:08:44.656067 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:44.656046    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5qnjs"]
Jul 10 14:08:45.565873 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:08:45.565840    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5a24a0-7dea-4076-8b2a-b1047a7bc995" path="/var/lib/kubelet/pods/9b5a24a0-7dea-4076-8b2a-b1047a7bc995/volumes"
Jul 10 14:09:41.499203 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.499168    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"]
Jul 10 14:09:41.499693 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.499583    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5a24a0-7dea-4076-8b2a-b1047a7bc995" containerName="manager"
Jul 10 14:09:41.499693 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.499593    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5a24a0-7dea-4076-8b2a-b1047a7bc995" containerName="manager"
Jul 10 14:09:41.499693 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.499670    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5a24a0-7dea-4076-8b2a-b1047a7bc995" containerName="manager"
Jul 10 14:09:41.502642 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.502625    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:41.505149 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.505124    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68m97\""
Jul 10 14:09:41.527267 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.527239    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"]
Jul 10 14:09:41.573672 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.573638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd98421e-26fd-4261-bfb1-ee054bff1ee1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w92nl\" (UID: \"fd98421e-26fd-4261-bfb1-ee054bff1ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:41.573873 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.573698    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbcs\" (UniqueName: \"kubernetes.io/projected/fd98421e-26fd-4261-bfb1-ee054bff1ee1-kube-api-access-nzbcs\") pod \"kuadrant-operator-controller-manager-86878c769f-w92nl\" (UID: \"fd98421e-26fd-4261-bfb1-ee054bff1ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:41.674580 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.674547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd98421e-26fd-4261-bfb1-ee054bff1ee1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w92nl\" (UID: \"fd98421e-26fd-4261-bfb1-ee054bff1ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:41.674727 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.674617    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbcs\" (UniqueName: \"kubernetes.io/projected/fd98421e-26fd-4261-bfb1-ee054bff1ee1-kube-api-access-nzbcs\") pod \"kuadrant-operator-controller-manager-86878c769f-w92nl\" (UID: \"fd98421e-26fd-4261-bfb1-ee054bff1ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:41.674933 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.674914    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd98421e-26fd-4261-bfb1-ee054bff1ee1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w92nl\" (UID: \"fd98421e-26fd-4261-bfb1-ee054bff1ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:41.683620 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.683599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbcs\" (UniqueName: \"kubernetes.io/projected/fd98421e-26fd-4261-bfb1-ee054bff1ee1-kube-api-access-nzbcs\") pod \"kuadrant-operator-controller-manager-86878c769f-w92nl\" (UID: \"fd98421e-26fd-4261-bfb1-ee054bff1ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:41.812714 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.812618    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:41.967919 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:41.967857    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"]
Jul 10 14:09:41.970680 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:09:41.970655    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd98421e_26fd_4261_bfb1_ee054bff1ee1.slice/crio-2c2a16448225704701c408913a6c26a437d4d44e6dfd33fc8de462c1f531ed88 WatchSource:0}: Error finding container 2c2a16448225704701c408913a6c26a437d4d44e6dfd33fc8de462c1f531ed88: Status 404 returned error can't find the container with id 2c2a16448225704701c408913a6c26a437d4d44e6dfd33fc8de462c1f531ed88
Jul 10 14:09:42.946021 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:42.945983    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl" event={"ID":"fd98421e-26fd-4261-bfb1-ee054bff1ee1","Type":"ContainerStarted","Data":"0eacc160f6847cf6a62e224999388b5682e015bd92f8e88473b8abc548b8076f"}
Jul 10 14:09:42.946391 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:42.946078    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl" event={"ID":"fd98421e-26fd-4261-bfb1-ee054bff1ee1","Type":"ContainerStarted","Data":"2c2a16448225704701c408913a6c26a437d4d44e6dfd33fc8de462c1f531ed88"}
Jul 10 14:09:42.946391 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:42.946106    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:09:42.966022 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:42.965951    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl" podStartSLOduration=1.965925921 podStartE2EDuration="1.965925921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:42.964606049 +0000 UTC m=+1191.881650311" watchObservedRunningTime="2026-07-10 14:09:42.965925921 +0000 UTC m=+1191.882970187"
Jul 10 14:09:53.723421 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:53.723397    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:09:53.732124 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:53.732103    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:09:53.954997 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:09:53.954927    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w92nl"
Jul 10 14:14:53.769380 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:14:53.769274    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:14:53.779485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:14:53.779462    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:19:53.807558 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:19:53.807460    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:19:53.819628 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:19:53.819611    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:23:18.935050 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.935013    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"]
Jul 10 14:23:18.939277 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.939250    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:18.945682 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.945653    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0c74fa54\"/\"e2e-lifecycle-model-0c74fa54-kserve-self-signed-certs\""
Jul 10 14:23:18.945831 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.945668    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0c74fa54\"/\"openshift-service-ca.crt\""
Jul 10 14:23:18.945831 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.945702    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0c74fa54\"/\"kube-root-ca.crt\""
Jul 10 14:23:18.946948 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.946492    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0c74fa54\"/\"default-dockercfg-hwvb7\""
Jul 10 14:23:18.960616 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.960591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-home\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:18.960710 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.960632    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-dshm\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:18.960710 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.960648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e38917-6aac-489a-8618-b911839e0121-tls-certs\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:18.960710 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.960672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn9z5\" (UniqueName: \"kubernetes.io/projected/f5e38917-6aac-489a-8618-b911839e0121-kube-api-access-mn9z5\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:18.960710 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.960706    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-tmp-dir\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:18.960878 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.960723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-model-cache\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:18.969030 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:18.969002    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"]
Jul 10 14:23:19.061731 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.061693    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-tmp-dir\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.061731 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.061730    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-model-cache\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.061950 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.061813    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-home\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.061950 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.061849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-dshm\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.061950 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.061864    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e38917-6aac-489a-8618-b911839e0121-tls-certs\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.061950 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.061879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9z5\" (UniqueName: \"kubernetes.io/projected/f5e38917-6aac-489a-8618-b911839e0121-kube-api-access-mn9z5\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.062152 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.062129    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-tmp-dir\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.062209 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.062148    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-model-cache\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.062269 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.062244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-home\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.064178 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.064150    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-dshm\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.064342 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.064326    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e38917-6aac-489a-8618-b911839e0121-tls-certs\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.072365 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.072317    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn9z5\" (UniqueName: \"kubernetes.io/projected/f5e38917-6aac-489a-8618-b911839e0121-kube-api-access-mn9z5\") pod \"e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") " pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.249335 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.249305    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:19.417216 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:23:19.417184    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5e38917_6aac_489a_8618_b911839e0121.slice/crio-763eb70a8779e3be6d36e0d6f0fb5ec53080d508c52be75201f42bc99ab4cc31 WatchSource:0}: Error finding container 763eb70a8779e3be6d36e0d6f0fb5ec53080d508c52be75201f42bc99ab4cc31: Status 404 returned error can't find the container with id 763eb70a8779e3be6d36e0d6f0fb5ec53080d508c52be75201f42bc99ab4cc31
Jul 10 14:23:19.417793 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.417761    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"]
Jul 10 14:23:19.601145 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.601045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv" event={"ID":"f5e38917-6aac-489a-8618-b911839e0121","Type":"ContainerStarted","Data":"4695f51ffe324aea8d55805e04c186979fd83906587bcf8d0149156cdf0290fe"}
Jul 10 14:23:19.601145 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.601098    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv" event={"ID":"f5e38917-6aac-489a-8618-b911839e0121","Type":"ContainerStarted","Data":"763eb70a8779e3be6d36e0d6f0fb5ec53080d508c52be75201f42bc99ab4cc31"}
Jul 10 14:23:19.636924 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:19.636865    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv" podStartSLOduration=1.636849084 podStartE2EDuration="1.636849084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:23:19.634973108 +0000 UTC m=+2008.552017367" watchObservedRunningTime="2026-07-10 14:23:19.636849084 +0000 UTC m=+2008.553893346"
Jul 10 14:23:29.250134 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:29.250090    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:29.250604 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:29.250168    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:29.262802 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:29.262777    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:29.669111 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:29.669020    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:23:58.666794 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:23:58.666761    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"]
Jul 10 14:24:13.688628 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:13.688581    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv" podUID="f5e38917-6aac-489a-8618-b911839e0121" containerName="main" containerID="cri-o://4695f51ffe324aea8d55805e04c186979fd83906587bcf8d0149156cdf0290fe" gracePeriod=45
Jul 10 14:24:13.911455 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:13.911418    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5e38917-6aac-489a-8618-b911839e0121" containerID="4695f51ffe324aea8d55805e04c186979fd83906587bcf8d0149156cdf0290fe" exitCode=0
Jul 10 14:24:13.911627 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:13.911502    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv" event={"ID":"f5e38917-6aac-489a-8618-b911839e0121","Type":"ContainerDied","Data":"4695f51ffe324aea8d55805e04c186979fd83906587bcf8d0149156cdf0290fe"}
Jul 10 14:24:13.942491 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:13.942442    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:24:14.031816 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.031786    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-model-cache\") pod \"f5e38917-6aac-489a-8618-b911839e0121\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") "
Jul 10 14:24:14.031961 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.031852    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-dshm\") pod \"f5e38917-6aac-489a-8618-b911839e0121\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") "
Jul 10 14:24:14.031961 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.031887    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e38917-6aac-489a-8618-b911839e0121-tls-certs\") pod \"f5e38917-6aac-489a-8618-b911839e0121\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") "
Jul 10 14:24:14.032091 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.031960    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-tmp-dir\") pod \"f5e38917-6aac-489a-8618-b911839e0121\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") "
Jul 10 14:24:14.032091 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.031968    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-model-cache" (OuterVolumeSpecName: "model-cache") pod "f5e38917-6aac-489a-8618-b911839e0121" (UID: "f5e38917-6aac-489a-8618-b911839e0121"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:24:14.032091 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.032026    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-home\") pod \"f5e38917-6aac-489a-8618-b911839e0121\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") "
Jul 10 14:24:14.032091 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.032057    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn9z5\" (UniqueName: \"kubernetes.io/projected/f5e38917-6aac-489a-8618-b911839e0121-kube-api-access-mn9z5\") pod \"f5e38917-6aac-489a-8618-b911839e0121\" (UID: \"f5e38917-6aac-489a-8618-b911839e0121\") "
Jul 10 14:24:14.032326 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.032294    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-home" (OuterVolumeSpecName: "home") pod "f5e38917-6aac-489a-8618-b911839e0121" (UID: "f5e38917-6aac-489a-8618-b911839e0121"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:24:14.032326 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.032289    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f5e38917-6aac-489a-8618-b911839e0121" (UID: "f5e38917-6aac-489a-8618-b911839e0121"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:24:14.032463 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.032391    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:24:14.032463 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.032410    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:24:14.032463 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.032434    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:24:14.034143 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.034103    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-dshm" (OuterVolumeSpecName: "dshm") pod "f5e38917-6aac-489a-8618-b911839e0121" (UID: "f5e38917-6aac-489a-8618-b911839e0121"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:24:14.034244 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.034134    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e38917-6aac-489a-8618-b911839e0121-kube-api-access-mn9z5" (OuterVolumeSpecName: "kube-api-access-mn9z5") pod "f5e38917-6aac-489a-8618-b911839e0121" (UID: "f5e38917-6aac-489a-8618-b911839e0121"). InnerVolumeSpecName "kube-api-access-mn9z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:24:14.034244 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.034165    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e38917-6aac-489a-8618-b911839e0121-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f5e38917-6aac-489a-8618-b911839e0121" (UID: "f5e38917-6aac-489a-8618-b911839e0121"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:24:14.133793 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.133761    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5e38917-6aac-489a-8618-b911839e0121-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:24:14.133793 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.133791    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e38917-6aac-489a-8618-b911839e0121-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:24:14.133957 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.133806    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn9z5\" (UniqueName: \"kubernetes.io/projected/f5e38917-6aac-489a-8618-b911839e0121-kube-api-access-mn9z5\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:24:14.918720 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.918684    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"
Jul 10 14:24:14.919115 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.918731    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv" event={"ID":"f5e38917-6aac-489a-8618-b911839e0121","Type":"ContainerDied","Data":"763eb70a8779e3be6d36e0d6f0fb5ec53080d508c52be75201f42bc99ab4cc31"}
Jul 10 14:24:14.919115 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.918799    2570 scope.go:117] "RemoveContainer" containerID="4695f51ffe324aea8d55805e04c186979fd83906587bcf8d0149156cdf0290fe"
Jul 10 14:24:14.943818 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.943789    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"]
Jul 10 14:24:14.946238 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:14.946218    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0c74fa54/e2e-lifecycle-model-0c74fa54-kserve-5b66b8ffc9-mz4pv"]
Jul 10 14:24:15.566902 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:15.566871    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e38917-6aac-489a-8618-b911839e0121" path="/var/lib/kubelet/pods/f5e38917-6aac-489a-8618-b911839e0121/volumes"
Jul 10 14:24:53.851510 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:53.851404    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:24:53.865416 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:24:53.865394    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:26:31.326391 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.326350    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"]
Jul 10 14:26:31.327003 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.326983    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e38917-6aac-489a-8618-b911839e0121" containerName="main"
Jul 10 14:26:31.327076 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.327007    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e38917-6aac-489a-8618-b911839e0121" containerName="main"
Jul 10 14:26:31.327128 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.327117    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5e38917-6aac-489a-8618-b911839e0121" containerName="main"
Jul 10 14:26:31.330331 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.330311    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.332920 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.332891    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ee9f0f\"/\"openshift-service-ca.crt\""
Jul 10 14:26:31.333796 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.333777    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ee9f0f\"/\"kube-root-ca.crt\""
Jul 10 14:26:31.333897 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.333794    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ee9f0f\"/\"test-model-ee9f0f-kserve-self-signed-certs\""
Jul 10 14:26:31.333949 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.333894    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ee9f0f\"/\"default-dockercfg-j5crn\""
Jul 10 14:26:31.344660 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.344638    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"]
Jul 10 14:26:31.422933 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.422900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-home\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.422933 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.422933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d65j\" (UniqueName: \"kubernetes.io/projected/28c894d6-544b-456b-a6b5-52f69968720c-kube-api-access-4d65j\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.423114 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.422994    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-dshm\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.423114 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.423054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c894d6-544b-456b-a6b5-52f69968720c-tls-certs\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.423114 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.423088    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-tmp-dir\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.423212 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.423145    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-model-cache\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524288 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524257    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-dshm\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524454 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c894d6-544b-456b-a6b5-52f69968720c-tls-certs\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524454 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-tmp-dir\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524454 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-model-cache\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524454 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-home\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524454 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d65j\" (UniqueName: \"kubernetes.io/projected/28c894d6-544b-456b-a6b5-52f69968720c-kube-api-access-4d65j\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524816 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524791    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-model-cache\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524816 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524808    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-tmp-dir\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.524929 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.524860    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-home\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.526615 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.526599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-dshm\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.526773 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.526737    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c894d6-544b-456b-a6b5-52f69968720c-tls-certs\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.534424 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.534396    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d65j\" (UniqueName: \"kubernetes.io/projected/28c894d6-544b-456b-a6b5-52f69968720c-kube-api-access-4d65j\") pod \"test-model-ee9f0f-kserve-6458bc66bc-2cdvp\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") " pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.640866 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.640812    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:31.787722 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:31.787693    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"]
Jul 10 14:26:31.789356 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:26:31.789330    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28c894d6_544b_456b_a6b5_52f69968720c.slice/crio-993c5243158936d9f76277d106b21543554af42073aba52c746b72880c413b33 WatchSource:0}: Error finding container 993c5243158936d9f76277d106b21543554af42073aba52c746b72880c413b33: Status 404 returned error can't find the container with id 993c5243158936d9f76277d106b21543554af42073aba52c746b72880c413b33
Jul 10 14:26:32.695598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:32.695550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp" event={"ID":"28c894d6-544b-456b-a6b5-52f69968720c","Type":"ContainerStarted","Data":"1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e"}
Jul 10 14:26:32.695598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:32.695603    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp" event={"ID":"28c894d6-544b-456b-a6b5-52f69968720c","Type":"ContainerStarted","Data":"993c5243158936d9f76277d106b21543554af42073aba52c746b72880c413b33"}
Jul 10 14:26:32.715055 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:32.715006    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp" podStartSLOduration=1.7149892530000002 podStartE2EDuration="1.714989253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:26:32.714162547 +0000 UTC m=+2201.631206812" watchObservedRunningTime="2026-07-10 14:26:32.714989253 +0000 UTC m=+2201.632033576"
Jul 10 14:26:41.641219 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:41.641189    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:41.641614 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:41.641251    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:41.654340 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:41.654315    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:41.759945 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:41.759909    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:26:52.976592 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:52.976558    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"]
Jul 10 14:26:52.980420 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:52.980401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.000141 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.000118    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e3d9d1\"/\"openshift-service-ca.crt\""
Jul 10 14:26:53.002415 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.002394    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e3d9d1\"/\"kube-root-ca.crt\""
Jul 10 14:26:53.002948 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.002933    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e3d9d1\"/\"test-model-e3d9d1-kserve-self-signed-certs\""
Jul 10 14:26:53.013876 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.013856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-dshm\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.013976 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.013892    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-model-cache\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.013976 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.013917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-home\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.014091 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.014006    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775cl\" (UniqueName: \"kubernetes.io/projected/90d8bbed-164c-42d5-934e-992e835d9f82-kube-api-access-775cl\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.014091 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.014051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-tmp-dir\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.014168 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.014124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d8bbed-164c-42d5-934e-992e835d9f82-tls-certs\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.021732 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.021706    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"]
Jul 10 14:26:53.024713 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.024694    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e3d9d1\"/\"default-dockercfg-x7kqv\""
Jul 10 14:26:53.115049 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115019    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d8bbed-164c-42d5-934e-992e835d9f82-tls-certs\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.115175 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-dshm\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.115175 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-model-cache\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.115249 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-home\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.115249 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115204    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775cl\" (UniqueName: \"kubernetes.io/projected/90d8bbed-164c-42d5-934e-992e835d9f82-kube-api-access-775cl\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.115249 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115233    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-tmp-dir\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.115601 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115577    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-model-cache\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.115687 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115616    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-tmp-dir\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.115766 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.115681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-home\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.117405 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.117388    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-dshm\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.117584 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.117569    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d8bbed-164c-42d5-934e-992e835d9f82-tls-certs\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.140838 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.140807    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-775cl\" (UniqueName: \"kubernetes.io/projected/90d8bbed-164c-42d5-934e-992e835d9f82-kube-api-access-775cl\") pod \"test-model-e3d9d1-kserve-7874b78f4f-nnzkc\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") " pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.288693 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.288622    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:26:53.452548 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.452504    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"]
Jul 10 14:26:53.452764 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:26:53.452501    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90d8bbed_164c_42d5_934e_992e835d9f82.slice/crio-1d96430ebf1c7ddc9eb874a61e60c71be1c47bb0bb5ab0d66bdd31268cc7be2e WatchSource:0}: Error finding container 1d96430ebf1c7ddc9eb874a61e60c71be1c47bb0bb5ab0d66bdd31268cc7be2e: Status 404 returned error can't find the container with id 1d96430ebf1c7ddc9eb874a61e60c71be1c47bb0bb5ab0d66bdd31268cc7be2e
Jul 10 14:26:53.816372 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.816332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc" event={"ID":"90d8bbed-164c-42d5-934e-992e835d9f82","Type":"ContainerStarted","Data":"a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db"}
Jul 10 14:26:53.816537 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.816385    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc" event={"ID":"90d8bbed-164c-42d5-934e-992e835d9f82","Type":"ContainerStarted","Data":"1d96430ebf1c7ddc9eb874a61e60c71be1c47bb0bb5ab0d66bdd31268cc7be2e"}
Jul 10 14:26:53.853187 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:26:53.853132    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc" podStartSLOduration=1.853113604 podStartE2EDuration="1.853113604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:26:53.85019689 +0000 UTC m=+2222.767241153" watchObservedRunningTime="2026-07-10 14:26:53.853113604 +0000 UTC m=+2222.770157868"
Jul 10 14:27:03.289441 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:03.289401    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:27:03.289847 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:03.289485    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:27:03.302310 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:03.302289    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:27:03.887217 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:03.887182    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:27:13.924388 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:13.924354    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"]
Jul 10 14:27:15.117985 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:15.117945    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"]
Jul 10 14:27:28.947164 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:28.947112    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp" podUID="28c894d6-544b-456b-a6b5-52f69968720c" containerName="main" containerID="cri-o://1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e" gracePeriod=45
Jul 10 14:27:29.204830 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.204803    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.243761    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-model-cache\") pod \"28c894d6-544b-456b-a6b5-52f69968720c\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") "
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.243864    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-home\") pod \"28c894d6-544b-456b-a6b5-52f69968720c\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") "
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.243920    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d65j\" (UniqueName: \"kubernetes.io/projected/28c894d6-544b-456b-a6b5-52f69968720c-kube-api-access-4d65j\") pod \"28c894d6-544b-456b-a6b5-52f69968720c\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") "
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.243949    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-dshm\") pod \"28c894d6-544b-456b-a6b5-52f69968720c\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") "
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.243980    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-model-cache" (OuterVolumeSpecName: "model-cache") pod "28c894d6-544b-456b-a6b5-52f69968720c" (UID: "28c894d6-544b-456b-a6b5-52f69968720c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.244000    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c894d6-544b-456b-a6b5-52f69968720c-tls-certs\") pod \"28c894d6-544b-456b-a6b5-52f69968720c\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") "
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.244026    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-tmp-dir\") pod \"28c894d6-544b-456b-a6b5-52f69968720c\" (UID: \"28c894d6-544b-456b-a6b5-52f69968720c\") "
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.244306    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:29.244485 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.244415    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-home" (OuterVolumeSpecName: "home") pod "28c894d6-544b-456b-a6b5-52f69968720c" (UID: "28c894d6-544b-456b-a6b5-52f69968720c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:27:29.245185 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.245150    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28c894d6-544b-456b-a6b5-52f69968720c" (UID: "28c894d6-544b-456b-a6b5-52f69968720c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:27:29.246997 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.246900    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c894d6-544b-456b-a6b5-52f69968720c-kube-api-access-4d65j" (OuterVolumeSpecName: "kube-api-access-4d65j") pod "28c894d6-544b-456b-a6b5-52f69968720c" (UID: "28c894d6-544b-456b-a6b5-52f69968720c"). InnerVolumeSpecName "kube-api-access-4d65j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:27:29.247107 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.247016    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28c894d6-544b-456b-a6b5-52f69968720c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28c894d6-544b-456b-a6b5-52f69968720c" (UID: "28c894d6-544b-456b-a6b5-52f69968720c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:27:29.247343 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.247314    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-dshm" (OuterVolumeSpecName: "dshm") pod "28c894d6-544b-456b-a6b5-52f69968720c" (UID: "28c894d6-544b-456b-a6b5-52f69968720c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:27:29.345278 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.345254    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:29.345278 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.345277    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28c894d6-544b-456b-a6b5-52f69968720c-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:29.345408 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.345287    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:29.345408 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.345294    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28c894d6-544b-456b-a6b5-52f69968720c-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:29.345408 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:29.345302    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d65j\" (UniqueName: \"kubernetes.io/projected/28c894d6-544b-456b-a6b5-52f69968720c-kube-api-access-4d65j\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:30.030087 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.030057    2570 generic.go:356] "Generic (PLEG): container finished" podID="28c894d6-544b-456b-a6b5-52f69968720c" containerID="1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e" exitCode=0
Jul 10 14:27:30.030489 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.030096    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"
Jul 10 14:27:30.030489 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.030110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp" event={"ID":"28c894d6-544b-456b-a6b5-52f69968720c","Type":"ContainerDied","Data":"1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e"}
Jul 10 14:27:30.030489 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.030141    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp" event={"ID":"28c894d6-544b-456b-a6b5-52f69968720c","Type":"ContainerDied","Data":"993c5243158936d9f76277d106b21543554af42073aba52c746b72880c413b33"}
Jul 10 14:27:30.030489 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.030160    2570 scope.go:117] "RemoveContainer" containerID="1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e"
Jul 10 14:27:30.039372 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.039355    2570 scope.go:117] "RemoveContainer" containerID="1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e"
Jul 10 14:27:30.039654 ip-10-0-137-35 kubenswrapper[2570]: E0710 14:27:30.039626    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e\": container with ID starting with 1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e not found: ID does not exist" containerID="1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e"
Jul 10 14:27:30.039773 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.039662    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e"} err="failed to get container status \"1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e\": rpc error: code = NotFound desc = could not find container \"1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e\": container with ID starting with 1529f4e8a34891952ab0431ab12239bcdf2364c0d734768b87d98d8dce35214e not found: ID does not exist"
Jul 10 14:27:30.060598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.060577    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"]
Jul 10 14:27:30.066300 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.066279    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ee9f0f/test-model-ee9f0f-kserve-6458bc66bc-2cdvp"]
Jul 10 14:27:30.138519 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.138491    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc" podUID="90d8bbed-164c-42d5-934e-992e835d9f82" containerName="main" containerID="cri-o://a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db" gracePeriod=45
Jul 10 14:27:30.389863 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.389838    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:27:30.455625 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.455594    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-home\") pod \"90d8bbed-164c-42d5-934e-992e835d9f82\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") "
Jul 10 14:27:30.455777 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.455633    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d8bbed-164c-42d5-934e-992e835d9f82-tls-certs\") pod \"90d8bbed-164c-42d5-934e-992e835d9f82\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") "
Jul 10 14:27:30.455777 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.455668    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-775cl\" (UniqueName: \"kubernetes.io/projected/90d8bbed-164c-42d5-934e-992e835d9f82-kube-api-access-775cl\") pod \"90d8bbed-164c-42d5-934e-992e835d9f82\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") "
Jul 10 14:27:30.455777 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.455705    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-tmp-dir\") pod \"90d8bbed-164c-42d5-934e-992e835d9f82\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") "
Jul 10 14:27:30.455777 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.455723    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-dshm\") pod \"90d8bbed-164c-42d5-934e-992e835d9f82\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") "
Jul 10 14:27:30.456012 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.455798    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-model-cache\") pod \"90d8bbed-164c-42d5-934e-992e835d9f82\" (UID: \"90d8bbed-164c-42d5-934e-992e835d9f82\") "
Jul 10 14:27:30.456012 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.455891    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-home" (OuterVolumeSpecName: "home") pod "90d8bbed-164c-42d5-934e-992e835d9f82" (UID: "90d8bbed-164c-42d5-934e-992e835d9f82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:27:30.456178 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.456114    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "90d8bbed-164c-42d5-934e-992e835d9f82" (UID: "90d8bbed-164c-42d5-934e-992e835d9f82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:27:30.456178 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.456164    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:30.456178 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.456163    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-model-cache" (OuterVolumeSpecName: "model-cache") pod "90d8bbed-164c-42d5-934e-992e835d9f82" (UID: "90d8bbed-164c-42d5-934e-992e835d9f82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:27:30.458052 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.458022    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-dshm" (OuterVolumeSpecName: "dshm") pod "90d8bbed-164c-42d5-934e-992e835d9f82" (UID: "90d8bbed-164c-42d5-934e-992e835d9f82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:27:30.458141 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.458071    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90d8bbed-164c-42d5-934e-992e835d9f82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "90d8bbed-164c-42d5-934e-992e835d9f82" (UID: "90d8bbed-164c-42d5-934e-992e835d9f82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:27:30.458141 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.458088    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d8bbed-164c-42d5-934e-992e835d9f82-kube-api-access-775cl" (OuterVolumeSpecName: "kube-api-access-775cl") pod "90d8bbed-164c-42d5-934e-992e835d9f82" (UID: "90d8bbed-164c-42d5-934e-992e835d9f82"). InnerVolumeSpecName "kube-api-access-775cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:27:30.556846 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.556787    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-775cl\" (UniqueName: \"kubernetes.io/projected/90d8bbed-164c-42d5-934e-992e835d9f82-kube-api-access-775cl\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:30.556846 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.556809    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:30.556846 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.556818    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:30.556846 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.556826    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d8bbed-164c-42d5-934e-992e835d9f82-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:30.556846 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:30.556836    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d8bbed-164c-42d5-934e-992e835d9f82-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:31.037461 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.037425    2570 generic.go:356] "Generic (PLEG): container finished" podID="90d8bbed-164c-42d5-934e-992e835d9f82" containerID="a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db" exitCode=0
Jul 10 14:27:31.037919 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.037465    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"
Jul 10 14:27:31.037919 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.037517    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc" event={"ID":"90d8bbed-164c-42d5-934e-992e835d9f82","Type":"ContainerDied","Data":"a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db"}
Jul 10 14:27:31.037919 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.037568    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc" event={"ID":"90d8bbed-164c-42d5-934e-992e835d9f82","Type":"ContainerDied","Data":"1d96430ebf1c7ddc9eb874a61e60c71be1c47bb0bb5ab0d66bdd31268cc7be2e"}
Jul 10 14:27:31.037919 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.037592    2570 scope.go:117] "RemoveContainer" containerID="a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db"
Jul 10 14:27:31.049082 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.049062    2570 scope.go:117] "RemoveContainer" containerID="a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db"
Jul 10 14:27:31.049339 ip-10-0-137-35 kubenswrapper[2570]: E0710 14:27:31.049322    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db\": container with ID starting with a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db not found: ID does not exist" containerID="a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db"
Jul 10 14:27:31.049388 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.049348    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db"} err="failed to get container status \"a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db\": rpc error: code = NotFound desc = could not find container \"a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db\": container with ID starting with a00c69c93d04a2fb3b4a4e8c1a173b97391377d9a205291849d51781090e19db not found: ID does not exist"
Jul 10 14:27:31.078939 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.078916    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"]
Jul 10 14:27:31.086726 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.086706    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e3d9d1/test-model-e3d9d1-kserve-7874b78f4f-nnzkc"]
Jul 10 14:27:31.567299 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.567268    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28c894d6-544b-456b-a6b5-52f69968720c" path="/var/lib/kubelet/pods/28c894d6-544b-456b-a6b5-52f69968720c/volumes"
Jul 10 14:27:31.567663 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:31.567650    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d8bbed-164c-42d5-934e-992e835d9f82" path="/var/lib/kubelet/pods/90d8bbed-164c-42d5-934e-992e835d9f82/volumes"
Jul 10 14:27:41.956793 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.956739    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"]
Jul 10 14:27:41.957250 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.957178    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d8bbed-164c-42d5-934e-992e835d9f82" containerName="main"
Jul 10 14:27:41.957250 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.957190    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d8bbed-164c-42d5-934e-992e835d9f82" containerName="main"
Jul 10 14:27:41.957250 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.957209    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c894d6-544b-456b-a6b5-52f69968720c" containerName="main"
Jul 10 14:27:41.957250 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.957214    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c894d6-544b-456b-a6b5-52f69968720c" containerName="main"
Jul 10 14:27:41.957401 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.957291    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="28c894d6-544b-456b-a6b5-52f69968720c" containerName="main"
Jul 10 14:27:41.957401 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.957302    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d8bbed-164c-42d5-934e-992e835d9f82" containerName="main"
Jul 10 14:27:41.961935 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.961918    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"
Jul 10 14:27:41.964449 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.964427    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qd8l\""
Jul 10 14:27:41.971636 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:41.971609    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"]
Jul 10 14:27:42.056894 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:42.056856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad0655-fcc5-4687-9625-a057e91d7c16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492\" (UID: \"28ad0655-fcc5-4687-9625-a057e91d7c16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"
Jul 10 14:27:42.157622 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:42.157591    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad0655-fcc5-4687-9625-a057e91d7c16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492\" (UID: \"28ad0655-fcc5-4687-9625-a057e91d7c16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"
Jul 10 14:27:42.158201 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:42.158182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad0655-fcc5-4687-9625-a057e91d7c16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492\" (UID: \"28ad0655-fcc5-4687-9625-a057e91d7c16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"
Jul 10 14:27:42.273299 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:42.273219    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"
Jul 10 14:27:42.639150 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:42.639121    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"]
Jul 10 14:27:42.644922 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:42.644903    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:27:43.110063 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:43.110024    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492" event={"ID":"28ad0655-fcc5-4687-9625-a057e91d7c16","Type":"ContainerStarted","Data":"ab1b7d39b26785be562a5c0ac15ba7e6ef8987c1bb4d524cedfb3013ccae7404"}
Jul 10 14:27:45.123787 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:45.123710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492" event={"ID":"28ad0655-fcc5-4687-9625-a057e91d7c16","Type":"ContainerStarted","Data":"c4b28ea4b035069f03d2f854fb9ee1a4579824d8e5fea03953f65543965aadc4"}
Jul 10 14:27:45.157186 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:45.157146    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492" podStartSLOduration=1.977831781 podStartE2EDuration="4.157131706s" totalImagesPullingTime="2.179299925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:27:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:27:45.153768525 +0000 UTC m=+2274.070812787" watchObservedRunningTime="2026-07-10 14:27:45.157131706 +0000 UTC m=+2274.074175970"
Jul 10 14:27:46.131007 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:46.130976    2570 generic.go:356] "Generic (PLEG): container finished" podID="28ad0655-fcc5-4687-9625-a057e91d7c16" containerID="c4b28ea4b035069f03d2f854fb9ee1a4579824d8e5fea03953f65543965aadc4" exitCode=0
Jul 10 14:27:46.131364 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:46.131039    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492" event={"ID":"28ad0655-fcc5-4687-9625-a057e91d7c16","Type":"ContainerDied","Data":"c4b28ea4b035069f03d2f854fb9ee1a4579824d8e5fea03953f65543965aadc4"}
Jul 10 14:27:47.273886 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:47.273859    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"
Jul 10 14:27:47.403646 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:47.403565    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad0655-fcc5-4687-9625-a057e91d7c16-maas-api-service-ca\") pod \"28ad0655-fcc5-4687-9625-a057e91d7c16\" (UID: \"28ad0655-fcc5-4687-9625-a057e91d7c16\") "
Jul 10 14:27:47.403926 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:47.403903    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28ad0655-fcc5-4687-9625-a057e91d7c16-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28ad0655-fcc5-4687-9625-a057e91d7c16" (UID: "28ad0655-fcc5-4687-9625-a057e91d7c16"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:27:47.504590 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:47.504558    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ad0655-fcc5-4687-9625-a057e91d7c16-maas-api-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:27:48.143519 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:48.143483    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492" event={"ID":"28ad0655-fcc5-4687-9625-a057e91d7c16","Type":"ContainerDied","Data":"ab1b7d39b26785be562a5c0ac15ba7e6ef8987c1bb4d524cedfb3013ccae7404"}
Jul 10 14:27:48.143519 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:48.143520    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492"
Jul 10 14:27:48.143726 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:27:48.143543    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab1b7d39b26785be562a5c0ac15ba7e6ef8987c1bb4d524cedfb3013ccae7404"
Jul 10 14:28:34.282445 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.282411    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"]
Jul 10 14:28:34.282923 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.282844    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ad0655-fcc5-4687-9625-a057e91d7c16" containerName="revoke-keys"
Jul 10 14:28:34.282923 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.282855    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ad0655-fcc5-4687-9625-a057e91d7c16" containerName="revoke-keys"
Jul 10 14:28:34.282923 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.282923    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ad0655-fcc5-4687-9625-a057e91d7c16" containerName="revoke-keys"
Jul 10 14:28:34.286087 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.286070    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"
Jul 10 14:28:34.296702 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.296678    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qd8l\""
Jul 10 14:28:34.299137 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.299118    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"]
Jul 10 14:28:34.410784 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.410720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba34eeb-3dc0-468d-852c-f8fb0779a036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw\" (UID: \"8ba34eeb-3dc0-468d-852c-f8fb0779a036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"
Jul 10 14:28:34.511527 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.511496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba34eeb-3dc0-468d-852c-f8fb0779a036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw\" (UID: \"8ba34eeb-3dc0-468d-852c-f8fb0779a036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"
Jul 10 14:28:34.512148 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.512125    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba34eeb-3dc0-468d-852c-f8fb0779a036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw\" (UID: \"8ba34eeb-3dc0-468d-852c-f8fb0779a036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"
Jul 10 14:28:34.596248 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.596173    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"
Jul 10 14:28:34.744441 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:34.744396    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"]
Jul 10 14:28:34.745708 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:28:34.745684    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba34eeb_3dc0_468d_852c_f8fb0779a036.slice/crio-781be82b8a3b5d113097609838eecde438a2e6fa093722d5720bb12a7cac6d19 WatchSource:0}: Error finding container 781be82b8a3b5d113097609838eecde438a2e6fa093722d5720bb12a7cac6d19: Status 404 returned error can't find the container with id 781be82b8a3b5d113097609838eecde438a2e6fa093722d5720bb12a7cac6d19
Jul 10 14:28:35.427987 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:35.427952    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw" event={"ID":"8ba34eeb-3dc0-468d-852c-f8fb0779a036","Type":"ContainerStarted","Data":"cc936b4b622c188485887e4b19ba4d54cc0e124438cfe76d22a2f5e85c7ce035"}
Jul 10 14:28:35.428342 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:35.428009    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw" event={"ID":"8ba34eeb-3dc0-468d-852c-f8fb0779a036","Type":"ContainerStarted","Data":"781be82b8a3b5d113097609838eecde438a2e6fa093722d5720bb12a7cac6d19"}
Jul 10 14:28:35.448422 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:35.448371    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw" podStartSLOduration=1.448355862 podStartE2EDuration="1.448355862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:28:35.447617069 +0000 UTC m=+2324.364661333" watchObservedRunningTime="2026-07-10 14:28:35.448355862 +0000 UTC m=+2324.365400124"
Jul 10 14:28:36.436060 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:36.436012    2570 generic.go:356] "Generic (PLEG): container finished" podID="8ba34eeb-3dc0-468d-852c-f8fb0779a036" containerID="cc936b4b622c188485887e4b19ba4d54cc0e124438cfe76d22a2f5e85c7ce035" exitCode=0
Jul 10 14:28:36.436613 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:36.436572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw" event={"ID":"8ba34eeb-3dc0-468d-852c-f8fb0779a036","Type":"ContainerDied","Data":"cc936b4b622c188485887e4b19ba4d54cc0e124438cfe76d22a2f5e85c7ce035"}
Jul 10 14:28:37.584101 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:37.584077    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"
Jul 10 14:28:37.637236 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:37.637201    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba34eeb-3dc0-468d-852c-f8fb0779a036-maas-api-service-ca\") pod \"8ba34eeb-3dc0-468d-852c-f8fb0779a036\" (UID: \"8ba34eeb-3dc0-468d-852c-f8fb0779a036\") "
Jul 10 14:28:37.637553 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:37.637524    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba34eeb-3dc0-468d-852c-f8fb0779a036-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8ba34eeb-3dc0-468d-852c-f8fb0779a036" (UID: "8ba34eeb-3dc0-468d-852c-f8fb0779a036"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:28:37.738355 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:37.738336    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ba34eeb-3dc0-468d-852c-f8fb0779a036-maas-api-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:28:38.449860 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:38.449827    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw"
Jul 10 14:28:38.450046 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:38.449826    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw" event={"ID":"8ba34eeb-3dc0-468d-852c-f8fb0779a036","Type":"ContainerDied","Data":"781be82b8a3b5d113097609838eecde438a2e6fa093722d5720bb12a7cac6d19"}
Jul 10 14:28:38.450046 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:28:38.449974    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="781be82b8a3b5d113097609838eecde438a2e6fa093722d5720bb12a7cac6d19"
Jul 10 14:29:52.231372 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.231341    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"]
Jul 10 14:29:52.231835 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.231768    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba34eeb-3dc0-468d-852c-f8fb0779a036" containerName="revoke-keys"
Jul 10 14:29:52.231835 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.231780    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba34eeb-3dc0-468d-852c-f8fb0779a036" containerName="revoke-keys"
Jul 10 14:29:52.231916 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.231854    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ba34eeb-3dc0-468d-852c-f8fb0779a036" containerName="revoke-keys"
Jul 10 14:29:52.235034 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.235015    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.237735 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.237710    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e5410e\"/\"kube-root-ca.crt\""
Jul 10 14:29:52.238482 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.238460    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e5410e\"/\"openshift-service-ca.crt\""
Jul 10 14:29:52.238602 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.238533    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e5410e\"/\"default-dockercfg-txxp7\""
Jul 10 14:29:52.238602 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.238541    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e5410e\"/\"auth-test-model-e5410e-kserve-self-signed-certs\""
Jul 10 14:29:52.248367 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.248347    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"]
Jul 10 14:29:52.384594 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.384556    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-model-cache\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.384761 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.384611    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tmp-dir\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.384761 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.384632    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tls-certs\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.384761 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.384674    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-home\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.384761 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.384712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnf9\" (UniqueName: \"kubernetes.io/projected/9ea6f460-8767-4382-bde4-bf263c2ac7ac-kube-api-access-lgnf9\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.384907 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.384783    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-dshm\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485245 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485174    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tmp-dir\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485245 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tls-certs\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485442 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-home\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485442 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485293    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnf9\" (UniqueName: \"kubernetes.io/projected/9ea6f460-8767-4382-bde4-bf263c2ac7ac-kube-api-access-lgnf9\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485442 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485330    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-dshm\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485442 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485385    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-model-cache\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485737 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485709    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tmp-dir\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485846 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485710    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-home\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.485846 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.485783    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-model-cache\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.487625 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.487607    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-dshm\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.487927 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.487906    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tls-certs\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.496877 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.496858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnf9\" (UniqueName: \"kubernetes.io/projected/9ea6f460-8767-4382-bde4-bf263c2ac7ac-kube-api-access-lgnf9\") pod \"auth-test-model-e5410e-kserve-56498bcdcf-dhhb5\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") " pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.544360 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.544338    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:29:52.690999 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.690971    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"]
Jul 10 14:29:52.692573 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:29:52.692546    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ea6f460_8767_4382_bde4_bf263c2ac7ac.slice/crio-b70af991ac32e90343ce486b6f03a2b57859a1444322e9d8e4373cc7618cd056 WatchSource:0}: Error finding container b70af991ac32e90343ce486b6f03a2b57859a1444322e9d8e4373cc7618cd056: Status 404 returned error can't find the container with id b70af991ac32e90343ce486b6f03a2b57859a1444322e9d8e4373cc7618cd056
Jul 10 14:29:52.882641 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.882602    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5" event={"ID":"9ea6f460-8767-4382-bde4-bf263c2ac7ac","Type":"ContainerStarted","Data":"4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f"}
Jul 10 14:29:52.882846 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.882653    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5" event={"ID":"9ea6f460-8767-4382-bde4-bf263c2ac7ac","Type":"ContainerStarted","Data":"b70af991ac32e90343ce486b6f03a2b57859a1444322e9d8e4373cc7618cd056"}
Jul 10 14:29:52.900937 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:52.900889    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5" podStartSLOduration=0.900873979 podStartE2EDuration="900.873979ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:29:52.90015054 +0000 UTC m=+2401.817194806" watchObservedRunningTime="2026-07-10 14:29:52.900873979 +0000 UTC m=+2401.817918242"
Jul 10 14:29:53.890760 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:53.890647    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:29:53.905891 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:29:53.904566    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:30:02.545190 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:30:02.545149    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:30:02.545611 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:30:02.545218    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:30:02.558024 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:30:02.557999    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:30:02.953021 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:30:02.952993    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:32:16.130588 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:16.130371    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"]
Jul 10 14:32:24.814008 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.813971    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"]
Jul 10 14:32:24.817357 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.817338    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:24.819839 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.819819    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e5410e\"/\"sub-test-model-e5410e-kserve-self-signed-certs\""
Jul 10 14:32:24.828696 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.828672    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"]
Jul 10 14:32:24.936831 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.936794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb362bdd-15e6-47c0-970b-077eb4c9e527-tls-certs\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:24.936992 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.936907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-dshm\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:24.936992 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.936935    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-model-cache\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:24.936992 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.936968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6kt\" (UniqueName: \"kubernetes.io/projected/bb362bdd-15e6-47c0-970b-077eb4c9e527-kube-api-access-vf6kt\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:24.937179 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.937080    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-home\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:24.937179 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:24.937156    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-tmp-dir\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.038261 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.038228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-home\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.038261 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.038289    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-tmp-dir\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.038535 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.038357    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb362bdd-15e6-47c0-970b-077eb4c9e527-tls-certs\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.038535 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.038440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-dshm\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.038535 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.038463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-model-cache\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.038535 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.038518    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6kt\" (UniqueName: \"kubernetes.io/projected/bb362bdd-15e6-47c0-970b-077eb4c9e527-kube-api-access-vf6kt\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.038769 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.038624    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-home\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.039280 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.039258    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-model-cache\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.039436 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.039305    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-tmp-dir\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.041669 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.041647    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-dshm\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.041968 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.041946    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb362bdd-15e6-47c0-970b-077eb4c9e527-tls-certs\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.051804 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.051774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6kt\" (UniqueName: \"kubernetes.io/projected/bb362bdd-15e6-47c0-970b-077eb4c9e527-kube-api-access-vf6kt\") pod \"sub-test-model-e5410e-kserve-859cdfd7f-hsb9n\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") " pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.126686 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.126626    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:25.489644 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.488985    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"]
Jul 10 14:32:25.491992 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:32:25.491245    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb362bdd_15e6_47c0_970b_077eb4c9e527.slice/crio-fae8f3a2690a49c3f98ae3871aeea29924b5fabeb5a95d4706d727c8f1d168ac WatchSource:0}: Error finding container fae8f3a2690a49c3f98ae3871aeea29924b5fabeb5a95d4706d727c8f1d168ac: Status 404 returned error can't find the container with id fae8f3a2690a49c3f98ae3871aeea29924b5fabeb5a95d4706d727c8f1d168ac
Jul 10 14:32:25.768508 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.768419    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n" event={"ID":"bb362bdd-15e6-47c0-970b-077eb4c9e527","Type":"ContainerStarted","Data":"e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e"}
Jul 10 14:32:25.768508 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.768468    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n" event={"ID":"bb362bdd-15e6-47c0-970b-077eb4c9e527","Type":"ContainerStarted","Data":"fae8f3a2690a49c3f98ae3871aeea29924b5fabeb5a95d4706d727c8f1d168ac"}
Jul 10 14:32:25.794774 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:25.794714    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n" podStartSLOduration=1.794700027 podStartE2EDuration="1.794700027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:25.792004489 +0000 UTC m=+2554.709048753" watchObservedRunningTime="2026-07-10 14:32:25.794700027 +0000 UTC m=+2554.711744291"
Jul 10 14:32:31.156459 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.156402    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5" podUID="9ea6f460-8767-4382-bde4-bf263c2ac7ac" containerName="main" containerID="cri-o://4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f" gracePeriod=45
Jul 10 14:32:31.418657 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.418602    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:32:31.496513 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.496484    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-dshm\") pod \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") "
Jul 10 14:32:31.496689 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.496529    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-home\") pod \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") "
Jul 10 14:32:31.496689 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.496563    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tls-certs\") pod \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") "
Jul 10 14:32:31.496689 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.496597    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgnf9\" (UniqueName: \"kubernetes.io/projected/9ea6f460-8767-4382-bde4-bf263c2ac7ac-kube-api-access-lgnf9\") pod \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") "
Jul 10 14:32:31.496689 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.496619    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-model-cache\") pod \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") "
Jul 10 14:32:31.496689 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.496666    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tmp-dir\") pod \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\" (UID: \"9ea6f460-8767-4382-bde4-bf263c2ac7ac\") "
Jul 10 14:32:31.496955 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.496811    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-home" (OuterVolumeSpecName: "home") pod "9ea6f460-8767-4382-bde4-bf263c2ac7ac" (UID: "9ea6f460-8767-4382-bde4-bf263c2ac7ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:32:31.497445 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.497399    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ea6f460-8767-4382-bde4-bf263c2ac7ac" (UID: "9ea6f460-8767-4382-bde4-bf263c2ac7ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:32:31.497445 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.497401    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ea6f460-8767-4382-bde4-bf263c2ac7ac" (UID: "9ea6f460-8767-4382-bde4-bf263c2ac7ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:32:31.497646 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.497626    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:32:31.497708 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.497647    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:32:31.497708 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.497662    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:32:31.499574 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.499547    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ea6f460-8767-4382-bde4-bf263c2ac7ac" (UID: "9ea6f460-8767-4382-bde4-bf263c2ac7ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:32:31.506651 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.506613    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea6f460-8767-4382-bde4-bf263c2ac7ac-kube-api-access-lgnf9" (OuterVolumeSpecName: "kube-api-access-lgnf9") pod "9ea6f460-8767-4382-bde4-bf263c2ac7ac" (UID: "9ea6f460-8767-4382-bde4-bf263c2ac7ac"). InnerVolumeSpecName "kube-api-access-lgnf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:32:31.506977 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.506958    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-dshm" (OuterVolumeSpecName: "dshm") pod "9ea6f460-8767-4382-bde4-bf263c2ac7ac" (UID: "9ea6f460-8767-4382-bde4-bf263c2ac7ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:32:31.598291 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.598270    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ea6f460-8767-4382-bde4-bf263c2ac7ac-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:32:31.598291 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.598291    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ea6f460-8767-4382-bde4-bf263c2ac7ac-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:32:31.598489 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.598301    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgnf9\" (UniqueName: \"kubernetes.io/projected/9ea6f460-8767-4382-bde4-bf263c2ac7ac-kube-api-access-lgnf9\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:32:31.804357 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.804329    2570 generic.go:356] "Generic (PLEG): container finished" podID="9ea6f460-8767-4382-bde4-bf263c2ac7ac" containerID="4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f" exitCode=0
Jul 10 14:32:31.804474 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.804377    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"
Jul 10 14:32:31.804474 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.804411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5" event={"ID":"9ea6f460-8767-4382-bde4-bf263c2ac7ac","Type":"ContainerDied","Data":"4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f"}
Jul 10 14:32:31.804474 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.804454    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5" event={"ID":"9ea6f460-8767-4382-bde4-bf263c2ac7ac","Type":"ContainerDied","Data":"b70af991ac32e90343ce486b6f03a2b57859a1444322e9d8e4373cc7618cd056"}
Jul 10 14:32:31.804474 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.804473    2570 scope.go:117] "RemoveContainer" containerID="4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f"
Jul 10 14:32:31.813755 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.813726    2570 scope.go:117] "RemoveContainer" containerID="4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f"
Jul 10 14:32:31.814008 ip-10-0-137-35 kubenswrapper[2570]: E0710 14:32:31.813990    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f\": container with ID starting with 4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f not found: ID does not exist" containerID="4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f"
Jul 10 14:32:31.814070 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.814019    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f"} err="failed to get container status \"4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f\": rpc error: code = NotFound desc = could not find container \"4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f\": container with ID starting with 4bb6b12bc1d6c7d87b66ef56b34b3bdd26e683d581e3d112606c72614f7c458f not found: ID does not exist"
Jul 10 14:32:31.825539 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.825520    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"]
Jul 10 14:32:31.827891 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:31.827873    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/auth-test-model-e5410e-kserve-56498bcdcf-dhhb5"]
Jul 10 14:32:33.566121 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:33.566086    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea6f460-8767-4382-bde4-bf263c2ac7ac" path="/var/lib/kubelet/pods/9ea6f460-8767-4382-bde4-bf263c2ac7ac/volumes"
Jul 10 14:32:35.127331 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:35.127301    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:35.127831 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:35.127348    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:35.139945 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:35.139921    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:32:35.842091 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:32:35.842060    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:33:32.300413 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:32.300376    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"]
Jul 10 14:33:38.916094 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.916061    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"]
Jul 10 14:33:38.916490 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.916477    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea6f460-8767-4382-bde4-bf263c2ac7ac" containerName="main"
Jul 10 14:33:38.916534 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.916491    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea6f460-8767-4382-bde4-bf263c2ac7ac" containerName="main"
Jul 10 14:33:38.916574 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.916565    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea6f460-8767-4382-bde4-bf263c2ac7ac" containerName="main"
Jul 10 14:33:38.919652 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.919633    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:38.922146 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.922125    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e5410e\"/\"rate-test-model-e5410e-kserve-self-signed-certs\""
Jul 10 14:33:38.930754 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.930718    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"]
Jul 10 14:33:38.980258 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.980222    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-model-cache\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:38.980388 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.980280    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8wpl\" (UniqueName: \"kubernetes.io/projected/a057b201-9e32-4f3a-be3f-449d8e2dc686-kube-api-access-z8wpl\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:38.980388 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.980327    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a057b201-9e32-4f3a-be3f-449d8e2dc686-tls-certs\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:38.980388 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.980347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-dshm\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:38.980530 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.980432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-tmp-dir\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:38.980530 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:38.980486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-home\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081110 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-tmp-dir\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081261 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-home\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081261 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081172    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-model-cache\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081261 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8wpl\" (UniqueName: \"kubernetes.io/projected/a057b201-9e32-4f3a-be3f-449d8e2dc686-kube-api-access-z8wpl\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081374 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081287    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a057b201-9e32-4f3a-be3f-449d8e2dc686-tls-certs\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081374 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-dshm\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081534 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081513    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-tmp-dir\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081579 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081561    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-home\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.081616 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.081595    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-model-cache\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.083608 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.083578    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-dshm\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.083917 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.083896    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a057b201-9e32-4f3a-be3f-449d8e2dc686-tls-certs\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.091019 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.091000    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8wpl\" (UniqueName: \"kubernetes.io/projected/a057b201-9e32-4f3a-be3f-449d8e2dc686-kube-api-access-z8wpl\") pod \"rate-test-model-e5410e-kserve-7565955bb7-7p77f\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") " pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.229056 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.229026    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:39.383233 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:39.383195    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"]
Jul 10 14:33:39.387652 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:33:39.387626    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda057b201_9e32_4f3a_be3f_449d8e2dc686.slice/crio-64b4597efd215ab2b80b5d86f24856e6d031df1ddf2da6080138f8ecc362dab2 WatchSource:0}: Error finding container 64b4597efd215ab2b80b5d86f24856e6d031df1ddf2da6080138f8ecc362dab2: Status 404 returned error can't find the container with id 64b4597efd215ab2b80b5d86f24856e6d031df1ddf2da6080138f8ecc362dab2
Jul 10 14:33:40.215289 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:40.215250    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f" event={"ID":"a057b201-9e32-4f3a-be3f-449d8e2dc686","Type":"ContainerStarted","Data":"11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f"}
Jul 10 14:33:40.215289 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:40.215296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f" event={"ID":"a057b201-9e32-4f3a-be3f-449d8e2dc686","Type":"ContainerStarted","Data":"64b4597efd215ab2b80b5d86f24856e6d031df1ddf2da6080138f8ecc362dab2"}
Jul 10 14:33:40.239710 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:40.239659    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f" podStartSLOduration=2.239644091 podStartE2EDuration="2.239644091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:33:40.237900727 +0000 UTC m=+2629.154944991" watchObservedRunningTime="2026-07-10 14:33:40.239644091 +0000 UTC m=+2629.156688355"
Jul 10 14:33:47.320350 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.320309    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n" podUID="bb362bdd-15e6-47c0-970b-077eb4c9e527" containerName="main" containerID="cri-o://e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e" gracePeriod=45
Jul 10 14:33:47.580877 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.580825    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:33:47.656341 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656303    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb362bdd-15e6-47c0-970b-077eb4c9e527-tls-certs\") pod \"bb362bdd-15e6-47c0-970b-077eb4c9e527\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") "
Jul 10 14:33:47.656487 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656351    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-tmp-dir\") pod \"bb362bdd-15e6-47c0-970b-077eb4c9e527\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") "
Jul 10 14:33:47.656553 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656529    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-dshm\") pod \"bb362bdd-15e6-47c0-970b-077eb4c9e527\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") "
Jul 10 14:33:47.656605 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656570    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf6kt\" (UniqueName: \"kubernetes.io/projected/bb362bdd-15e6-47c0-970b-077eb4c9e527-kube-api-access-vf6kt\") pod \"bb362bdd-15e6-47c0-970b-077eb4c9e527\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") "
Jul 10 14:33:47.656663 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656606    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-model-cache\") pod \"bb362bdd-15e6-47c0-970b-077eb4c9e527\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") "
Jul 10 14:33:47.656722 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656602    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb362bdd-15e6-47c0-970b-077eb4c9e527" (UID: "bb362bdd-15e6-47c0-970b-077eb4c9e527"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:33:47.656722 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656676    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-home\") pod \"bb362bdd-15e6-47c0-970b-077eb4c9e527\" (UID: \"bb362bdd-15e6-47c0-970b-077eb4c9e527\") "
Jul 10 14:33:47.656876 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656839    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb362bdd-15e6-47c0-970b-077eb4c9e527" (UID: "bb362bdd-15e6-47c0-970b-077eb4c9e527"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:33:47.656930 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.656882    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-home" (OuterVolumeSpecName: "home") pod "bb362bdd-15e6-47c0-970b-077eb4c9e527" (UID: "bb362bdd-15e6-47c0-970b-077eb4c9e527"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:33:47.657105 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.657083    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:33:47.657216 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.657109    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:33:47.657216 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.657124    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:33:47.658506 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.658480    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb362bdd-15e6-47c0-970b-077eb4c9e527-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb362bdd-15e6-47c0-970b-077eb4c9e527" (UID: "bb362bdd-15e6-47c0-970b-077eb4c9e527"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:33:47.658592 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.658577    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb362bdd-15e6-47c0-970b-077eb4c9e527-kube-api-access-vf6kt" (OuterVolumeSpecName: "kube-api-access-vf6kt") pod "bb362bdd-15e6-47c0-970b-077eb4c9e527" (UID: "bb362bdd-15e6-47c0-970b-077eb4c9e527"). InnerVolumeSpecName "kube-api-access-vf6kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:33:47.658656 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.658613    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-dshm" (OuterVolumeSpecName: "dshm") pod "bb362bdd-15e6-47c0-970b-077eb4c9e527" (UID: "bb362bdd-15e6-47c0-970b-077eb4c9e527"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:33:47.757844 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.757806    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf6kt\" (UniqueName: \"kubernetes.io/projected/bb362bdd-15e6-47c0-970b-077eb4c9e527-kube-api-access-vf6kt\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:33:47.757844 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.757836    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb362bdd-15e6-47c0-970b-077eb4c9e527-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:33:47.757844 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:47.757850    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb362bdd-15e6-47c0-970b-077eb4c9e527-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:33:48.264424 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.264392    2570 generic.go:356] "Generic (PLEG): container finished" podID="bb362bdd-15e6-47c0-970b-077eb4c9e527" containerID="e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e" exitCode=0
Jul 10 14:33:48.264594 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.264441    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"
Jul 10 14:33:48.264594 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.264492    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n" event={"ID":"bb362bdd-15e6-47c0-970b-077eb4c9e527","Type":"ContainerDied","Data":"e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e"}
Jul 10 14:33:48.264594 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.264539    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n" event={"ID":"bb362bdd-15e6-47c0-970b-077eb4c9e527","Type":"ContainerDied","Data":"fae8f3a2690a49c3f98ae3871aeea29924b5fabeb5a95d4706d727c8f1d168ac"}
Jul 10 14:33:48.264594 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.264563    2570 scope.go:117] "RemoveContainer" containerID="e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e"
Jul 10 14:33:48.274421 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.274399    2570 scope.go:117] "RemoveContainer" containerID="e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e"
Jul 10 14:33:48.274723 ip-10-0-137-35 kubenswrapper[2570]: E0710 14:33:48.274706    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e\": container with ID starting with e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e not found: ID does not exist" containerID="e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e"
Jul 10 14:33:48.274791 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.274731    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e"} err="failed to get container status \"e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e\": rpc error: code = NotFound desc = could not find container \"e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e\": container with ID starting with e29dc3dd33e00de587a0ecd61fd4561916809f47a09ca9fae69b512fe3edf02e not found: ID does not exist"
Jul 10 14:33:48.288517 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.288493    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"]
Jul 10 14:33:48.292879 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:48.292860    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/sub-test-model-e5410e-kserve-859cdfd7f-hsb9n"]
Jul 10 14:33:49.229497 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:49.229469    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:49.229497 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:49.229511    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:49.243890 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:49.243863    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:49.281965 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:49.281940    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:33:49.571059 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:33:49.570982    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb362bdd-15e6-47c0-970b-077eb4c9e527" path="/var/lib/kubelet/pods/bb362bdd-15e6-47c0-970b-077eb4c9e527/volumes"
Jul 10 14:34:00.914102 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.914068    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"]
Jul 10 14:34:00.914814 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.914795    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb362bdd-15e6-47c0-970b-077eb4c9e527" containerName="main"
Jul 10 14:34:00.914874 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.914818    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb362bdd-15e6-47c0-970b-077eb4c9e527" containerName="main"
Jul 10 14:34:00.914930 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.914918    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb362bdd-15e6-47c0-970b-077eb4c9e527" containerName="main"
Jul 10 14:34:00.918566 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.918543    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:00.921543 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.921523    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-47e604\"/\"openshift-service-ca.crt\""
Jul 10 14:34:00.922728 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.922684    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-47e604\"/\"kube-root-ca.crt\""
Jul 10 14:34:00.922908 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.922839    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-47e604\"/\"default-dockercfg-96rhq\""
Jul 10 14:34:00.922983 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.922697    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-47e604\"/\"rate-test-model-47e604-kserve-self-signed-certs\""
Jul 10 14:34:00.939101 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:00.939070    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"]
Jul 10 14:34:01.074501 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.074469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-dshm\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.074501 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.074503    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-tmp-dir\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.074694 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.074585    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91122a98-da40-48b3-a30c-64bc32dfd067-tls-certs\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.074694 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.074608    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns5xp\" (UniqueName: \"kubernetes.io/projected/91122a98-da40-48b3-a30c-64bc32dfd067-kube-api-access-ns5xp\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.074694 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.074630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-model-cache\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.074694 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.074653    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-home\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.175787 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.175687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-model-cache\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.175787 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.175733    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-home\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.175970 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.175811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-dshm\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.175970 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.175838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-tmp-dir\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.175970 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.175928    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91122a98-da40-48b3-a30c-64bc32dfd067-tls-certs\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.176113 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.176065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns5xp\" (UniqueName: \"kubernetes.io/projected/91122a98-da40-48b3-a30c-64bc32dfd067-kube-api-access-ns5xp\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.176215 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.176185    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-home\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.176344 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.176302    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-model-cache\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.176417 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.176352    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-tmp-dir\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.178487 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.178463    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91122a98-da40-48b3-a30c-64bc32dfd067-tls-certs\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.178598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.178467    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-dshm\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.186714 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.186693    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns5xp\" (UniqueName: \"kubernetes.io/projected/91122a98-da40-48b3-a30c-64bc32dfd067-kube-api-access-ns5xp\") pod \"rate-test-model-47e604-kserve-cbbf896b7-dk659\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") " pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.230479 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.230457    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:01.371369 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:01.371338    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"]
Jul 10 14:34:01.371531 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:34:01.371466    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91122a98_da40_48b3_a30c_64bc32dfd067.slice/crio-e65ddb19c32dc4b573fc892977f2f608bb7cabd386af177f1ce77ddb62b8cb7c WatchSource:0}: Error finding container e65ddb19c32dc4b573fc892977f2f608bb7cabd386af177f1ce77ddb62b8cb7c: Status 404 returned error can't find the container with id e65ddb19c32dc4b573fc892977f2f608bb7cabd386af177f1ce77ddb62b8cb7c
Jul 10 14:34:02.354970 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:02.354930    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659" event={"ID":"91122a98-da40-48b3-a30c-64bc32dfd067","Type":"ContainerStarted","Data":"3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543"}
Jul 10 14:34:02.355422 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:02.354982    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659" event={"ID":"91122a98-da40-48b3-a30c-64bc32dfd067","Type":"ContainerStarted","Data":"e65ddb19c32dc4b573fc892977f2f608bb7cabd386af177f1ce77ddb62b8cb7c"}
Jul 10 14:34:02.377799 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:02.377738    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659" podStartSLOduration=2.377723487 podStartE2EDuration="2.377723487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:34:02.375068024 +0000 UTC m=+2651.292112289" watchObservedRunningTime="2026-07-10 14:34:02.377723487 +0000 UTC m=+2651.294767750"
Jul 10 14:34:11.230588 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:11.230554    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:11.231041 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:11.230604    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:11.245800 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:11.245778    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:11.423290 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:11.423257    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:34:45.197979 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:45.197900    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"]
Jul 10 14:34:45.999911 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:45.999878    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"]
Jul 10 14:34:53.928494 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:53.928368    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:34:53.945406 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:34:53.945381    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjz4r_4f39dfb1-4d93-4c39-8ea9-db64ca0beab7/ovn-acl-logging/0.log"
Jul 10 14:35:00.217906 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.217864    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f" podUID="a057b201-9e32-4f3a-be3f-449d8e2dc686" containerName="main" containerID="cri-o://11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f" gracePeriod=45
Jul 10 14:35:00.478691 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.478638    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:35:00.584203 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584168    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-tmp-dir\") pod \"a057b201-9e32-4f3a-be3f-449d8e2dc686\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") "
Jul 10 14:35:00.584348 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584254    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-model-cache\") pod \"a057b201-9e32-4f3a-be3f-449d8e2dc686\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") "
Jul 10 14:35:00.584348 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584296    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-home\") pod \"a057b201-9e32-4f3a-be3f-449d8e2dc686\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") "
Jul 10 14:35:00.584348 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584330    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8wpl\" (UniqueName: \"kubernetes.io/projected/a057b201-9e32-4f3a-be3f-449d8e2dc686-kube-api-access-z8wpl\") pod \"a057b201-9e32-4f3a-be3f-449d8e2dc686\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") "
Jul 10 14:35:00.584521 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584377    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a057b201-9e32-4f3a-be3f-449d8e2dc686-tls-certs\") pod \"a057b201-9e32-4f3a-be3f-449d8e2dc686\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") "
Jul 10 14:35:00.584521 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584406    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-dshm\") pod \"a057b201-9e32-4f3a-be3f-449d8e2dc686\" (UID: \"a057b201-9e32-4f3a-be3f-449d8e2dc686\") "
Jul 10 14:35:00.584521 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584404    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a057b201-9e32-4f3a-be3f-449d8e2dc686" (UID: "a057b201-9e32-4f3a-be3f-449d8e2dc686"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:35:00.584521 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584478    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-home" (OuterVolumeSpecName: "home") pod "a057b201-9e32-4f3a-be3f-449d8e2dc686" (UID: "a057b201-9e32-4f3a-be3f-449d8e2dc686"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:35:00.584684 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584523    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-model-cache" (OuterVolumeSpecName: "model-cache") pod "a057b201-9e32-4f3a-be3f-449d8e2dc686" (UID: "a057b201-9e32-4f3a-be3f-449d8e2dc686"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:35:00.584722 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584684    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:00.584722 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584705    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:00.584815 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.584722    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:00.586427 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.586403    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a057b201-9e32-4f3a-be3f-449d8e2dc686-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a057b201-9e32-4f3a-be3f-449d8e2dc686" (UID: "a057b201-9e32-4f3a-be3f-449d8e2dc686"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:35:00.586427 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.586416    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a057b201-9e32-4f3a-be3f-449d8e2dc686-kube-api-access-z8wpl" (OuterVolumeSpecName: "kube-api-access-z8wpl") pod "a057b201-9e32-4f3a-be3f-449d8e2dc686" (UID: "a057b201-9e32-4f3a-be3f-449d8e2dc686"). InnerVolumeSpecName "kube-api-access-z8wpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:35:00.586598 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.586409    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-dshm" (OuterVolumeSpecName: "dshm") pod "a057b201-9e32-4f3a-be3f-449d8e2dc686" (UID: "a057b201-9e32-4f3a-be3f-449d8e2dc686"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:35:00.685689 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.685661    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8wpl\" (UniqueName: \"kubernetes.io/projected/a057b201-9e32-4f3a-be3f-449d8e2dc686-kube-api-access-z8wpl\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:00.685689 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.685688    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a057b201-9e32-4f3a-be3f-449d8e2dc686-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:00.685865 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.685703    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a057b201-9e32-4f3a-be3f-449d8e2dc686-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:00.701991 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.701962    2570 generic.go:356] "Generic (PLEG): container finished" podID="a057b201-9e32-4f3a-be3f-449d8e2dc686" containerID="11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f" exitCode=0
Jul 10 14:35:00.702089 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.702009    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"
Jul 10 14:35:00.702089 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.702052    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f" event={"ID":"a057b201-9e32-4f3a-be3f-449d8e2dc686","Type":"ContainerDied","Data":"11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f"}
Jul 10 14:35:00.702162 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.702090    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f" event={"ID":"a057b201-9e32-4f3a-be3f-449d8e2dc686","Type":"ContainerDied","Data":"64b4597efd215ab2b80b5d86f24856e6d031df1ddf2da6080138f8ecc362dab2"}
Jul 10 14:35:00.702162 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.702107    2570 scope.go:117] "RemoveContainer" containerID="11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f"
Jul 10 14:35:00.713348 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.713325    2570 scope.go:117] "RemoveContainer" containerID="11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f"
Jul 10 14:35:00.713714 ip-10-0-137-35 kubenswrapper[2570]: E0710 14:35:00.713683    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f\": container with ID starting with 11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f not found: ID does not exist" containerID="11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f"
Jul 10 14:35:00.713820 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.713725    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f"} err="failed to get container status \"11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f\": rpc error: code = NotFound desc = could not find container \"11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f\": container with ID starting with 11d1c2b35954f321344a0602cebd2f43581580c88c74165863b285ef5c323f2f not found: ID does not exist"
Jul 10 14:35:00.734090 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.734041    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"]
Jul 10 14:35:00.740917 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:00.740886    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e5410e/rate-test-model-e5410e-kserve-7565955bb7-7p77f"]
Jul 10 14:35:01.020874 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.020771    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659" podUID="91122a98-da40-48b3-a30c-64bc32dfd067" containerName="main" containerID="cri-o://3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543" gracePeriod=45
Jul 10 14:35:01.273319 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.273258    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:35:01.392725 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.392694    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-dshm\") pod \"91122a98-da40-48b3-a30c-64bc32dfd067\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") "
Jul 10 14:35:01.392908 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.392734    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns5xp\" (UniqueName: \"kubernetes.io/projected/91122a98-da40-48b3-a30c-64bc32dfd067-kube-api-access-ns5xp\") pod \"91122a98-da40-48b3-a30c-64bc32dfd067\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") "
Jul 10 14:35:01.392908 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.392820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-home\") pod \"91122a98-da40-48b3-a30c-64bc32dfd067\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") "
Jul 10 14:35:01.393057 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.393037    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-tmp-dir\") pod \"91122a98-da40-48b3-a30c-64bc32dfd067\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") "
Jul 10 14:35:01.393118 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.393085    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91122a98-da40-48b3-a30c-64bc32dfd067-tls-certs\") pod \"91122a98-da40-48b3-a30c-64bc32dfd067\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") "
Jul 10 14:35:01.393118 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.393088    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-home" (OuterVolumeSpecName: "home") pod "91122a98-da40-48b3-a30c-64bc32dfd067" (UID: "91122a98-da40-48b3-a30c-64bc32dfd067"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:35:01.393229 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.393126    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-model-cache\") pod \"91122a98-da40-48b3-a30c-64bc32dfd067\" (UID: \"91122a98-da40-48b3-a30c-64bc32dfd067\") "
Jul 10 14:35:01.393294 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.393259    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91122a98-da40-48b3-a30c-64bc32dfd067" (UID: "91122a98-da40-48b3-a30c-64bc32dfd067"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:35:01.393446 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.393418    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-model-cache" (OuterVolumeSpecName: "model-cache") pod "91122a98-da40-48b3-a30c-64bc32dfd067" (UID: "91122a98-da40-48b3-a30c-64bc32dfd067"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:35:01.393490 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.393480    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:01.393528 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.393498    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:01.395009 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.394983    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-dshm" (OuterVolumeSpecName: "dshm") pod "91122a98-da40-48b3-a30c-64bc32dfd067" (UID: "91122a98-da40-48b3-a30c-64bc32dfd067"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:35:01.395386 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.395358    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91122a98-da40-48b3-a30c-64bc32dfd067-kube-api-access-ns5xp" (OuterVolumeSpecName: "kube-api-access-ns5xp") pod "91122a98-da40-48b3-a30c-64bc32dfd067" (UID: "91122a98-da40-48b3-a30c-64bc32dfd067"). InnerVolumeSpecName "kube-api-access-ns5xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:35:01.395386 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.395354    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91122a98-da40-48b3-a30c-64bc32dfd067-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91122a98-da40-48b3-a30c-64bc32dfd067" (UID: "91122a98-da40-48b3-a30c-64bc32dfd067"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:35:01.494184 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.494149    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91122a98-da40-48b3-a30c-64bc32dfd067-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:01.494184 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.494179    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:01.494184 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.494187    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91122a98-da40-48b3-a30c-64bc32dfd067-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:01.494505 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.494197    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns5xp\" (UniqueName: \"kubernetes.io/projected/91122a98-da40-48b3-a30c-64bc32dfd067-kube-api-access-ns5xp\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:01.566023 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.565946    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a057b201-9e32-4f3a-be3f-449d8e2dc686" path="/var/lib/kubelet/pods/a057b201-9e32-4f3a-be3f-449d8e2dc686/volumes"
Jul 10 14:35:01.710613 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.710573    2570 generic.go:356] "Generic (PLEG): container finished" podID="91122a98-da40-48b3-a30c-64bc32dfd067" containerID="3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543" exitCode=0
Jul 10 14:35:01.710800 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.710618    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"
Jul 10 14:35:01.710800 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.710646    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659" event={"ID":"91122a98-da40-48b3-a30c-64bc32dfd067","Type":"ContainerDied","Data":"3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543"}
Jul 10 14:35:01.710800 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.710681    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659" event={"ID":"91122a98-da40-48b3-a30c-64bc32dfd067","Type":"ContainerDied","Data":"e65ddb19c32dc4b573fc892977f2f608bb7cabd386af177f1ce77ddb62b8cb7c"}
Jul 10 14:35:01.710800 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.710703    2570 scope.go:117] "RemoveContainer" containerID="3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543"
Jul 10 14:35:01.719838 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.719816    2570 scope.go:117] "RemoveContainer" containerID="3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543"
Jul 10 14:35:01.720089 ip-10-0-137-35 kubenswrapper[2570]: E0710 14:35:01.720066    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543\": container with ID starting with 3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543 not found: ID does not exist" containerID="3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543"
Jul 10 14:35:01.720154 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.720096    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543"} err="failed to get container status \"3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543\": rpc error: code = NotFound desc = could not find container \"3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543\": container with ID starting with 3a855046c1edc77e074ba1361f1ccad77e90fb16665325fe5b8e9d5e4d2db543 not found: ID does not exist"
Jul 10 14:35:01.731751 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.731723    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"]
Jul 10 14:35:01.736009 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:01.735990    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-47e604/rate-test-model-47e604-kserve-cbbf896b7-dk659"]
Jul 10 14:35:02.170063 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.170029    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7289-140576863133536"]
Jul 10 14:35:02.170458 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.170437    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a057b201-9e32-4f3a-be3f-449d8e2dc686" containerName="main"
Jul 10 14:35:02.170506 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.170461    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a057b201-9e32-4f3a-be3f-449d8e2dc686" containerName="main"
Jul 10 14:35:02.170506 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.170470    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91122a98-da40-48b3-a30c-64bc32dfd067" containerName="main"
Jul 10 14:35:02.170506 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.170475    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="91122a98-da40-48b3-a30c-64bc32dfd067" containerName="main"
Jul 10 14:35:02.170597 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.170557    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a057b201-9e32-4f3a-be3f-449d8e2dc686" containerName="main"
Jul 10 14:35:02.170597 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.170565    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="91122a98-da40-48b3-a30c-64bc32dfd067" containerName="main"
Jul 10 14:35:02.175239 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.175215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7289-140576863133536"
Jul 10 14:35:02.177680 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.177663    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-5dfxb\""
Jul 10 14:35:02.187200 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.187177    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7289-140576863133536"]
Jul 10 14:35:02.301796 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.301740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zktpb\" (UniqueName: \"kubernetes.io/projected/5028105c-114a-4efa-a883-701501b475e4-kube-api-access-zktpb\") pod \"test-curl-7289-140576863133536\" (UID: \"5028105c-114a-4efa-a883-701501b475e4\") " pod="openshift-ingress/test-curl-7289-140576863133536"
Jul 10 14:35:02.402648 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.402621    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zktpb\" (UniqueName: \"kubernetes.io/projected/5028105c-114a-4efa-a883-701501b475e4-kube-api-access-zktpb\") pod \"test-curl-7289-140576863133536\" (UID: \"5028105c-114a-4efa-a883-701501b475e4\") " pod="openshift-ingress/test-curl-7289-140576863133536"
Jul 10 14:35:02.411987 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.411955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zktpb\" (UniqueName: \"kubernetes.io/projected/5028105c-114a-4efa-a883-701501b475e4-kube-api-access-zktpb\") pod \"test-curl-7289-140576863133536\" (UID: \"5028105c-114a-4efa-a883-701501b475e4\") " pod="openshift-ingress/test-curl-7289-140576863133536"
Jul 10 14:35:02.484655 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.484631    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7289-140576863133536"
Jul 10 14:35:02.617421 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.617396    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7289-140576863133536"]
Jul 10 14:35:02.618853 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:35:02.618823    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5028105c_114a_4efa_a883_701501b475e4.slice/crio-d02e069445adf59bd5153f0be31832aab665a93172c2e14ac788258d3f409809 WatchSource:0}: Error finding container d02e069445adf59bd5153f0be31832aab665a93172c2e14ac788258d3f409809: Status 404 returned error can't find the container with id d02e069445adf59bd5153f0be31832aab665a93172c2e14ac788258d3f409809
Jul 10 14:35:02.620124 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.620104    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:35:02.718675 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:02.718635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7289-140576863133536" event={"ID":"5028105c-114a-4efa-a883-701501b475e4","Type":"ContainerStarted","Data":"d02e069445adf59bd5153f0be31832aab665a93172c2e14ac788258d3f409809"}
Jul 10 14:35:03.565941 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:03.565864    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91122a98-da40-48b3-a30c-64bc32dfd067" path="/var/lib/kubelet/pods/91122a98-da40-48b3-a30c-64bc32dfd067/volumes"
Jul 10 14:35:03.729896 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:03.729860    2570 generic.go:356] "Generic (PLEG): container finished" podID="5028105c-114a-4efa-a883-701501b475e4" containerID="64357dd81061e063ea0412a8ba5399efdf6e6f71cbd1da34b35e4fb7716fce58" exitCode=0
Jul 10 14:35:03.730034 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:03.729922    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7289-140576863133536" event={"ID":"5028105c-114a-4efa-a883-701501b475e4","Type":"ContainerDied","Data":"64357dd81061e063ea0412a8ba5399efdf6e6f71cbd1da34b35e4fb7716fce58"}
Jul 10 14:35:04.879595 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:04.879568    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7289-140576863133536"
Jul 10 14:35:04.917271 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:04.917236    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7289-140576863133536_5028105c-114a-4efa-a883-701501b475e4/test-curl-7289-140576863133536/0.log"
Jul 10 14:35:04.945596 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:04.945566    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7289-140576863133536"]
Jul 10 14:35:04.949141 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:04.949113    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7289-140576863133536"]
Jul 10 14:35:05.027079 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:05.027004    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zktpb\" (UniqueName: \"kubernetes.io/projected/5028105c-114a-4efa-a883-701501b475e4-kube-api-access-zktpb\") pod \"5028105c-114a-4efa-a883-701501b475e4\" (UID: \"5028105c-114a-4efa-a883-701501b475e4\") "
Jul 10 14:35:05.029137 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:05.029101    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5028105c-114a-4efa-a883-701501b475e4-kube-api-access-zktpb" (OuterVolumeSpecName: "kube-api-access-zktpb") pod "5028105c-114a-4efa-a883-701501b475e4" (UID: "5028105c-114a-4efa-a883-701501b475e4"). InnerVolumeSpecName "kube-api-access-zktpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:35:05.128630 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:05.128593    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zktpb\" (UniqueName: \"kubernetes.io/projected/5028105c-114a-4efa-a883-701501b475e4-kube-api-access-zktpb\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Jul 10 14:35:05.572650 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:05.572606    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5028105c-114a-4efa-a883-701501b475e4" path="/var/lib/kubelet/pods/5028105c-114a-4efa-a883-701501b475e4/volumes"
Jul 10 14:35:05.743587 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:05.743557    2570 scope.go:117] "RemoveContainer" containerID="64357dd81061e063ea0412a8ba5399efdf6e6f71cbd1da34b35e4fb7716fce58"
Jul 10 14:35:05.743762 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:35:05.743569    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7289-140576863133536"
Jul 10 14:36:02.725117 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:02.725080    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lthcp_6e6284d2-b576-406c-a78c-c2f0687dead6/manager/0.log"
Jul 10 14:36:02.852105 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:02.852071    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qq62w_bb2085e6-52eb-43b0-bd70-ef30a9f0727f/manager/0.log"
Jul 10 14:36:02.980836 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:02.980734    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55bb89bdd-hc5k9_3e23fc1e-b600-4902-ae7e-5c0c97656c03/manager/0.log"
Jul 10 14:36:03.591199 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:03.591174    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545b4db9db-z5tc9_0cde7be0-bb25-42fa-b0a1-01bb72442734/copy-manifests/0.log"
Jul 10 14:36:03.599125 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:03.599077    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545b4db9db-z5tc9_0cde7be0-bb25-42fa-b0a1-01bb72442734/manager/0.log"
Jul 10 14:36:03.968294 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:03.968264    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-796c584757-9tvg7_719414ca-0c64-4a33-bb51-6319c99d50ca/maas-api/0.log"
Jul 10 14:36:04.507774 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:04.507734    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-7beb38-4m5bw_8ba34eeb-3dc0-468d-852c-f8fb0779a036/revoke-keys/0.log"
Jul 10 14:36:04.949590 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:04.949563    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-e3d9d1-gx492_28ad0655-fcc5-4687-9625-a057e91d7c16/revoke-keys/0.log"
Jul 10 14:36:05.517083 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:05.517043    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-j9nzc_6990b1b9-1a4a-4458-a499-ba8db6636c3c/postgres/0.log"
Jul 10 14:36:06.286057 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.286020    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6_733fc345-1153-431f-a9c0-c3e3bc6bb192/util/0.log"
Jul 10 14:36:06.292893 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.292866    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6_733fc345-1153-431f-a9c0-c3e3bc6bb192/pull/0.log"
Jul 10 14:36:06.299450 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.299429    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6_733fc345-1153-431f-a9c0-c3e3bc6bb192/extract/0.log"
Jul 10 14:36:06.414526 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.414504    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc_c3dcc56f-8cc1-4878-b983-a9f36de788dd/util/0.log"
Jul 10 14:36:06.420919 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.420897    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc_c3dcc56f-8cc1-4878-b983-a9f36de788dd/pull/0.log"
Jul 10 14:36:06.428079 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.428062    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc_c3dcc56f-8cc1-4878-b983-a9f36de788dd/extract/0.log"
Jul 10 14:36:06.542467 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.542392    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb_9b2948fe-4932-4e1f-b62c-b5452d865d6a/pull/0.log"
Jul 10 14:36:06.549809 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.549789    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb_9b2948fe-4932-4e1f-b62c-b5452d865d6a/extract/0.log"
Jul 10 14:36:06.556525 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.556504    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb_9b2948fe-4932-4e1f-b62c-b5452d865d6a/util/0.log"
Jul 10 14:36:06.671836 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.671814    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb_a2bedd52-f074-4c17-9706-bd8699585559/extract/0.log"
Jul 10 14:36:06.678324 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.678305    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb_a2bedd52-f074-4c17-9706-bd8699585559/util/0.log"
Jul 10 14:36:06.685131 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.685110    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb_a2bedd52-f074-4c17-9706-bd8699585559/pull/0.log"
Jul 10 14:36:06.924945 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:06.924880    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-msm95_9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d/manager/0.log"
Jul 10 14:36:07.037283 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:07.037253    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hcs26_e9fa8974-9bb3-434c-b059-e4c8be330c00/manager/0.log"
Jul 10 14:36:07.279105 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:07.279072    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6jwv7_f256bfaa-1d4a-47b2-a6c0-93a6a1248f42/registry-server/0.log"
Jul 10 14:36:07.416720 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:07.416688    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-w92nl_fd98421e-26fd-4261-bfb1-ee054bff1ee1/manager/0.log"
Jul 10 14:36:07.681969 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:07.681899    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d9bql_c5d55f70-0b69-481d-a828-84f3ac5eb024/manager/0.log"
Jul 10 14:36:08.372999 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:08.372966    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9db8d9c-sdr7p_f2b7856f-8704-4a74-83b7-a86037deeb1b/kube-auth-proxy/0.log"
Jul 10 14:36:08.611659 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:08.611629    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h2h96_33227a06-da0c-450e-8581-f9bfa6dcc1e8/payload-pre-processing/0.log"
Jul 10 14:36:08.740280 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:08.740250    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5vgkx_312d4b84-85a0-4ae6-b991-897acfefdf2f/payload-processing/0.log"
Jul 10 14:36:08.851561 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:08.851530    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5775766-brv7z_d60bfbb9-096b-4bec-bc9d-0e8359dc1381/router/0.log"
Jul 10 14:36:09.196541 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:09.196457    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-jkpmh_db781036-d853-4152-8d03-b95b13c87308/main/0.log"
Jul 10 14:36:09.432040 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:09.432003    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pvk78_43f16045-3166-4725-a7a2-55f18dedcdc8/main/0.log"
Jul 10 14:36:09.552679 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:09.552643    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqzsp5_8412d7bf-a41e-46eb-9d30-2f5d86e610c6/main/0.log"
Jul 10 14:36:09.793533 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:09.793500    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-fhjjb_fe7740b8-2513-46e6-92fd-ce41d491e220/main/0.log"
Jul 10 14:36:17.191278 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:17.191203    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sk4fp_40cfbc71-878d-418c-945e-2295a16948a4/global-pull-secret-syncer/0.log"
Jul 10 14:36:17.340847 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:17.340813    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6h9h8_5f2b8453-b037-4092-beb7-f36d13e7fae0/konnectivity-agent/0.log"
Jul 10 14:36:17.426527 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:17.426495    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-35.ec2.internal_e80e9c091ef9e35f91bb75e55dd39ae0/haproxy/0.log"
Jul 10 14:36:22.020293 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.020267    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6_733fc345-1153-431f-a9c0-c3e3bc6bb192/extract/0.log"
Jul 10 14:36:22.047575 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.047542    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6_733fc345-1153-431f-a9c0-c3e3bc6bb192/util/0.log"
Jul 10 14:36:22.071154 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.071122    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599bbw6_733fc345-1153-431f-a9c0-c3e3bc6bb192/pull/0.log"
Jul 10 14:36:22.104575 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.104551    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc_c3dcc56f-8cc1-4878-b983-a9f36de788dd/extract/0.log"
Jul 10 14:36:22.126876 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.126856    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc_c3dcc56f-8cc1-4878-b983-a9f36de788dd/util/0.log"
Jul 10 14:36:22.152648 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.152625    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02d4wc_c3dcc56f-8cc1-4878-b983-a9f36de788dd/pull/0.log"
Jul 10 14:36:22.184664 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.184646    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb_9b2948fe-4932-4e1f-b62c-b5452d865d6a/extract/0.log"
Jul 10 14:36:22.208726 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.208702    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb_9b2948fe-4932-4e1f-b62c-b5452d865d6a/util/0.log"
Jul 10 14:36:22.232259 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.232234    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738skhb_9b2948fe-4932-4e1f-b62c-b5452d865d6a/pull/0.log"
Jul 10 14:36:22.261369 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.261347    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb_a2bedd52-f074-4c17-9706-bd8699585559/extract/0.log"
Jul 10 14:36:22.286324 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.286267    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb_a2bedd52-f074-4c17-9706-bd8699585559/util/0.log"
Jul 10 14:36:22.321027 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.321005    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d8gsb_a2bedd52-f074-4c17-9706-bd8699585559/pull/0.log"
Jul 10 14:36:22.755210 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.755181    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-msm95_9a817fbe-f0c5-406e-9cf8-b0c5b01ac88d/manager/0.log"
Jul 10 14:36:22.779206 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.779180    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hcs26_e9fa8974-9bb3-434c-b059-e4c8be330c00/manager/0.log"
Jul 10 14:36:22.869883 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:22.869862    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6jwv7_f256bfaa-1d4a-47b2-a6c0-93a6a1248f42/registry-server/0.log"
Jul 10 14:36:23.062731 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:23.062652    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-w92nl_fd98421e-26fd-4261-bfb1-ee054bff1ee1/manager/0.log"
Jul 10 14:36:23.191296 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:23.191271    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d9bql_c5d55f70-0b69-481d-a828-84f3ac5eb024/manager/0.log"
Jul 10 14:36:25.255269 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:25.255242    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ddzpf_69b59a0c-00dc-4b3b-ab96-6d1f23d192e5/kube-state-metrics/0.log"
Jul 10 14:36:25.276021 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:25.275995    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ddzpf_69b59a0c-00dc-4b3b-ab96-6d1f23d192e5/kube-rbac-proxy-main/0.log"
Jul 10 14:36:25.301348 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:25.301322    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ddzpf_69b59a0c-00dc-4b3b-ab96-6d1f23d192e5/kube-rbac-proxy-self/0.log"
Jul 10 14:36:25.332572 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:25.332549    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b857cf7b4-f8gmn_14cb747a-4ea4-49ac-b8ea-e840fac8182a/metrics-server/0.log"
Jul 10 14:36:25.358576 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:25.358555    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-5h9ml_453e5acc-4503-444e-8a52-153b97524c47/monitoring-plugin/0.log"
Jul 10 14:36:25.396042 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:25.396019    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6vw4k_9ec5a3a3-777c-41b3-9c45-e04515b2307f/node-exporter/0.log"
Jul 10 14:36:25.435191 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:25.435168    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6vw4k_9ec5a3a3-777c-41b3-9c45-e04515b2307f/kube-rbac-proxy/0.log"
Jul 10 14:36:25.459822 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:25.459800    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6vw4k_9ec5a3a3-777c-41b3-9c45-e04515b2307f/init-textfile/0.log"
Jul 10 14:36:26.007874 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.007836    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-kg24x_e8be30c5-fef3-4c20-a779-0fb11b80973e/prometheus-operator/0.log"
Jul 10 14:36:26.028166 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.028136    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-kg24x_e8be30c5-fef3-4c20-a779-0fb11b80973e/kube-rbac-proxy/0.log"
Jul 10 14:36:26.055934 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.055904    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-nkrsc_32b75f97-8d75-48aa-8fac-c944c45672b8/prometheus-operator-admission-webhook/0.log"
Jul 10 14:36:26.167411 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.167381    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679b9f4fd-5hspq_f7b59335-aa85-42b3-83de-48367db43c47/thanos-query/0.log"
Jul 10 14:36:26.192469 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.192441    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679b9f4fd-5hspq_f7b59335-aa85-42b3-83de-48367db43c47/kube-rbac-proxy-web/0.log"
Jul 10 14:36:26.219445 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.219399    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679b9f4fd-5hspq_f7b59335-aa85-42b3-83de-48367db43c47/kube-rbac-proxy/0.log"
Jul 10 14:36:26.241217 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.241194    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679b9f4fd-5hspq_f7b59335-aa85-42b3-83de-48367db43c47/prom-label-proxy/0.log"
Jul 10 14:36:26.262689 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.262627    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679b9f4fd-5hspq_f7b59335-aa85-42b3-83de-48367db43c47/kube-rbac-proxy-rules/0.log"
Jul 10 14:36:26.286121 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:26.286098    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679b9f4fd-5hspq_f7b59335-aa85-42b3-83de-48367db43c47/kube-rbac-proxy-metrics/0.log"
Jul 10 14:36:27.302911 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.302877    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"]
Jul 10 14:36:27.303417 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.303401    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5028105c-114a-4efa-a883-701501b475e4" containerName="test-curl-7289-140576863133536"
Jul 10 14:36:27.303461 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.303418    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5028105c-114a-4efa-a883-701501b475e4" containerName="test-curl-7289-140576863133536"
Jul 10 14:36:27.303506 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.303497    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5028105c-114a-4efa-a883-701501b475e4" containerName="test-curl-7289-140576863133536"
Jul 10 14:36:27.306972 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.306954    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.310251 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.310230    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2vrfh\"/\"default-dockercfg-cn9ln\""
Jul 10 14:36:27.310373 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.310230    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2vrfh\"/\"kube-root-ca.crt\""
Jul 10 14:36:27.310871 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.310855    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2vrfh\"/\"openshift-service-ca.crt\""
Jul 10 14:36:27.323776 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.323737    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"]
Jul 10 14:36:27.337148 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.337123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-sys\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.337270 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.337162    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvf9t\" (UniqueName: \"kubernetes.io/projected/9966ba19-e6da-47db-a108-cd68d86ed9ea-kube-api-access-gvf9t\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.337270 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.337192    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-proc\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.337347 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.337282    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-lib-modules\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.337347 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.337299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-podres\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.437766 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.437719    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-sys\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.437938 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.437786    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvf9t\" (UniqueName: \"kubernetes.io/projected/9966ba19-e6da-47db-a108-cd68d86ed9ea-kube-api-access-gvf9t\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.437938 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.437819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-proc\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.437938 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.437849    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-sys\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.437938 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.437884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-lib-modules\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.437938 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.437900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-podres\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.437938 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.437925    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-proc\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.438212 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.438020    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-podres\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.438212 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.438045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9966ba19-e6da-47db-a108-cd68d86ed9ea-lib-modules\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.450505 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.450478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvf9t\" (UniqueName: \"kubernetes.io/projected/9966ba19-e6da-47db-a108-cd68d86ed9ea-kube-api-access-gvf9t\") pod \"perf-node-gather-daemonset-9hnxx\" (UID: \"9966ba19-e6da-47db-a108-cd68d86ed9ea\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.515604 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.515583    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-2p6n8_490c5a67-536c-4f73-aaa0-f126bf339d02/networking-console-plugin/0.log"
Jul 10 14:36:27.617229 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.617171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:27.756191 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:27.756165    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"]
Jul 10 14:36:27.758368 ip-10-0-137-35 kubenswrapper[2570]: W0710 14:36:27.758340    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9966ba19_e6da_47db_a108_cd68d86ed9ea.slice/crio-dd8835a8e11558d618f0f508c669db4bad60908345f4d9c933d0b17c1796f3a2 WatchSource:0}: Error finding container dd8835a8e11558d618f0f508c669db4bad60908345f4d9c933d0b17c1796f3a2: Status 404 returned error can't find the container with id dd8835a8e11558d618f0f508c669db4bad60908345f4d9c933d0b17c1796f3a2
Jul 10 14:36:28.233703 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:28.233668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx" event={"ID":"9966ba19-e6da-47db-a108-cd68d86ed9ea","Type":"ContainerStarted","Data":"001d47a31a1ce050d13647726ea528461fb2479918a001e8b5fbabb1d7a42a0d"}
Jul 10 14:36:28.233889 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:28.233724    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx" event={"ID":"9966ba19-e6da-47db-a108-cd68d86ed9ea","Type":"ContainerStarted","Data":"dd8835a8e11558d618f0f508c669db4bad60908345f4d9c933d0b17c1796f3a2"}
Jul 10 14:36:28.233889 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:28.233792    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:28.260991 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:28.260944    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx" podStartSLOduration=1.260930184 podStartE2EDuration="1.260930184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:36:28.259516705 +0000 UTC m=+2797.176560968" watchObservedRunningTime="2026-07-10 14:36:28.260930184 +0000 UTC m=+2797.177974631"
Jul 10 14:36:28.833412 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:28.833383    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-755854dc8d-dgs82_1f519337-77c8-4d01-ae0d-f3e1936885e5/console/0.log"
Jul 10 14:36:28.891626 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:28.891580    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-x2jp8_b60ba0d4-2bda-4165-99cc-fe7d200d9aaf/download-server/0.log"
Jul 10 14:36:30.747933 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:30.747900    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cg7wr_b5fb2df7-1f6c-494a-8938-5ab22fc38cb3/dns/0.log"
Jul 10 14:36:30.773798 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:30.773771    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cg7wr_b5fb2df7-1f6c-494a-8938-5ab22fc38cb3/kube-rbac-proxy/0.log"
Jul 10 14:36:30.914645 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:30.914619    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4bdfh_15689ad4-e290-448d-829a-d3ed091b3f1d/dns-node-resolver/0.log"
Jul 10 14:36:31.672452 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:31.672423    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nb27n_b18c367d-8164-49e8-a5e0-22e6759da098/node-ca/0.log"
Jul 10 14:36:32.902281 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:32.902257    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9db8d9c-sdr7p_f2b7856f-8704-4a74-83b7-a86037deeb1b/kube-auth-proxy/0.log"
Jul 10 14:36:33.019002 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:33.018970    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h2h96_33227a06-da0c-450e-8581-f9bfa6dcc1e8/payload-pre-processing/0.log"
Jul 10 14:36:33.061293 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:33.061266    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5vgkx_312d4b84-85a0-4ae6-b991-897acfefdf2f/payload-processing/0.log"
Jul 10 14:36:33.092023 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:33.091999    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5775766-brv7z_d60bfbb9-096b-4bec-bc9d-0e8359dc1381/router/0.log"
Jul 10 14:36:34.036012 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:34.035982    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbtl9_9b2471f5-2960-4f0b-aa67-d6a016d9b6d3/serve-healthcheck-canary/0.log"
Jul 10 14:36:34.249411 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:34.249385    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-9hnxx"
Jul 10 14:36:34.723307 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:34.723278    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8sxd6_41cd8e57-350c-4802-8811-12561af5b788/kube-rbac-proxy/0.log"
Jul 10 14:36:34.750157 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:34.750134    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8sxd6_41cd8e57-350c-4802-8811-12561af5b788/exporter/0.log"
Jul 10 14:36:34.779662 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:34.779623    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8sxd6_41cd8e57-350c-4802-8811-12561af5b788/extractor/0.log"
Jul 10 14:36:37.387840 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:37.387769    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lthcp_6e6284d2-b576-406c-a78c-c2f0687dead6/manager/0.log"
Jul 10 14:36:37.638574 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:37.638493    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qq62w_bb2085e6-52eb-43b0-bd70-ef30a9f0727f/manager/0.log"
Jul 10 14:36:37.800107 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:37.800079    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55bb89bdd-hc5k9_3e23fc1e-b600-4902-ae7e-5c0c97656c03/manager/0.log"
Jul 10 14:36:38.067634 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:38.067599    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9db8d9c-sdr7p_f2b7856f-8704-4a74-83b7-a86037deeb1b/kube-auth-proxy/0.log"
Jul 10 14:36:38.116854 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:38.116823    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545b4db9db-z5tc9_0cde7be0-bb25-42fa-b0a1-01bb72442734/manager/0.log"
Jul 10 14:36:38.153099 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:38.153073    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545b4db9db-z5tc9_0cde7be0-bb25-42fa-b0a1-01bb72442734/copy-manifests/0.log"
Jul 10 14:36:38.156864 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:38.156842    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h2h96_33227a06-da0c-450e-8581-f9bfa6dcc1e8/payload-pre-processing/0.log"
Jul 10 14:36:38.185424 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:38.185378    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5vgkx_312d4b84-85a0-4ae6-b991-897acfefdf2f/payload-processing/0.log"
Jul 10 14:36:38.206585 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:38.206563    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5775766-brv7z_d60bfbb9-096b-4bec-bc9d-0e8359dc1381/router/0.log"
Jul 10 14:36:39.773898 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:39.773867    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9db8d9c-sdr7p_f2b7856f-8704-4a74-83b7-a86037deeb1b/kube-auth-proxy/0.log"
Jul 10 14:36:39.892621 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:39.892589    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h2h96_33227a06-da0c-450e-8581-f9bfa6dcc1e8/payload-pre-processing/0.log"
Jul 10 14:36:39.946668 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:39.946611    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5vgkx_312d4b84-85a0-4ae6-b991-897acfefdf2f/payload-processing/0.log"
Jul 10 14:36:39.969896 ip-10-0-137-35 kubenswrapper[2570]: I0710 14:36:39.969870    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5775766-brv7z_d60bfbb9-096b-4bec-bc9d-0e8359dc1381/router/0.log"