Jul 24 12:50:46.041481 ip-10-0-134-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 12:50:46.041493 ip-10-0-134-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 12:50:46.041500 ip-10-0-134-90 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 12:50:46.041811 ip-10-0-134-90 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 12:50:56.248914 ip-10-0-134-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 12:50:56.248932 ip-10-0-134-90 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f4399bc41aa342c585f0d436af00d9e7 --
Jul 24 12:52:47.700817 ip-10-0-134-90 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 12:52:48.057530 ip-10-0-134-90 kubenswrapper[2528]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 12:52:48.057530 ip-10-0-134-90 kubenswrapper[2528]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 12:52:48.057530 ip-10-0-134-90 kubenswrapper[2528]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 12:52:48.057530 ip-10-0-134-90 kubenswrapper[2528]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 12:52:48.057530 ip-10-0-134-90 kubenswrapper[2528]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 12:52:48.059934 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.059863    2528 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 12:52:48.063998 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.063983    2528 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 12:52:48.063998 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.063998    2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064001    2528 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064005    2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064008    2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064011    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064014    2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064018    2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064020    2528 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064023    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064026    2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064028    2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064031    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064033    2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064036    2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064038    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064041    2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064043    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064045    2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064048    2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064050    2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 12:52:48.064070 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064053    2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064055    2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064058    2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064060    2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064062    2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064065    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064067    2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064069    2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064072    2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064075    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064077    2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064080    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064083    2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064086    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064088    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064090    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064093    2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064096    2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064098    2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064101    2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 12:52:48.064542 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064103    2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064105    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064107    2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064110    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064112    2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064114    2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064116    2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064119    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064121    2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064123    2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064126    2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064128    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064130    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064132    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064136    2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064139    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064141    2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064144    2528 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064147    2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064149    2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 12:52:48.065017 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064153    2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064157    2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064160    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064163    2528 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064165    2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064168    2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064171    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064173    2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064176    2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064178    2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064180    2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064184    2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064189    2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064191    2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064194    2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064196    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064199    2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064201    2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064204    2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064206    2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 12:52:48.065509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064208    2528 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064210    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064213    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064215    2528 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064218    2528 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064220    2528 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064223    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064226    2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064228    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064231    2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064234    2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064237    2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064240    2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064243    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064246    2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064248    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064251    2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064253    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064919    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 12:52:48.065996 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064925    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064928    2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064931    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064934    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064936    2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064939    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064942    2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064945    2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064948    2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064950    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064953    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064955    2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064958    2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064960    2528 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064963    2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064965    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064967    2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064970    2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064973    2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064976    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 12:52:48.066427 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064978    2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064981    2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064983    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064986    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064989    2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064991    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064993    2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064996    2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.064998    2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065000    2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065003    2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065005    2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065007    2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065010    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065012    2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065014    2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065016    2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065019    2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065022    2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 12:52:48.066920 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065024    2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065027    2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065031    2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065035    2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065038    2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065040    2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065043    2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065046    2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065048    2528 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065051    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065055    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065057    2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065060    2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065063    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065065    2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065067    2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065070    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065072    2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065074    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 12:52:48.067369 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065078    2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065081    2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065084    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065086    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065089    2528 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065091    2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065093    2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065096    2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065098    2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065100    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065103    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065106    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065108    2528 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065111    2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065113    2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065115    2528 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065118    2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065120    2528 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065123    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065126    2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 12:52:48.067837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065128    2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065131    2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065133    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065136    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065139    2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065143    2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065145    2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065147    2528 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065150    2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065152    2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065155    2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065157    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065159    2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065161    2528 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065164    2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065168    2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065171    2528 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065174    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065177    2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065179    2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 12:52:48.068304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065497    2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065501    2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065504    2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065506    2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065509    2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065512    2528 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065515    2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065517    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065520    2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065523    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065525    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065528    2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065530    2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065533    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065535    2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065539    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065541    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065545    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065548    2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065550    2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 12:52:48.068780 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065552    2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065555    2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065557    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065559    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065562    2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065579    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065582    2528 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065586    2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065590    2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065592    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065595    2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065598    2528 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065601    2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065603    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065606    2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065609    2528 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065611    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065615    2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065618    2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065621    2528 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 12:52:48.069252 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065623    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065625    2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065627    2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065630    2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065632    2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065635    2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065637    2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065641    2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065643    2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065646    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065649    2528 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065651    2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065654    2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065656    2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065658    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065661    2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065663    2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065665    2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065668    2528 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 12:52:48.069729 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065670    2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065673    2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065676    2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065678    2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065681    2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065683    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065685    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065688    2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065692    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065694    2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065697    2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065701    2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065704    2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065707    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065710    2528 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065713    2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065715    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065717    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065719    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 12:52:48.070168 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065722    2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065725    2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065728    2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065731    2528 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065734    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065736    2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065739    2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065741    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065743    2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065746    2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065748    2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065751    2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065753    2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065755    2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065758    2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065760    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065762    2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065764    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065767    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 12:52:48.070677 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065769    2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.065772    2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065846    2528 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065861    2528 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065870    2528 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065876    2528 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065883    2528 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065888    2528 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065892    2528 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065896    2528 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065898    2528 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065901    2528 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065904    2528 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065908    2528 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065912    2528 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065915    2528 flags.go:64] FLAG: --cgroup-root=""
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065919    2528 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065922    2528 flags.go:64] FLAG: --client-ca-file=""
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065924    2528 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065927    2528 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065930    2528 flags.go:64] FLAG: --cluster-domain=""
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065933    2528 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065936    2528 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065939    2528 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 12:52:48.071126 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065942    2528 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065945    2528 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065948    2528 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065951    2528 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065954    2528 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065957    2528 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065960    2528 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065962    2528 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065965    2528 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065968    2528 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065972    2528 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065974    2528 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065977    2528 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065980    2528 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065982    2528 flags.go:64] FLAG: --enable-server="true"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065985    2528 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065990    2528 flags.go:64] FLAG: --event-burst="100"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065992    2528 flags.go:64] FLAG: --event-qps="50"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065995    2528 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.065998    2528 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066001    2528 flags.go:64] FLAG: --eviction-hard=""
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066004    2528 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066008    2528 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066011    2528 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066015    2528 flags.go:64] FLAG: --eviction-soft=""
Jul 24 12:52:48.071701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066017    2528 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066020    2528 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066023    2528 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066025    2528 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066028    2528 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066030    2528 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066033    2528 flags.go:64] FLAG: --feature-gates=""
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066037    2528 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066039    2528 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066042    2528 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066045    2528 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066048    2528 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066050    2528 flags.go:64] FLAG: --help="false"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066053    2528 flags.go:64] FLAG: --hostname-override="ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066056    2528 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066058    2528 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066061    2528 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066064    2528 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066067    2528 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066070    2528 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066073    2528 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066075    2528 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066078    2528 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 12:52:48.072309 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066081    2528 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066084    2528 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066087    2528 flags.go:64] FLAG: --kube-reserved=""
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066089    2528 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066092    2528 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066095    2528 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066098    2528 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066101    2528 flags.go:64] FLAG: --lock-file=""
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066105    2528 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066107    2528 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066110    2528 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066115    2528 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066118    2528 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066120    2528 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066123    2528 flags.go:64] FLAG: --logging-format="text"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066126    2528 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066129    2528 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066132    2528 flags.go:64] FLAG: --manifest-url=""
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066135    2528 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066139    2528 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066142    2528 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066145    2528 flags.go:64] FLAG: --max-pods="110"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066148    2528 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066151    2528 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066153    2528 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 12:52:48.072889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066156    2528 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066159    2528 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066161    2528 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066164    2528 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066170    2528 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066173    2528 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066176    2528 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066179    2528 flags.go:64] FLAG: --pod-cidr=""
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066182    2528 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066187    2528 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066189    2528 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066192    2528 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066195    2528 flags.go:64] FLAG: --port="10250"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066197    2528 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066201    2528 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00243b449dfe56223"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066205    2528 flags.go:64] FLAG: --qos-reserved=""
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066208    2528 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066210    2528 flags.go:64] FLAG: --register-node="true"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066213    2528 flags.go:64] FLAG: --register-with-taints=""
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066216    2528 flags.go:64] FLAG: --registry-burst="10"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066219    2528 flags.go:64] FLAG: --registry-qps="5"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066222    2528 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066224    2528 flags.go:64] FLAG: --reserved-memory=""
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066228    2528 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066231    2528 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 12:52:48.073469 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066233    2528 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066236    2528 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066239    2528 flags.go:64] FLAG: --runonce="false"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066241    2528 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066244    2528 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066246    2528 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066249    2528 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066252    2528 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066254    2528 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066257    2528 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066260    2528 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066263    2528 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066265    2528 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066268    2528 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066270    2528 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066273    2528 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066276    2528 flags.go:64] FLAG: --system-cgroups=""
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066279    2528 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066283    2528 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066286    2528 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066288    2528 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066294    2528 flags.go:64] FLAG: --tls-min-version=""
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066298    2528 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066301    2528 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066303    2528 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 12:52:48.074059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066306    2528 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066309    2528 flags.go:64] FLAG: --v="2"
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066312    2528 flags.go:64] FLAG: --version="false"
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066316    2528 flags.go:64] FLAG: --vmodule=""
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066319    2528 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.066322    2528 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066423    2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066426    2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066429    2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066432    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066435    2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066438    2528 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066440    2528 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066443    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066446    2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066448    2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066451    2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066453    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066455    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066458    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066460    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 12:52:48.074655 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066462    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066465    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066467    2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066470    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066473    2528 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066475    2528 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066478    2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066482    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066485    2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066487    2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066489    2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066492    2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066494    2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066496    2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066500    2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066503    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066506    2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066509    2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066511    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 12:52:48.075157 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066513    2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066516    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066518    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066521    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066523    2528 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066526    2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066528    2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066530    2528 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066533    2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066535    2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066537    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066540    2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066542    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066544    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066547    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066549    2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066552    2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066554    2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066557    2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066559    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 12:52:48.075733 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066562    2528 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066578    2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066581    2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066584    2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066586    2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066589    2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066591    2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066594    2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066596    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066598    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066601    2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066604    2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066608    2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066610    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066613    2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066615    2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066618    2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066620    2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066622    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066625    2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 12:52:48.076297 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066627    2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066629    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066632    2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066636    2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066639    2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066642    2528 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066644    2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066647    2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066649    2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066652    2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066655    2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066657    2528 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066661    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066664    2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066666    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066668    2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066671    2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066673    2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066675    2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 12:52:48.076775 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066678    2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066680    2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066682    2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066685    2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066687    2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.066690    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.067419    2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.074179    2528 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.074196    2528 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.074214    2528 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.074220    2528 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074278    2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074284    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074288    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 12:52:48.077225 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074290    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074295    2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074299    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074302    2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074305    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074307    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074310    2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074313    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074315    2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074318    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074321    2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074324    2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074326    2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074328    2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074331    2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074334    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074336    2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074338    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074341    2528 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 12:52:48.077563 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074343    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074345    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074348    2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074350    2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074353    2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074355    2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074358    2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074368    2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074371    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074373    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074376    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074378    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074380    2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074383    2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074385    2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074388    2528 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074390    2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074392    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074395    2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074397    2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 12:52:48.078003 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074399    2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074402    2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074404    2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074406    2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074408    2528 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074410    2528 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074413    2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074415    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074417    2528 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074420    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074423    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074425    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074427    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074429    2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074433    2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074436    2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074439    2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074441    2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074444    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074446    2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 12:52:48.078469 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074454    2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074456    2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074459    2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074461    2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074464    2528 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074466    2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074469    2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074471    2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074474    2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074476    2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074478    2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074481    2528 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074483    2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074486    2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074488    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074490    2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074493    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074496    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074498    2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074500    2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 12:52:48.078952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074503    2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074505    2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074507    2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074510    2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074512    2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074515    2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074517    2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074524    2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074527    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074529    2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074531    2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074534    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074536    2528 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074544    2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074547    2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074549    2528 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 12:52:48.079426 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074552    2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.074556    2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074712    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074716    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074719    2528 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074722    2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074724    2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074727    2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074729    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074733    2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074737    2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074739    2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074742    2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074744    2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 12:52:48.079895 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074746    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074749    2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074751    2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074753    2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074756    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074758    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074760    2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074763    2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074766    2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074769    2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074772    2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074774    2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074777    2528 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074779    2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074782    2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074784    2528 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074792    2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074794    2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074797    2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074799    2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 12:52:48.080233 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074801    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074804    2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074806    2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074808    2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074810    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074813    2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074815    2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074817    2528 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074819    2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074822    2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074824    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074826    2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074828    2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074830    2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074833    2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074835    2528 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074837    2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074840    2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074842    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074844    2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 12:52:48.080703 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074846    2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074849    2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074851    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074853    2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074855    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074858    2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074860    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074862    2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074864    2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074877    2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074880    2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074882    2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074885    2528 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074887    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074889    2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074891    2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074894    2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074896    2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074898    2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074900    2528 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 12:52:48.081340 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074903    2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074905    2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074907    2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074909    2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074912    2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074914    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074917    2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074920    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074923    2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074926    2528 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074928    2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074930    2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074933    2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074935    2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074937    2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074939    2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074942    2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074944    2528 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074946    2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 12:52:48.082056 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074949    2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074951    2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074953    2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074962    2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074964    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074967    2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074969    2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:48.074971    2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.074976    2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.075078    2528 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.077009    2528 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.078104    2528 server.go:1019] "Starting client certificate rotation"
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.078204    2528 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 12:52:48.082678 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.078262    2528 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 12:52:48.083002 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.080260    2528 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 12:52:48.086080 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.086059    2528 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 12:52:48.095848 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.095832    2528 log.go:25] "Validated CRI v1 runtime API"
Jul 24 12:52:48.097608 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.097595    2528 log.go:25] "Validated CRI v1 image API"
Jul 24 12:52:48.098369 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.098345    2528 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 12:52:48.100474 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.100451    2528 fs.go:135] Filesystem UUIDs: map[14ebc5b7-f85b-49a7-b5ee-acc65a6251df:/dev/nvme0n1p4 6f823042-959a-4da0-a432-f2fb976ee62a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 24 12:52:48.100543 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.100473    2528 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 12:52:48.105467 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.105358    2528 manager.go:216] Machine: {Timestamp:2026-07-24 12:52:48.104149739 +0000 UTC m=+0.294908153 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199528 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2530ef8c9b7bdcc5d78ae970e4f688 SystemUUID:ec2530ef-8c9b-7bdc-c5d7-8ae970e4f688 BootID:f4399bc4-1aa3-42c5-85f0-d436af00d9e7 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:67:24:fe:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:67:24:fe:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:3e:99:14:c3:8e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 12:52:48.105467 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.105459    2528 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 12:52:48.105636 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.105540    2528 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 12:52:48.108295 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.108275    2528 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 12:52:48.108417 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.108298    2528 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 12:52:48.108861 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.108851    2528 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 12:52:48.108902 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.108862    2528 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 12:52:48.108902 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.108873    2528 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 12:52:48.109372 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.109363    2528 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 12:52:48.109482 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.109466    2528 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 12:52:48.110011 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.110000    2528 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 12:52:48.111593 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.111582    2528 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 12:52:48.111843 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.111833    2528 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 12:52:48.111872 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.111864    2528 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 12:52:48.111899 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.111873    2528 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 12:52:48.111899 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.111887    2528 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 12:52:48.111899 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.111895    2528 kubelet.go:398] "Adding apiserver pod source"
Jul 24 12:52:48.111988 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.111908    2528 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 12:52:48.112320 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.112300    2528 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 12:52:48.112407 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.112337    2528 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 12:52:48.114417 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.114401    2528 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 12:52:48.116244 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.116232    2528 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 12:52:48.116295 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.116260    2528 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 12:52:48.117660 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117649    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 12:52:48.117704 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117665    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 12:52:48.117704 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117670    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 12:52:48.117704 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117675    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 12:52:48.117704 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117682    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 12:52:48.117704 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117688    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 12:52:48.117704 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117695    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 12:52:48.117704 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117700    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 12:52:48.117876 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117722    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 12:52:48.117876 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117731    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 12:52:48.117876 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117751    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 12:52:48.117876 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.117759    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 12:52:48.118417 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.118405    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 12:52:48.118444 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.118423    2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 12:52:48.121561 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.121533    2528 server.go:1268] "Started kubelet"
Jul 24 12:52:48.121688 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.121660    2528 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 12:52:48.121871 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.121732    2528 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 12:52:48.122361 ip-10-0-134-90 systemd[1]: Started Kubernetes Kubelet.
Jul 24 12:52:48.124315 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.124288    2528 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 12:52:48.125158 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.125124    2528 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 12:52:48.125768 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.125750    2528 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 12:52:48.125914 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.125890    2528 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 12:52:48.126025 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.125895    2528 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 12:52:48.126610 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.126592    2528 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 12:52:48.128199 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.128176    2528 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 12:52:48.131089 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.130199    2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-90.ec2.internal.18c53ae1a4567e02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-90.ec2.internal,UID:ip-10-0-134-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-90.ec2.internal,},FirstTimestamp:2026-07-24 12:52:48.121454082 +0000 UTC m=+0.312212499,LastTimestamp:2026-07-24 12:52:48.121454082 +0000 UTC m=+0.312212499,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-90.ec2.internal,}"
Jul 24 12:52:48.134005 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.133987    2528 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 12:52:48.134005 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.133994    2528 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 12:52:48.134144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.134066    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.134624 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.134606    2528 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 12:52:48.134705 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.134607    2528 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 12:52:48.134705 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.134641    2528 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 12:52:48.134771 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.134728    2528 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 12:52:48.134771 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.134736    2528 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 12:52:48.134879 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.134807    2528 factory.go:55] Registering systemd factory
Jul 24 12:52:48.134925 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.134896    2528 factory.go:223] Registration of the systemd container factory successfully
Jul 24 12:52:48.135064 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.135052    2528 factory.go:153] Registering CRI-O factory
Jul 24 12:52:48.135142 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.135067    2528 factory.go:223] Registration of the crio container factory successfully
Jul 24 12:52:48.135142 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.135114    2528 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 12:52:48.135142 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.135136    2528 factory.go:103] Registering Raw factory
Jul 24 12:52:48.135277 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.135150    2528 manager.go:1196] Started watching for new ooms in manager
Jul 24 12:52:48.135624 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.135608    2528 manager.go:349] Starting recovery of all containers
Jul 24 12:52:48.136108 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.136084    2528 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 12:52:48.136202 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.136135    2528 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 12:52:48.145441 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.145305    2528 manager.go:354] Recovery completed
Jul 24 12:52:48.149313 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.149301    2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 12:52:48.150883 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.150862    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 12:52:48.150955 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.150897    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 12:52:48.150955 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.150910    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 24 12:52:48.151411 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.151387    2528 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 12:52:48.151411 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.151402    2528 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 12:52:48.151411 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.151407    2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 12:52:48.151528 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.151418    2528 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 12:52:48.152418 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.152403    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 12:52:48.152508 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.152429    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 12:52:48.152508 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.152444    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 24 12:52:48.153194 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.153182    2528 policy_none.go:49] "None policy: Start"
Jul 24 12:52:48.153194 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.153196    2528 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 12:52:48.153311 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.153206    2528 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 12:52:48.154291 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.154281    2528 policy_none.go:47] "Start"
Jul 24 12:52:48.158042 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.158021    2528 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4fgkz"
Jul 24 12:52:48.159086 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.158962    2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-90.ec2.internal.18c53ae1a6178549  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-90.ec2.internal,UID:ip-10-0-134-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-90.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-90.ec2.internal,},FirstTimestamp:2026-07-24 12:52:48.150881609 +0000 UTC m=+0.341640027,LastTimestamp:2026-07-24 12:52:48.150881609 +0000 UTC m=+0.341640027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-90.ec2.internal,}"
Jul 24 12:52:48.164522 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.164463    2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-90.ec2.internal.18c53ae1a617da31  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-90.ec2.internal,UID:ip-10-0-134-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-90.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-90.ec2.internal,},FirstTimestamp:2026-07-24 12:52:48.150903345 +0000 UTC m=+0.341661762,LastTimestamp:2026-07-24 12:52:48.150903345 +0000 UTC m=+0.341661762,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-90.ec2.internal,}"
Jul 24 12:52:48.167352 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.167336    2528 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4fgkz"
Jul 24 12:52:48.169141 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.169040    2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-90.ec2.internal.18c53ae1a6180b7f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-90.ec2.internal,UID:ip-10-0-134-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-90.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-90.ec2.internal,},FirstTimestamp:2026-07-24 12:52:48.150915967 +0000 UTC m=+0.341674385,LastTimestamp:2026-07-24 12:52:48.150915967 +0000 UTC m=+0.341674385,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-90.ec2.internal,}"
Jul 24 12:52:48.181118 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.181105    2528 manager.go:337] "Starting Device Plugin manager"
Jul 24 12:52:48.181196 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.181132    2528 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 12:52:48.181196 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.181140    2528 server.go:87] "Starting device plugin registration server"
Jul 24 12:52:48.181374 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.181362    2528 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 12:52:48.181409 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.181379    2528 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 12:52:48.181465 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.181450    2528 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 12:52:48.181530 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.181518    2528 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 12:52:48.181581 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.181531    2528 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 12:52:48.181981 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.181965    2528 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 12:52:48.182051 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.182005    2528 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.281781 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.281761    2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 12:52:48.282698 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.282437    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 12:52:48.282698 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.282463    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 12:52:48.282698 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.282474    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 24 12:52:48.282698 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.282496    2528 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.292229 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.292216    2528 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.292270 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.292235    2528 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-90.ec2.internal\": node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.301631 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.301610    2528 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 12:52:48.302803 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.302789    2528 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 12:52:48.302848 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.302825    2528 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 12:52:48.302848 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.302844    2528 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 12:52:48.302911 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.302871    2528 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 12:52:48.305287 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.305269    2528 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 12:52:48.323225 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.323180    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.403137 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.403099    2528 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"]
Jul 24 12:52:48.403223 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.403162    2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 12:52:48.404471 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.404456    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 12:52:48.404542 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.404488    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 12:52:48.404542 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.404501    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 24 12:52:48.405784 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.405770    2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 12:52:48.405917 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.405894    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.405998 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.405931    2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 12:52:48.409291 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.409276    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 12:52:48.409368 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.409305    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 12:52:48.409368 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.409318    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 24 12:52:48.409368 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.409324    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 12:52:48.409368 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.409341    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 12:52:48.409368 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.409349    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 24 12:52:48.410643 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.410628    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.410719 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.410657    2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 12:52:48.411363 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.411349    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 12:52:48.411432 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.411376    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 12:52:48.411432 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.411389    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 24 12:52:48.424099 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.424081    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.436419 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.436401    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb76d54528df2ec80109e1b71d5a8ae3-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"bb76d54528df2ec80109e1b71d5a8ae3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.436479 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.436424    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2469f2e9c9535df20f40dd7a985aa254-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"2469f2e9c9535df20f40dd7a985aa254\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.436479 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.436442    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2469f2e9c9535df20f40dd7a985aa254-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"2469f2e9c9535df20f40dd7a985aa254\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.438099 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.438083    2528 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-90.ec2.internal\" not found" node="ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.442368 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.442353    2528 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-90.ec2.internal\" not found" node="ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.524581 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.524540    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.536870 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.536851    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2469f2e9c9535df20f40dd7a985aa254-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"2469f2e9c9535df20f40dd7a985aa254\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.536932 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.536873    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb76d54528df2ec80109e1b71d5a8ae3-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"bb76d54528df2ec80109e1b71d5a8ae3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.536932 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.536889    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2469f2e9c9535df20f40dd7a985aa254-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"2469f2e9c9535df20f40dd7a985aa254\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.536932 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.536920    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2469f2e9c9535df20f40dd7a985aa254-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"2469f2e9c9535df20f40dd7a985aa254\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.537017 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.536944    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2469f2e9c9535df20f40dd7a985aa254-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"2469f2e9c9535df20f40dd7a985aa254\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.537017 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.536952    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb76d54528df2ec80109e1b71d5a8ae3-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"bb76d54528df2ec80109e1b71d5a8ae3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.625269 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.625242    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.725781 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.725759    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.740204 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.740187    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.745750 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:48.745736    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:48.826676 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.826652    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:48.927150 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:48.927099    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:49.027642 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:49.027616    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:49.078224 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.078201    2528 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 12:52:49.078708 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.078323    2528 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 12:52:49.128197 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:49.128172    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:49.170919 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.170892    2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 12:47:49 +0000 UTC" deadline="2028-01-09 21:49:16.164344096 +0000 UTC"
Jul 24 12:52:49.170919 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.170914    2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12824h56m26.993432332s"
Jul 24 12:52:49.229204 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:49.229131    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:49.267616 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.267600    2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 12:52:49.268925 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.268910    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 12:52:49.269001 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.268944    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 12:52:49.269001 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.268958    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 24 12:52:49.328881 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:49.328859    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb76d54528df2ec80109e1b71d5a8ae3.slice/crio-654463b97c652a57a85a744831c591d5f55ac3269de3f2379969254ba400516f WatchSource:0}: Error finding container 654463b97c652a57a85a744831c591d5f55ac3269de3f2379969254ba400516f: Status 404 returned error can't find the container with id 654463b97c652a57a85a744831c591d5f55ac3269de3f2379969254ba400516f
Jul 24 12:52:49.330253 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:49.330232    2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 24 12:52:49.333988 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.333977    2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 12:52:49.403059 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.403039    2528 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 12:52:49.434589 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.434562    2528 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:49.448695 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.448679    2528 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 12:52:49.450792 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.450781    2528 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 24 12:52:49.463487 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:49.463471    2528 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 12:52:50.955701 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:50.955682    2528 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 12:52:50.962768 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:50.962749    2528 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 12:52:51.329926 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.329878    2528 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 12:52:51.436769 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.436743    2528 apiserver.go:52] "Watching apiserver"
Jul 24 12:52:51.443066 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.443046    2528 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 12:52:51.443843 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.443824    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-lxs42","openshift-network-diagnostics/network-check-target-z4mq5","openshift-network-operator/iptables-alerter-kbpx8","kube-system/global-pull-secret-syncer-b28qt","kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb","openshift-cluster-node-tuning-operator/tuned-m5vvr","openshift-image-registry/node-ca-xrnvm","openshift-multus/multus-additional-cni-plugins-gp2kc","openshift-multus/multus-lmxhh","openshift-ovn-kubernetes/ovnkube-node-xkwt4","kube-system/konnectivity-agent-phqqp","openshift-dns/node-resolver-xtv6m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"]
Jul 24 12:52:51.445713 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.445698    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.446834 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.446819    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:51.446922 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.446871    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:52:51.447903 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.447884    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6mrxj\""
Jul 24 12:52:51.447968 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.447910    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.448018 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.448005    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 12:52:51.448344 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.448330    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 12:52:51.448409 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.448377    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 12:52:51.448464 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.448446    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 12:52:51.448929 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.448917    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:52:51.450066 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.450048    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.450177 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.450065    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 12:52:51.450399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.450378    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 12:52:51.450485 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.450417    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 12:52:51.450534 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.450486    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vjqbq\""
Jul 24 12:52:51.450923 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.450893    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 12:52:51.451135 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.451122    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 12:52:51.451212 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.451136    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4bm2h\""
Jul 24 12:52:51.451374 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.451360    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.452308 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.452288    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 12:52:51.452948 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.452498    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.452948 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.452508    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 12:52:51.452948 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.452841    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x7gvx\""
Jul 24 12:52:51.453337 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.453319    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 12:52:51.453430 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.453337    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 12:52:51.453430 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.453337    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 12:52:51.453578 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.453562    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.453637 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.453576    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-27ddb\""
Jul 24 12:52:51.454643 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.454628    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gqmxb\""
Jul 24 12:52:51.454761 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.454745    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:51.454840 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.454821    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:52:51.455016 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.455002    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 12:52:51.455104 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.455037    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 12:52:51.455856 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.455840    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zv69f\""
Jul 24 12:52:51.455927 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.455875    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 12:52:51.455980 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.455935    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 12:52:51.456028 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.455996    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.457441 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.457423    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.457973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.457923    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:52:51.458392 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.458369    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 12:52:51.458874 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.458857    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 12:52:51.458994 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.458977    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 12:52:51.459104 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.458857    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jq85z\""
Jul 24 12:52:51.459334 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.459317    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 12:52:51.459389 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.459350    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 12:52:51.459389 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.459382    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 12:52:51.459564 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.459548    2528 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 12:52:51.460005 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.459981    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.462206 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.462191    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 12:52:51.462473 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.462462    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bjxlp\""
Jul 24 12:52:51.462549 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.462507    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 12:52:51.462585 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.462567    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 12:52:51.469629 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469589    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.469715 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469647    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6db00936-7903-4791-8d20-04d84396824e-host-slash\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.469715 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469684    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-kubernetes\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.469715 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469707    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b0a70d49-090c-4dc3-98f3-85619a05c775-kubelet-config\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.469861 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469741    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2792564-4a58-4951-97ed-81a29ee13530-multus-daemon-config\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.469861 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469787    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-systemd-units\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.469861 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469819    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-sys\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.469861 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469843    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-var-lib-kubelet\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.470014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469866    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-netns\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.470014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469889    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6acfad45-c25e-49b1-8377-5c091d68f531-agent-certs\") pod \"konnectivity-agent-phqqp\" (UID: \"6acfad45-c25e-49b1-8377-5c091d68f531\") " pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:52:51.470014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469914    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-cni-binary-copy\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.470014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469943    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt8fh\" (UniqueName: \"kubernetes.io/projected/6db00936-7903-4791-8d20-04d84396824e-kube-api-access-dt8fh\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.470014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469963    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2792564-4a58-4951-97ed-81a29ee13530-cni-binary-copy\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.470014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469981    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ppqm\" (UniqueName: \"kubernetes.io/projected/b7ecdb94-22fd-4802-8548-600e92c653fa-kube-api-access-6ppqm\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.470014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.469995    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b0a70d49-090c-4dc3-98f3-85619a05c775-dbus\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.470014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470011    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-conf-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470038    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-sys-fs\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470057    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-log-socket\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470069    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysconfig\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470082    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-systemd\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470120    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-tuned\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470137    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnjm5\" (UniqueName: \"kubernetes.io/projected/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-kube-api-access-wnjm5\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470150    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-host\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470164    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-os-release\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470190    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-etc-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470219    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470238    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-ovn\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470251    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-node-log\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470264    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fp2f\" (UniqueName: \"kubernetes.io/projected/00d61db8-509e-4814-adb4-b5709b2a16ac-kube-api-access-2fp2f\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470298    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wklhv\" (UniqueName: \"kubernetes.io/projected/b2792564-4a58-4951-97ed-81a29ee13530-kube-api-access-wklhv\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470332    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6acfad45-c25e-49b1-8377-5c091d68f531-konnectivity-ca\") pod \"konnectivity-agent-phqqp\" (UID: \"6acfad45-c25e-49b1-8377-5c091d68f531\") " pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470354    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470379    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470404    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-env-overrides\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470438    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00d61db8-509e-4814-adb4-b5709b2a16ac-ovn-node-metrics-cert\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470462    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysctl-conf\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470483    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-os-release\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470505    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-device-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470528    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-cni-bin\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470551    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6db00936-7903-4791-8d20-04d84396824e-iptables-alerter-script\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470575    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-lib-modules\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470598    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-tmp-dir\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470619    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-etc-kubernetes\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470642    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-cni-bin\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.470849 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470664    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-hostroot\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470698    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470779    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-systemd\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470805    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysctl-d\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470826    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9f3394a-9317-4f97-9573-c80f2d76fed2-tmp\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470845    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-cni-multus\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470863    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470884    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470910    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-cni-netd\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470938    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470956    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-host\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470971    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-hosts-file\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.470987    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471008    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-cnibin\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471021    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-socket-dir-parent\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471034    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-registration-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.471587 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471048    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471067    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-cnibin\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471081    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-run-netns\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471116    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-k8s-cni-cncf-io\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471137    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-system-cni-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471150    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-cni-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471164    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-kubelet\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471192    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-system-cni-dir\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471214    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-ovnkube-config\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471236    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kpwk\" (UniqueName: \"kubernetes.io/projected/478d3296-f563-4290-9d13-6450fd8167e1-kube-api-access-9kpwk\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471259    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xspk7\" (UniqueName: \"kubernetes.io/projected/34e5d295-1c9c-4afd-910b-0866fbc3f772-kube-api-access-xspk7\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471277    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-modprobe-d\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471290    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-run\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471303    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-serviceca\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471318    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45vlt\" (UniqueName: \"kubernetes.io/projected/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-kube-api-access-45vlt\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471338    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.472399 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471357    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-socket-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.473159 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471370    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-slash\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.473159 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471383    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-var-lib-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.473159 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471414    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z4pj\" (UniqueName: \"kubernetes.io/projected/b9f3394a-9317-4f97-9573-c80f2d76fed2-kube-api-access-7z4pj\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.473159 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471444    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-multus-certs\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.473159 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471457    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-kubelet\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.473159 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.471479    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-ovnkube-script-lib\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.473159 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.472308    2528 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 12:52:51.497310 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.497294    2528 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnrlb"
Jul 24 12:52:51.505895 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.505875    2528 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnrlb"
Jul 24 12:52:51.558730 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.558711    2528 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 12:52:51.571758 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571737    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-registration-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.571837 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571759    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.571837 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571774    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-cnibin\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.571837 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571793    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-run-netns\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.571837 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571826    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-k8s-cni-cncf-io\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571866    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-k8s-cni-cncf-io\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571876    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-run-netns\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571867    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-cnibin\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.571885    2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571898    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-system-cni-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571918    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-cni-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571876    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-registration-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.571950    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret podName:b0a70d49-090c-4dc3-98f3-85619a05c775 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:52.071918388 +0000 UTC m=+2.939153412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret") pod "global-pull-secret-syncer-b28qt" (UID: "b0a70d49-090c-4dc3-98f3-85619a05c775") : object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571968    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-kubelet\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571972    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-cni-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571984    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-system-cni-dir\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.572004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.571983    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-system-cni-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572016    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-kubelet\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572020    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-system-cni-dir\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572032    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-ovnkube-config\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572049    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kpwk\" (UniqueName: \"kubernetes.io/projected/478d3296-f563-4290-9d13-6450fd8167e1-kube-api-access-9kpwk\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572071    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xspk7\" (UniqueName: \"kubernetes.io/projected/34e5d295-1c9c-4afd-910b-0866fbc3f772-kube-api-access-xspk7\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572107    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-modprobe-d\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572133    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-run\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572147    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-serviceca\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572169    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45vlt\" (UniqueName: \"kubernetes.io/projected/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-kube-api-access-45vlt\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572193    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572212    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-run\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572215    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-socket-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572237    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-slash\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572246    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-modprobe-d\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572285    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-slash\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572296    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.572504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572375    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-var-lib-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572415    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z4pj\" (UniqueName: \"kubernetes.io/projected/b9f3394a-9317-4f97-9573-c80f2d76fed2-kube-api-access-7z4pj\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572439    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-var-lib-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572449    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-socket-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572440    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-multus-certs\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572492    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-kubelet\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572527    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-kubelet\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572545    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-multus-certs\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572555    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-ovnkube-script-lib\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572564    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-serviceca\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572595    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572600    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-ovnkube-config\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572637    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6db00936-7903-4791-8d20-04d84396824e-host-slash\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572698    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6db00936-7903-4791-8d20-04d84396824e-host-slash\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572822    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-kubernetes\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572963    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.573015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572970    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-ovnkube-script-lib\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.572687    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-kubernetes\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573087    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b0a70d49-090c-4dc3-98f3-85619a05c775-kubelet-config\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573122    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2792564-4a58-4951-97ed-81a29ee13530-multus-daemon-config\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573135    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-systemd-units\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573135    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b0a70d49-090c-4dc3-98f3-85619a05c775-kubelet-config\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573148    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-sys\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573172    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-var-lib-kubelet\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573186    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-netns\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573188    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-sys\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573202    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6acfad45-c25e-49b1-8377-5c091d68f531-agent-certs\") pod \"konnectivity-agent-phqqp\" (UID: \"6acfad45-c25e-49b1-8377-5c091d68f531\") " pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573203    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-systemd-units\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573216    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-cni-binary-copy\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573242    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-var-lib-kubelet\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573250    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-run-netns\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573242    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt8fh\" (UniqueName: \"kubernetes.io/projected/6db00936-7903-4791-8d20-04d84396824e-kube-api-access-dt8fh\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573277    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2792564-4a58-4951-97ed-81a29ee13530-cni-binary-copy\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.573700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573292    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ppqm\" (UniqueName: \"kubernetes.io/projected/b7ecdb94-22fd-4802-8548-600e92c653fa-kube-api-access-6ppqm\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573306    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b0a70d49-090c-4dc3-98f3-85619a05c775-dbus\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573341    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-conf-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573365    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-sys-fs\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573385    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-log-socket\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573408    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysconfig\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573428    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-systemd\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573450    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-tuned\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573475    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnjm5\" (UniqueName: \"kubernetes.io/projected/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-kube-api-access-wnjm5\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573498    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-host\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573520    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-os-release\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573522    2528 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573543    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-etc-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573547    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-log-socket\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573564    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2792564-4a58-4951-97ed-81a29ee13530-multus-daemon-config\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573624    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-etc-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573654    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b0a70d49-090c-4dc3-98f3-85619a05c775-dbus\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573662    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-systemd\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.574445 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573566    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573689    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-ovn\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573705    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-node-log\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573715    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-conf-dir\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573726    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fp2f\" (UniqueName: \"kubernetes.io/projected/00d61db8-509e-4814-adb4-b5709b2a16ac-kube-api-access-2fp2f\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573727    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-cni-binary-copy\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573742    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wklhv\" (UniqueName: \"kubernetes.io/projected/b2792564-4a58-4951-97ed-81a29ee13530-kube-api-access-wklhv\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573772    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-sys-fs\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573770    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6acfad45-c25e-49b1-8377-5c091d68f531-konnectivity-ca\") pod \"konnectivity-agent-phqqp\" (UID: \"6acfad45-c25e-49b1-8377-5c091d68f531\") " pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573627    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-openvswitch\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573797    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573803    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2792564-4a58-4951-97ed-81a29ee13530-cni-binary-copy\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573812    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-node-log\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573820    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573847    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-ovn\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573911    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysconfig\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573948    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.575450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.573991    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574029    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-env-overrides\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574027    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-host\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574112    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34e5d295-1c9c-4afd-910b-0866fbc3f772-os-release\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574314    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6acfad45-c25e-49b1-8377-5c091d68f531-konnectivity-ca\") pod \"konnectivity-agent-phqqp\" (UID: \"6acfad45-c25e-49b1-8377-5c091d68f531\") " pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574347    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00d61db8-509e-4814-adb4-b5709b2a16ac-ovn-node-metrics-cert\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574377    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysctl-conf\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574483    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysctl-conf\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574547    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00d61db8-509e-4814-adb4-b5709b2a16ac-env-overrides\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574487    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-os-release\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574610    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-device-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574625    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-os-release\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574629    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-cni-bin\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574656    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6db00936-7903-4791-8d20-04d84396824e-iptables-alerter-script\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574670    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-device-dir\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574679    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-cni-bin\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574680    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-lib-modules\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574710    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-tmp-dir\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.576317 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574732    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-etc-kubernetes\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574765    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-cni-bin\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574785    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-lib-modules\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574788    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-hostroot\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574831    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574848    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-etc-kubernetes\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574855    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-systemd\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574886    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysctl-d\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574894    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-run-systemd\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574909    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9f3394a-9317-4f97-9573-c80f2d76fed2-tmp\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574932    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-cni-multus\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574935    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-cni-bin\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574955    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574967    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-hostroot\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.574979    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575002    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-cni-netd\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575021    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-tmp-dir\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.577036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575025    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575060    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575080    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-host\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575127    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-hosts-file\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575153    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575176    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-sysctl-d\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575223    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f3394a-9317-4f97-9573-c80f2d76fed2-host\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.575247    2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575278    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-cnibin\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575323    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-hosts-file\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575322    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7ecdb94-22fd-4802-8548-600e92c653fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575387    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34e5d295-1c9c-4afd-910b-0866fbc3f772-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575178    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-cnibin\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575425    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-socket-dir-parent\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575465    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-host-var-lib-cni-multus\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575390    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00d61db8-509e-4814-adb4-b5709b2a16ac-host-cni-netd\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.575503    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs podName:478d3296-f563-4290-9d13-6450fd8167e1 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:52.075487003 +0000 UTC m=+2.942722014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs") pod "network-metrics-daemon-lxs42" (UID: "478d3296-f563-4290-9d13-6450fd8167e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:51.577595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575537    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2792564-4a58-4951-97ed-81a29ee13530-multus-socket-dir-parent\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.578031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.575554    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6db00936-7903-4791-8d20-04d84396824e-iptables-alerter-script\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.578031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.576743    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9f3394a-9317-4f97-9573-c80f2d76fed2-etc-tuned\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.578031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.576918    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00d61db8-509e-4814-adb4-b5709b2a16ac-ovn-node-metrics-cert\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.578031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.577010    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6acfad45-c25e-49b1-8377-5c091d68f531-agent-certs\") pod \"konnectivity-agent-phqqp\" (UID: \"6acfad45-c25e-49b1-8377-5c091d68f531\") " pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:52:51.578031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.577284    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9f3394a-9317-4f97-9573-c80f2d76fed2-tmp\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.583136 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.583073    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xspk7\" (UniqueName: \"kubernetes.io/projected/34e5d295-1c9c-4afd-910b-0866fbc3f772-kube-api-access-xspk7\") pod \"multus-additional-cni-plugins-gp2kc\" (UID: \"34e5d295-1c9c-4afd-910b-0866fbc3f772\") " pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.583232 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.583206    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kpwk\" (UniqueName: \"kubernetes.io/projected/478d3296-f563-4290-9d13-6450fd8167e1-kube-api-access-9kpwk\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:51.583578 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.583557    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45vlt\" (UniqueName: \"kubernetes.io/projected/6b5d92cd-a6d1-4203-b62f-19b8d8d313df-kube-api-access-45vlt\") pod \"node-ca-xrnvm\" (UID: \"6b5d92cd-a6d1-4203-b62f-19b8d8d313df\") " pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.583578 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.583568    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z4pj\" (UniqueName: \"kubernetes.io/projected/b9f3394a-9317-4f97-9573-c80f2d76fed2-kube-api-access-7z4pj\") pod \"tuned-m5vvr\" (UID: \"b9f3394a-9317-4f97-9573-c80f2d76fed2\") " pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.587545 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.584900    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 12:52:51.587545 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.584928    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 12:52:51.587545 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.584942    2528 projected.go:196] Error preparing data for projected volume kube-api-access-6s4w8 for pod openshift-network-diagnostics/network-check-target-z4mq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:51.587545 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:51.585010    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8 podName:537a1161-4b9b-4c97-a708-7dd7c2128bb1 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:52.084985006 +0000 UTC m=+2.952220031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6s4w8" (UniqueName: "kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8") pod "network-check-target-z4mq5" (UID: "537a1161-4b9b-4c97-a708-7dd7c2128bb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:51.587545 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.585693    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ppqm\" (UniqueName: \"kubernetes.io/projected/b7ecdb94-22fd-4802-8548-600e92c653fa-kube-api-access-6ppqm\") pod \"aws-ebs-csi-driver-node-j46lb\" (UID: \"b7ecdb94-22fd-4802-8548-600e92c653fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.587545 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.586012    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt8fh\" (UniqueName: \"kubernetes.io/projected/6db00936-7903-4791-8d20-04d84396824e-kube-api-access-dt8fh\") pod \"iptables-alerter-kbpx8\" (UID: \"6db00936-7903-4791-8d20-04d84396824e\") " pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.587545 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.586605    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnjm5\" (UniqueName: \"kubernetes.io/projected/b83ced7e-49b7-4e77-8409-5cb62fa48bfd-kube-api-access-wnjm5\") pod \"node-resolver-xtv6m\" (UID: \"b83ced7e-49b7-4e77-8409-5cb62fa48bfd\") " pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.587889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.587659    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fp2f\" (UniqueName: \"kubernetes.io/projected/00d61db8-509e-4814-adb4-b5709b2a16ac-kube-api-access-2fp2f\") pod \"ovnkube-node-xkwt4\" (UID: \"00d61db8-509e-4814-adb4-b5709b2a16ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.588778 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.588751    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wklhv\" (UniqueName: \"kubernetes.io/projected/b2792564-4a58-4951-97ed-81a29ee13530-kube-api-access-wklhv\") pod \"multus-lmxhh\" (UID: \"b2792564-4a58-4951-97ed-81a29ee13530\") " pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.630425 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.630387    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" event={"ID":"bb76d54528df2ec80109e1b71d5a8ae3","Type":"ContainerStarted","Data":"654463b97c652a57a85a744831c591d5f55ac3269de3f2379969254ba400516f"}
Jul 24 12:52:51.729241 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.729222    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2469f2e9c9535df20f40dd7a985aa254.slice/crio-9042f6a68f74f16f0ec2cacbe023cec3a6f09b818c3880c5151249772ee83ab5 WatchSource:0}: Error finding container 9042f6a68f74f16f0ec2cacbe023cec3a6f09b818c3880c5151249772ee83ab5: Status 404 returned error can't find the container with id 9042f6a68f74f16f0ec2cacbe023cec3a6f09b818c3880c5151249772ee83ab5
Jul 24 12:52:51.755752 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.755735    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lmxhh"
Jul 24 12:52:51.761952 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.761934    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2792564_4a58_4951_97ed_81a29ee13530.slice/crio-3cbadae0819263edca11fcb04292686b6e8f31d74b1a039775eb7dfbc4af5447 WatchSource:0}: Error finding container 3cbadae0819263edca11fcb04292686b6e8f31d74b1a039775eb7dfbc4af5447: Status 404 returned error can't find the container with id 3cbadae0819263edca11fcb04292686b6e8f31d74b1a039775eb7dfbc4af5447
Jul 24 12:52:51.763480 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.763461    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbpx8"
Jul 24 12:52:51.769783 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.769765    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db00936_7903_4791_8d20_04d84396824e.slice/crio-7e8c47acde5026d3ce70ab2647fd9e7fb6145b99667e24a57113f44e574edf01 WatchSource:0}: Error finding container 7e8c47acde5026d3ce70ab2647fd9e7fb6145b99667e24a57113f44e574edf01: Status 404 returned error can't find the container with id 7e8c47acde5026d3ce70ab2647fd9e7fb6145b99667e24a57113f44e574edf01
Jul 24 12:52:51.769840 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.769794    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:52:51.775473 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.775451    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m5vvr"
Jul 24 12:52:51.776470 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.776445    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6acfad45_c25e_49b1_8377_5c091d68f531.slice/crio-b52f37ad36a8fe451f0199b0a860edf7a2f165e7ba2f90448f8251553840f0e8 WatchSource:0}: Error finding container b52f37ad36a8fe451f0199b0a860edf7a2f165e7ba2f90448f8251553840f0e8: Status 404 returned error can't find the container with id b52f37ad36a8fe451f0199b0a860edf7a2f165e7ba2f90448f8251553840f0e8
Jul 24 12:52:51.779955 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.779936    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb"
Jul 24 12:52:51.782725 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.782708    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f3394a_9317_4f97_9573_c80f2d76fed2.slice/crio-61c6fdf9a1ce0a76abee784f792bf7b4c1c7eb73f87cbe7cf9837e757099969f WatchSource:0}: Error finding container 61c6fdf9a1ce0a76abee784f792bf7b4c1c7eb73f87cbe7cf9837e757099969f: Status 404 returned error can't find the container with id 61c6fdf9a1ce0a76abee784f792bf7b4c1c7eb73f87cbe7cf9837e757099969f
Jul 24 12:52:51.785906 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.785756    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gp2kc"
Jul 24 12:52:51.787919 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.787904    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ecdb94_22fd_4802_8548_600e92c653fa.slice/crio-c29f19d408e2d0c322c544439eb3b7eaa2ef5059536e008e0dbb58f3a634d401 WatchSource:0}: Error finding container c29f19d408e2d0c322c544439eb3b7eaa2ef5059536e008e0dbb58f3a634d401: Status 404 returned error can't find the container with id c29f19d408e2d0c322c544439eb3b7eaa2ef5059536e008e0dbb58f3a634d401
Jul 24 12:52:51.790035 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.790022    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xtv6m"
Jul 24 12:52:51.792720 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.792704    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e5d295_1c9c_4afd_910b_0866fbc3f772.slice/crio-926ac8c187942779322a43c5bf3d167ef0c7a43037e351b12e02661f4d2ae549 WatchSource:0}: Error finding container 926ac8c187942779322a43c5bf3d167ef0c7a43037e351b12e02661f4d2ae549: Status 404 returned error can't find the container with id 926ac8c187942779322a43c5bf3d167ef0c7a43037e351b12e02661f4d2ae549
Jul 24 12:52:51.794901 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.794888    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:52:51.797509 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.797494    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83ced7e_49b7_4e77_8409_5cb62fa48bfd.slice/crio-8b2bbf891410b50de4b6cd26dc7fe7c72533ee7e149f15e5022849969c36242c WatchSource:0}: Error finding container 8b2bbf891410b50de4b6cd26dc7fe7c72533ee7e149f15e5022849969c36242c: Status 404 returned error can't find the container with id 8b2bbf891410b50de4b6cd26dc7fe7c72533ee7e149f15e5022849969c36242c
Jul 24 12:52:51.799116 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:51.799085    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrnvm"
Jul 24 12:52:51.802066 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.802048    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d61db8_509e_4814_adb4_b5709b2a16ac.slice/crio-b981ca29088d5ff47e9240ea268cba5e27b2dda553d2630ad121802389ebf1c4 WatchSource:0}: Error finding container b981ca29088d5ff47e9240ea268cba5e27b2dda553d2630ad121802389ebf1c4: Status 404 returned error can't find the container with id b981ca29088d5ff47e9240ea268cba5e27b2dda553d2630ad121802389ebf1c4
Jul 24 12:52:51.807837 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:52:51.807814    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5d92cd_a6d1_4203_b62f_19b8d8d313df.slice/crio-a4a70f5955dc673559277f3908937fd78ed4444044d403339beda7069155efae WatchSource:0}: Error finding container a4a70f5955dc673559277f3908937fd78ed4444044d403339beda7069155efae: Status 404 returned error can't find the container with id a4a70f5955dc673559277f3908937fd78ed4444044d403339beda7069155efae
Jul 24 12:52:52.079057 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.079034    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:52.079182 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.079086    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:52.079228 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:52.079179    2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:52.079228 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:52.079188    2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:52.079303 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:52.079237    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret podName:b0a70d49-090c-4dc3-98f3-85619a05c775 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:53.079224355 +0000 UTC m=+3.946459366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret") pod "global-pull-secret-syncer-b28qt" (UID: "b0a70d49-090c-4dc3-98f3-85619a05c775") : object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:52.079303 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:52.079250    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs podName:478d3296-f563-4290-9d13-6450fd8167e1 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:53.079243538 +0000 UTC m=+3.946478545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs") pod "network-metrics-daemon-lxs42" (UID: "478d3296-f563-4290-9d13-6450fd8167e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:52.179834 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.179810    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:52.180048 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:52.180031    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 12:52:52.180143 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:52.180054    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 12:52:52.180143 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:52.180066    2528 projected.go:196] Error preparing data for projected volume kube-api-access-6s4w8 for pod openshift-network-diagnostics/network-check-target-z4mq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:52.180143 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:52.180139    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8 podName:537a1161-4b9b-4c97-a708-7dd7c2128bb1 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:53.180113597 +0000 UTC m=+4.047348610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s4w8" (UniqueName: "kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8") pod "network-check-target-z4mq5" (UID: "537a1161-4b9b-4c97-a708-7dd7c2128bb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:52.507926 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.507866    2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 12:47:51 +0000 UTC" deadline="2028-02-17 13:51:44.337263294 +0000 UTC"
Jul 24 12:52:52.507926 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.507923    2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13752h58m51.829343363s"
Jul 24 12:52:52.643252 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.643209    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb" event={"ID":"b7ecdb94-22fd-4802-8548-600e92c653fa","Type":"ContainerStarted","Data":"c29f19d408e2d0c322c544439eb3b7eaa2ef5059536e008e0dbb58f3a634d401"}
Jul 24 12:52:52.655569 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.655492    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m5vvr" event={"ID":"b9f3394a-9317-4f97-9573-c80f2d76fed2","Type":"ContainerStarted","Data":"61c6fdf9a1ce0a76abee784f792bf7b4c1c7eb73f87cbe7cf9837e757099969f"}
Jul 24 12:52:52.662304 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.662273    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-phqqp" event={"ID":"6acfad45-c25e-49b1-8377-5c091d68f531","Type":"ContainerStarted","Data":"b52f37ad36a8fe451f0199b0a860edf7a2f165e7ba2f90448f8251553840f0e8"}
Jul 24 12:52:52.668229 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.668194    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbpx8" event={"ID":"6db00936-7903-4791-8d20-04d84396824e","Type":"ContainerStarted","Data":"7e8c47acde5026d3ce70ab2647fd9e7fb6145b99667e24a57113f44e574edf01"}
Jul 24 12:52:52.680004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.679975    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lmxhh" event={"ID":"b2792564-4a58-4951-97ed-81a29ee13530","Type":"ContainerStarted","Data":"3cbadae0819263edca11fcb04292686b6e8f31d74b1a039775eb7dfbc4af5447"}
Jul 24 12:52:52.691510 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.691476    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"b981ca29088d5ff47e9240ea268cba5e27b2dda553d2630ad121802389ebf1c4"}
Jul 24 12:52:52.702342 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.702319    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xtv6m" event={"ID":"b83ced7e-49b7-4e77-8409-5cb62fa48bfd","Type":"ContainerStarted","Data":"8b2bbf891410b50de4b6cd26dc7fe7c72533ee7e149f15e5022849969c36242c"}
Jul 24 12:52:52.709297 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.709274    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" event={"ID":"34e5d295-1c9c-4afd-910b-0866fbc3f772","Type":"ContainerStarted","Data":"926ac8c187942779322a43c5bf3d167ef0c7a43037e351b12e02661f4d2ae549"}
Jul 24 12:52:52.716186 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.716161    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"2469f2e9c9535df20f40dd7a985aa254","Type":"ContainerStarted","Data":"9042f6a68f74f16f0ec2cacbe023cec3a6f09b818c3880c5151249772ee83ab5"}
Jul 24 12:52:52.718488 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:52.718466    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrnvm" event={"ID":"6b5d92cd-a6d1-4203-b62f-19b8d8d313df","Type":"ContainerStarted","Data":"a4a70f5955dc673559277f3908937fd78ed4444044d403339beda7069155efae"}
Jul 24 12:52:53.086531 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:53.086490    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:53.086675 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:53.086549    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:53.086760 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.086681    2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:53.086760 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.086746    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret podName:b0a70d49-090c-4dc3-98f3-85619a05c775 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:55.086720085 +0000 UTC m=+5.953955098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret") pod "global-pull-secret-syncer-b28qt" (UID: "b0a70d49-090c-4dc3-98f3-85619a05c775") : object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:53.087176 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.087157    2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:53.087287 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.087210    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs podName:478d3296-f563-4290-9d13-6450fd8167e1 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:55.087194817 +0000 UTC m=+5.954429829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs") pod "network-metrics-daemon-lxs42" (UID: "478d3296-f563-4290-9d13-6450fd8167e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:53.187950 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:53.187699    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:53.188123 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.187960    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 12:52:53.188123 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.187984    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 12:52:53.188123 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.187996    2528 projected.go:196] Error preparing data for projected volume kube-api-access-6s4w8 for pod openshift-network-diagnostics/network-check-target-z4mq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:53.188123 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.188059    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8 podName:537a1161-4b9b-4c97-a708-7dd7c2128bb1 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:55.188040974 +0000 UTC m=+6.055276026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s4w8" (UniqueName: "kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8") pod "network-check-target-z4mq5" (UID: "537a1161-4b9b-4c97-a708-7dd7c2128bb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:53.508171 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:53.508129    2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 12:47:51 +0000 UTC" deadline="2028-03-08 22:52:09.031459723 +0000 UTC"
Jul 24 12:52:53.508171 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:53.508169    2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14241h59m15.523294778s"
Jul 24 12:52:53.627758 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:53.627718    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:53.627931 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.627843    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:52:53.628274 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:53.628246    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:53.628371 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.628348    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:52:53.630644 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:53.630622    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:53.630764 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:53.630742    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:52:55.103767 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:55.103331    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:55.103767 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:55.103388    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:55.103767 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.103512    2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:55.103767 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.103536    2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:55.103767 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.103567    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret podName:b0a70d49-090c-4dc3-98f3-85619a05c775 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:59.103549961 +0000 UTC m=+9.970784972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret") pod "global-pull-secret-syncer-b28qt" (UID: "b0a70d49-090c-4dc3-98f3-85619a05c775") : object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:55.103767 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.103595    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs podName:478d3296-f563-4290-9d13-6450fd8167e1 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:59.103576872 +0000 UTC m=+9.970811883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs") pod "network-metrics-daemon-lxs42" (UID: "478d3296-f563-4290-9d13-6450fd8167e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:55.204559 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:55.203955    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:55.204559 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.204182    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 12:52:55.204559 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.204201    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 12:52:55.204559 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.204212    2528 projected.go:196] Error preparing data for projected volume kube-api-access-6s4w8 for pod openshift-network-diagnostics/network-check-target-z4mq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:55.204559 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.204260    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8 podName:537a1161-4b9b-4c97-a708-7dd7c2128bb1 nodeName:}" failed. No retries permitted until 2026-07-24 12:52:59.204243917 +0000 UTC m=+10.071478930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s4w8" (UniqueName: "kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8") pod "network-check-target-z4mq5" (UID: "537a1161-4b9b-4c97-a708-7dd7c2128bb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:55.627566 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:55.627541    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:55.627748 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.627663    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:52:55.628062 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:55.628044    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:55.628179 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.628159    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:52:55.630146 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:55.627504    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:55.630283 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:55.630260    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:52:57.627713 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:57.627212    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:57.627713 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:57.627212    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:57.627713 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:57.627338    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:52:57.627713 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:57.627371    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:57.627713 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:57.627488    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:52:57.627713 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:57.627566    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:52:59.145060 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:59.145022    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:59.145550 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:59.145088    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:59.145550 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.145245    2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:59.145550 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.145304    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret podName:b0a70d49-090c-4dc3-98f3-85619a05c775 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:07.145285513 +0000 UTC m=+18.012520527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret") pod "global-pull-secret-syncer-b28qt" (UID: "b0a70d49-090c-4dc3-98f3-85619a05c775") : object "kube-system"/"original-pull-secret" not registered
Jul 24 12:52:59.145715 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.145698    2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:59.145764 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.145748    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs podName:478d3296-f563-4290-9d13-6450fd8167e1 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:07.145731958 +0000 UTC m=+18.012966987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs") pod "network-metrics-daemon-lxs42" (UID: "478d3296-f563-4290-9d13-6450fd8167e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:52:59.246131 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:59.246075    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:59.246323 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.246250    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 12:52:59.246323 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.246268    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 12:52:59.246323 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.246277    2528 projected.go:196] Error preparing data for projected volume kube-api-access-6s4w8 for pod openshift-network-diagnostics/network-check-target-z4mq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:59.246463 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.246338    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8 podName:537a1161-4b9b-4c97-a708-7dd7c2128bb1 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:07.246320969 +0000 UTC m=+18.113556000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s4w8" (UniqueName: "kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8") pod "network-check-target-z4mq5" (UID: "537a1161-4b9b-4c97-a708-7dd7c2128bb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:52:59.628246 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:59.628203    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:52:59.629337 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.629302    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:52:59.629473 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:59.629355    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:52:59.629473 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.629434    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:52:59.629584 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:52:59.629478    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:52:59.629584 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:52:59.629550    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:01.627447 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:01.627410    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:01.627899 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:01.627552    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:01.627986 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:01.627909    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:01.628040 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:01.627990    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:01.628040 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:01.628031    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:01.628165 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:01.628082    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:03.627390 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:03.627353    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:03.627390 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:03.627392    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:03.627798 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:03.627359    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:03.627798 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:03.627474    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:03.627798 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:03.627592    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:03.627798 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:03.627691    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:05.626981 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:05.626945    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:05.627458 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:05.626936    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:05.627458 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:05.627061    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:05.627458 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:05.627083    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:05.627458 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:05.627177    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:05.627458 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:05.627261    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:07.199414 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:07.199382    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:07.199829 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:07.199427    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:07.199829 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.199536    2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 12:53:07.199829 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.199536    2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:53:07.199829 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.199598    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret podName:b0a70d49-090c-4dc3-98f3-85619a05c775 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:23.199579357 +0000 UTC m=+34.066814365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret") pod "global-pull-secret-syncer-b28qt" (UID: "b0a70d49-090c-4dc3-98f3-85619a05c775") : object "kube-system"/"original-pull-secret" not registered
Jul 24 12:53:07.199829 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.199612    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs podName:478d3296-f563-4290-9d13-6450fd8167e1 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:23.199605893 +0000 UTC m=+34.066840900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs") pod "network-metrics-daemon-lxs42" (UID: "478d3296-f563-4290-9d13-6450fd8167e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:53:07.300354 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:07.300318    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:07.300503 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.300487    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 12:53:07.300503 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.300502    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 12:53:07.300576 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.300511    2528 projected.go:196] Error preparing data for projected volume kube-api-access-6s4w8 for pod openshift-network-diagnostics/network-check-target-z4mq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:53:07.300576 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.300561    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8 podName:537a1161-4b9b-4c97-a708-7dd7c2128bb1 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:23.300546293 +0000 UTC m=+34.167781303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s4w8" (UniqueName: "kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8") pod "network-check-target-z4mq5" (UID: "537a1161-4b9b-4c97-a708-7dd7c2128bb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:53:07.628049 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:07.627574    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:07.628049 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:07.627588    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:07.628049 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.627689    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:07.628049 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:07.627739    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:07.628049 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.627863    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:07.628049 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:07.627944    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:09.628438 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:09.628389    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:09.628917 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:09.628512    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:09.628917 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:09.628532    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:09.628917 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:09.628646    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:09.628917 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:09.628692    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:09.628917 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:09.628760    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:11.627493 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.627283    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:11.627817 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.627286    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:11.627817 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:11.627618    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:11.627817 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:11.627681    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:11.627817 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.627409    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:11.627817 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:11.627784    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:11.759816 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.759779    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" event={"ID":"bb76d54528df2ec80109e1b71d5a8ae3","Type":"ContainerStarted","Data":"30fdc4c54a207f55f67e0b63ad38707fa495e44c0e4b684350160f9e4463a7df"}
Jul 24 12:53:11.761713 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.761686    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m5vvr" event={"ID":"b9f3394a-9317-4f97-9573-c80f2d76fed2","Type":"ContainerStarted","Data":"901baf0e74ae5a399652f5fcbac1b38abd674c7af1b1e36ec4612dfdfb61d30f"}
Jul 24 12:53:11.763901 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.763373    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lmxhh" event={"ID":"b2792564-4a58-4951-97ed-81a29ee13530","Type":"ContainerStarted","Data":"35a3179196c6cfe57755e025369ac74011ea1ed7f6d3ebfaa77b56cb2b78f9a3"}
Jul 24 12:53:11.765609 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.765589    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"c5fc508c60c8077129c3364d7b663a7a05156b69c0f69772c5e69064418eb82c"}
Jul 24 12:53:11.765714 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.765643    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"9ed7b9d4a32571007685e0d58949cd517b8342087e7d861fdda479ce99826a31"}
Jul 24 12:53:11.788156 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.781845    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" podStartSLOduration=21.781829169 podStartE2EDuration="21.781829169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:11.781667781 +0000 UTC m=+22.648902816" watchObservedRunningTime="2026-07-24 12:53:11.781829169 +0000 UTC m=+22.649064200"
Jul 24 12:53:11.802291 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:11.802238    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m5vvr" podStartSLOduration=3.198755915 podStartE2EDuration="22.802219858s" totalImagesPullingTime="19.603463943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:11.801720777 +0000 UTC m=+22.668955807" watchObservedRunningTime="2026-07-24 12:53:11.802219858 +0000 UTC m=+22.669454894"
Jul 24 12:53:12.768934 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.768754    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrnvm" event={"ID":"6b5d92cd-a6d1-4203-b62f-19b8d8d313df","Type":"ContainerStarted","Data":"69a6cd1f1f9ad6ddbf8c14ec5a439e6d8e19726d5b9fe057b7fa777e0a1030c7"}
Jul 24 12:53:12.770237 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.770215    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb" event={"ID":"b7ecdb94-22fd-4802-8548-600e92c653fa","Type":"ContainerStarted","Data":"e0e8621bf3eab3544c1a64901fa78e7331999fe5b8b0dc0cf0fe8bc8b873575d"}
Jul 24 12:53:12.771410 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.771388    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-phqqp" event={"ID":"6acfad45-c25e-49b1-8377-5c091d68f531","Type":"ContainerStarted","Data":"2540ec84bf05717d6e1d311ff60955b6ade6646e98672d2b643706c450fd05e3"}
Jul 24 12:53:12.772821 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.772801    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbpx8" event={"ID":"6db00936-7903-4791-8d20-04d84396824e","Type":"ContainerStarted","Data":"b8aa924f5933ed564876d6e4894eee37ca3e85b6f2bac92131e74bd9b14ef3e8"}
Jul 24 12:53:12.775333 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.775312    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"1b52d880f9d1f842d2e1a889a335ac04d2cfbdc717a32ddb99d8191af8270802"}
Jul 24 12:53:12.775427 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.775373    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"ead2c451b9392ce79ac6eae453fd0829aa2f0c9f015ee37e018d41b4dcc5b363"}
Jul 24 12:53:12.775427 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.775406    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"ed58388977752444edcf506d16679306112ef0394c4cc9caa2c1afeb55ffa547"}
Jul 24 12:53:12.775536 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.775452    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"cad307889922ff3f1b651a15b29611b392f6bc42d98e2021e0ff10375a9f0f71"}
Jul 24 12:53:12.776533 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.776514    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xtv6m" event={"ID":"b83ced7e-49b7-4e77-8409-5cb62fa48bfd","Type":"ContainerStarted","Data":"a4fff25392d9c6e34d0b37fd371b6e572e9ea6601a7fa1d7c8f63ab1aa36eff0"}
Jul 24 12:53:12.777757 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.777733    2528 generic.go:356] "Generic (PLEG): container finished" podID="34e5d295-1c9c-4afd-910b-0866fbc3f772" containerID="289cb8e44cf81879688fb9aec7f54706d1996482bc92e0b56cc36ac22e8fd069" exitCode=0
Jul 24 12:53:12.777818 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.777795    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" event={"ID":"34e5d295-1c9c-4afd-910b-0866fbc3f772","Type":"ContainerDied","Data":"289cb8e44cf81879688fb9aec7f54706d1996482bc92e0b56cc36ac22e8fd069"}
Jul 24 12:53:12.779258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.779240    2528 generic.go:356] "Generic (PLEG): container finished" podID="2469f2e9c9535df20f40dd7a985aa254" containerID="981652ee72af32b86fbcb5ff5208be1c1d0d03b624b90357458fc291e23c819d" exitCode=0
Jul 24 12:53:12.779337 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.779310    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"2469f2e9c9535df20f40dd7a985aa254","Type":"ContainerDied","Data":"981652ee72af32b86fbcb5ff5208be1c1d0d03b624b90357458fc291e23c819d"}
Jul 24 12:53:12.785344 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.785305    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lmxhh" podStartSLOduration=4.105628841 podStartE2EDuration="23.785292418s" totalImagesPullingTime="19.679663577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:11.823513105 +0000 UTC m=+22.690748146" watchObservedRunningTime="2026-07-24 12:53:12.785292418 +0000 UTC m=+23.652527442"
Jul 24 12:53:12.785942 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.785911    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xrnvm" podStartSLOduration=3.210507435 podStartE2EDuration="22.785900465s" totalImagesPullingTime="19.57539303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:12.785387309 +0000 UTC m=+23.652622338" watchObservedRunningTime="2026-07-24 12:53:12.785900465 +0000 UTC m=+23.653135494"
Jul 24 12:53:12.822673 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.822626    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xtv6m" podStartSLOduration=4.244398891 podStartE2EDuration="23.822608603s" totalImagesPullingTime="19.578209712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:12.82196305 +0000 UTC m=+23.689198081" watchObservedRunningTime="2026-07-24 12:53:12.822608603 +0000 UTC m=+23.689843634"
Jul 24 12:53:12.868530 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.868490    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-phqqp" podStartSLOduration=4.264288244 podStartE2EDuration="23.868476769s" totalImagesPullingTime="19.604188525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:12.868184283 +0000 UTC m=+23.735419314" watchObservedRunningTime="2026-07-24 12:53:12.868476769 +0000 UTC m=+23.735711798"
Jul 24 12:53:12.868673 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:12.868652    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kbpx8" podStartSLOduration=4.272515348 podStartE2EDuration="23.868647509s" totalImagesPullingTime="19.596132161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:12.852686614 +0000 UTC m=+23.719921643" watchObservedRunningTime="2026-07-24 12:53:12.868647509 +0000 UTC m=+23.735882539"
Jul 24 12:53:13.162720 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.162694    2528 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 12:53:13.517999 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.517895    2528 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T12:53:13.162712205Z","UUID":"4684ebe3-785f-4cd3-81be-1072da7de3c3","Handler":null,"Name":"","Endpoint":""}
Jul 24 12:53:13.520230 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.520204    2528 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 12:53:13.520387 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.520245    2528 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 12:53:13.627040 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.627007    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:13.627040 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.627029    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:13.627386 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:13.627146    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:13.627386 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:13.627248    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:13.627386 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.627279    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:13.627386 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:13.627334    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:13.785353 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.785267    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb" event={"ID":"b7ecdb94-22fd-4802-8548-600e92c653fa","Type":"ContainerStarted","Data":"6133ec2ecda2c5082cb1fd1bdae8d42290067d1206ec3fe01d4ac7d65dece973"}
Jul 24 12:53:13.788179 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.788148    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"2469f2e9c9535df20f40dd7a985aa254","Type":"ContainerStarted","Data":"710bd3eb26a2611e68a72b2be196009d4ff5f2629a1d93d99cc54fba029fccda"}
Jul 24 12:53:13.806932 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:13.806883    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" podStartSLOduration=23.80686871 podStartE2EDuration="23.80686871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:13.806323146 +0000 UTC m=+24.673558177" watchObservedRunningTime="2026-07-24 12:53:13.80686871 +0000 UTC m=+24.674103741"
Jul 24 12:53:14.791154 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:14.791071    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb" event={"ID":"b7ecdb94-22fd-4802-8548-600e92c653fa","Type":"ContainerStarted","Data":"2f06a340f2eeae135c8ea4fdb91b2ff219eb57553dbd57347c1c77e30635735d"}
Jul 24 12:53:14.794344 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:14.794321    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"0fe1e9183cf47121a6194cf48df43e4bf4662dcb5f32634d067bcebf6cb6b058"}
Jul 24 12:53:14.816706 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:14.816663    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46lb" podStartSLOduration=3.634807849 podStartE2EDuration="25.816644419s" totalImagesPullingTime="22.18183657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:14.816181535 +0000 UTC m=+25.683416565" watchObservedRunningTime="2026-07-24 12:53:14.816644419 +0000 UTC m=+25.683879450"
Jul 24 12:53:15.627155 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:15.627118    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:15.627473 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:15.627123    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:15.627473 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:15.627125    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:15.627473 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:15.627332    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:15.627473 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:15.627411    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:15.627764 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:15.627504    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:16.128789 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:16.128744    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:53:16.129331 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:16.129314    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:53:16.798425 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:16.798387    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:53:16.798907 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:16.798890    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-phqqp"
Jul 24 12:53:17.627006 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.626840    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:17.627601 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.626845    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:17.627601 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:17.627080    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:17.627601 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.626890    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:17.627601 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:17.627165    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:17.627601 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:17.627236    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:17.806177 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.806078    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" event={"ID":"00d61db8-509e-4814-adb4-b5709b2a16ac","Type":"ContainerStarted","Data":"85a53264a968c477273704209298c1cc21eb7ae35fcc044b2eb7e5405bd289d2"}
Jul 24 12:53:17.806412 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.806355    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:53:17.806481 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.806414    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:53:17.808241 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.808217    2528 generic.go:356] "Generic (PLEG): container finished" podID="34e5d295-1c9c-4afd-910b-0866fbc3f772" containerID="e9cb289efbb4d9584867af4025e6e4cf4bd6de893adb59c8e4efe594bafd5c86" exitCode=0
Jul 24 12:53:17.808357 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.808263    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" event={"ID":"34e5d295-1c9c-4afd-910b-0866fbc3f772","Type":"ContainerDied","Data":"e9cb289efbb4d9584867af4025e6e4cf4bd6de893adb59c8e4efe594bafd5c86"}
Jul 24 12:53:17.822465 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.822445    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:53:17.822559 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.822532    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:53:17.878719 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:17.878676    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4" podStartSLOduration=8.238925082 podStartE2EDuration="27.878659802s" totalImagesPullingTime="19.63973472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:17.850491198 +0000 UTC m=+28.717726228" watchObservedRunningTime="2026-07-24 12:53:17.878659802 +0000 UTC m=+28.745894826"
Jul 24 12:53:18.811419 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:18.811066    2528 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 12:53:19.141549 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.141441    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z4mq5"]
Jul 24 12:53:19.141755 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.141570    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:19.141755 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:19.141657    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:19.144788 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.144764    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lxs42"]
Jul 24 12:53:19.144932 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.144857    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:19.144992 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:19.144966    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:19.145428 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.145402    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b28qt"]
Jul 24 12:53:19.145558 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.145489    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:19.145616 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:19.145567    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:19.352928 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.352901    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:53:19.815245 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.815216    2528 generic.go:356] "Generic (PLEG): container finished" podID="34e5d295-1c9c-4afd-910b-0866fbc3f772" containerID="925f3df509e69f051087169b2b7c017d8565601d673fd79e699c1cc48c096b8a" exitCode=0
Jul 24 12:53:19.815593 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:19.815311    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" event={"ID":"34e5d295-1c9c-4afd-910b-0866fbc3f772","Type":"ContainerDied","Data":"925f3df509e69f051087169b2b7c017d8565601d673fd79e699c1cc48c096b8a"}
Jul 24 12:53:20.627546 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:20.627514    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:20.627667 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:20.627606    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:20.627667 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:20.627614    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:20.627667 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:20.627611    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:20.627766 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:20.627679    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:20.627766 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:20.627753    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:22.627258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:22.627237    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:22.627572 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:22.627256    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:22.627572 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:22.627348    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4mq5" podUID="537a1161-4b9b-4c97-a708-7dd7c2128bb1"
Jul 24 12:53:22.627572 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:22.627402    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:22.627572 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:22.627511    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxs42" podUID="478d3296-f563-4290-9d13-6450fd8167e1"
Jul 24 12:53:22.627720 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:22.627618    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b28qt" podUID="b0a70d49-090c-4dc3-98f3-85619a05c775"
Jul 24 12:53:22.823279 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:22.823216    2528 generic.go:356] "Generic (PLEG): container finished" podID="34e5d295-1c9c-4afd-910b-0866fbc3f772" containerID="b2b5206e55e4096834503e3759fe6e33d3fab145c3f09aa46bce1077f0ee340a" exitCode=0
Jul 24 12:53:22.823279 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:22.823264    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" event={"ID":"34e5d295-1c9c-4afd-910b-0866fbc3f772","Type":"ContainerDied","Data":"b2b5206e55e4096834503e3759fe6e33d3fab145c3f09aa46bce1077f0ee340a"}
Jul 24 12:53:23.218101 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:23.218062    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:23.218250 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:23.218117    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:23.218250 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:23.218204    2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 12:53:23.218250 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:23.218205    2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:53:23.218344 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:23.218251    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret podName:b0a70d49-090c-4dc3-98f3-85619a05c775 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:55.218239304 +0000 UTC m=+66.085474313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret") pod "global-pull-secret-syncer-b28qt" (UID: "b0a70d49-090c-4dc3-98f3-85619a05c775") : object "kube-system"/"original-pull-secret" not registered
Jul 24 12:53:23.218344 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:23.218266    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs podName:478d3296-f563-4290-9d13-6450fd8167e1 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:55.218259169 +0000 UTC m=+66.085494177 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs") pod "network-metrics-daemon-lxs42" (UID: "478d3296-f563-4290-9d13-6450fd8167e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 12:53:23.319369 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:23.319339    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:23.319495 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:23.319452    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 12:53:23.319495 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:23.319467    2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 12:53:23.319495 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:23.319477    2528 projected.go:196] Error preparing data for projected volume kube-api-access-6s4w8 for pod openshift-network-diagnostics/network-check-target-z4mq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:53:23.319586 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:23.319520    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8 podName:537a1161-4b9b-4c97-a708-7dd7c2128bb1 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:55.319504896 +0000 UTC m=+66.186739906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s4w8" (UniqueName: "kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8") pod "network-check-target-z4mq5" (UID: "537a1161-4b9b-4c97-a708-7dd7c2128bb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 12:53:24.457539 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.457495    2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeReady"
Jul 24 12:53:24.458006 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.457608    2528 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 12:53:24.503876 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.503848    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-948ff885d-6wkpw"]
Jul 24 12:53:24.505593 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.505574    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.508368 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.508325    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"]
Jul 24 12:53:24.508614 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.508513    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 12:53:24.509513 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.509490    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 12:53:24.509513 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.509506    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfr64\""
Jul 24 12:53:24.509803 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.509773    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 12:53:24.510013 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.509989    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bff7c44df-l6pz9"]
Jul 24 12:53:24.510354 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.510321    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.512458 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.511702    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-krmkk"]
Jul 24 12:53:24.512458 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.511961    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.513621 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.513419    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q"]
Jul 24 12:53:24.513815 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.513573    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.513919 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.513598    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.514681 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.514605    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w27c9\""
Jul 24 12:53:24.515284 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.515265    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 24 12:53:24.515617 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.515319    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 12:53:24.516080 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.516061    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 24 12:53:24.516237 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.515908    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.516930 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.516911    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gbmm9\""
Jul 24 12:53:24.517022 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.516979    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.517078 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.517041    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 24 12:53:24.517236 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.517209    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 12:53:24.517314 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.517300    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.517550 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.517514    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 12:53:24.517823 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.517803    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.518021 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.518002    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 12:53:24.518137 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.518027    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 24 12:53:24.518137 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.518110    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.520291 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.520268    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mp2vt\""
Jul 24 12:53:24.520519 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.520498    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"]
Jul 24 12:53:24.520659 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.520642    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q"
Jul 24 12:53:24.528690 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.526439    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 12:53:24.528690 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.527007    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lczpn\""
Jul 24 12:53:24.528690 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.527070    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dl4wk"]
Jul 24 12:53:24.528690 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.527106    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.528690 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.527516    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.528690 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.527921    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:24.531601 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.531578    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nvgv5\""
Jul 24 12:53:24.531931 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.531891    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.532146 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.532129    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 24 12:53:24.532221 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.532132    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.533544 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.533523    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"]
Jul 24 12:53:24.534043 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.534024    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.536127 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.536109    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 24 12:53:24.537704 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.537681    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.537967 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.537899    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.538194 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.538176    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 24 12:53:24.538278 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.538235    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 24 12:53:24.538395 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.538380    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv"]
Jul 24 12:53:24.538479 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.538400    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ttm6r\""
Jul 24 12:53:24.538605 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.538524    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.542575 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.542558    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-948ff885d-6wkpw"]
Jul 24 12:53:24.542768 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.542747    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv"
Jul 24 12:53:24.542860 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.542830    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-krmkk"]
Jul 24 12:53:24.542916 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.542878    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"]
Jul 24 12:53:24.542997 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.542981    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"]
Jul 24 12:53:24.543742 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.543724    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 24 12:53:24.546254 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.546236    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xmmx9"]
Jul 24 12:53:24.546444 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.546424    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gb8ws\""
Jul 24 12:53:24.546775 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.546604    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.547282 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.547260    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 24 12:53:24.547389 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.547022    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.547452 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.547010    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.547731 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.547713    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 24 12:53:24.550278 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.550258    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.550443 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.550422    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.550532 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.550512    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 12:53:24.550650 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.550309    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.551408 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.551388    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"]
Jul 24 12:53:24.551504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.551439    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dl4wk"]
Jul 24 12:53:24.551564 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.551521    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bff7c44df-l6pz9"]
Jul 24 12:53:24.551564 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.551547    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 12:53:24.551665 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.551571    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"]
Jul 24 12:53:24.551665 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.551594    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv"]
Jul 24 12:53:24.551665 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.551621    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cm4kb"]
Jul 24 12:53:24.553442 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.553424    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xhvvw\""
Jul 24 12:53:24.554300 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.554284    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.554539 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.554519    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.556879 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.555651    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"]
Jul 24 12:53:24.556879 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.555738    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xmmx9"]
Jul 24 12:53:24.556879 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.555827    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kdvl7\""
Jul 24 12:53:24.556879 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.555948    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cm4kb"
Jul 24 12:53:24.558451 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.558432    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 12:53:24.558578 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.558503    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7xh6d\""
Jul 24 12:53:24.558795 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.558774    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 12:53:24.559005 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.558954    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 12:53:24.559133 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.559115    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 12:53:24.559272 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.559128    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 12:53:24.559401 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.559187    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vxgfg\""
Jul 24 12:53:24.560471 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.560452    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q"]
Jul 24 12:53:24.561384 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.561367    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cm4kb"]
Jul 24 12:53:24.626662 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.626640    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:24.626760 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.626641    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:24.626828 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.626648    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:24.627814 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.627784    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:24.627918 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.627816    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxd7k\" (UniqueName: \"kubernetes.io/projected/79b2befc-76b8-4d01-8d48-f4ce408b0e64-kube-api-access-sxd7k\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.627918 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.627839    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2accca2-63f7-4a38-a254-6c263c46b6c4-config\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.627918 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.627882    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-trusted-ca\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.627918 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.627914    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f7c78ef-5523-4980-8efd-01c82f503b00-ca-trust-extracted\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.627943    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-installation-pull-secrets\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.627983    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628009    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwj7\" (UniqueName: \"kubernetes.io/projected/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-kube-api-access-cjwj7\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628033    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntk8q\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-kube-api-access-ntk8q\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628056    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mpm2\" (UniqueName: \"kubernetes.io/projected/5719331e-0d15-4d71-ba61-f8203424fe14-kube-api-access-4mpm2\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628085    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2accca2-63f7-4a38-a254-6c263c46b6c4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628132    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-bound-sa-token\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628158    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c542e6f-6258-452c-a767-15d3f8b4db1d-tmp-dir\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.628203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628180    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gv7\" (UniqueName: \"kubernetes.io/projected/b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd-kube-api-access-26gv7\") pod \"volume-data-source-validator-549c6d54cf-gzl8q\" (UID: \"b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628228    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-stats-auth\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628255    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628281    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628303    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628327    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628360    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b2befc-76b8-4d01-8d48-f4ce408b0e64-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628384    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-certificates\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628406    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw82j\" (UniqueName: \"kubernetes.io/projected/be2a6a03-51b1-406b-a9ac-cd971cc86a67-kube-api-access-bw82j\") pod \"network-check-source-7d88cb55d8-ngmfv\" (UID: \"be2a6a03-51b1-406b-a9ac-cd971cc86a67\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628432    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-service-ca-bundle\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628457    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-serving-cert\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628478    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-trusted-ca\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628501    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-serving-cert\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628527    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9l55\" (UniqueName: \"kubernetes.io/projected/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-kube-api-access-q9l55\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628550    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5whc\" (UniqueName: \"kubernetes.io/projected/3c542e6f-6258-452c-a767-15d3f8b4db1d-kube-api-access-h5whc\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.628855 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628577    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-config\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628600    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkdq9\" (UniqueName: \"kubernetes.io/projected/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-kube-api-access-rkdq9\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628628    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-default-certificate\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628654    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c542e6f-6258-452c-a767-15d3f8b4db1d-config-volume\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628678    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsqkf\" (UniqueName: \"kubernetes.io/projected/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-kube-api-access-nsqkf\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628706    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6rhz\" (UniqueName: \"kubernetes.io/projected/e2accca2-63f7-4a38-a254-6c263c46b6c4-kube-api-access-h6rhz\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628731    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-snapshots\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628756    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-tmp\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628786    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628915    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b2befc-76b8-4d01-8d48-f4ce408b0e64-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.628960    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-image-registry-private-configuration\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.629046    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.629329    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.629357    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lv5pf\""
Jul 24 12:53:24.629736 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.629562    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 12:53:24.630303 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.629871    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-txwsv\""
Jul 24 12:53:24.718714 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.718650    2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phqqp_6acfad45-c25e-49b1-8377-5c091d68f531/konnectivity-agent/0.log" limit=1024
Jul 24 12:53:24.729714 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729689    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b2befc-76b8-4d01-8d48-f4ce408b0e64-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.729825 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729716    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-certificates\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.729825 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729739    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw82j\" (UniqueName: \"kubernetes.io/projected/be2a6a03-51b1-406b-a9ac-cd971cc86a67-kube-api-access-bw82j\") pod \"network-check-source-7d88cb55d8-ngmfv\" (UID: \"be2a6a03-51b1-406b-a9ac-cd971cc86a67\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv"
Jul 24 12:53:24.729825 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729764    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/098474b9-bea8-400b-8b57-45594e62d0a5-cert\") pod \"ingress-canary-cm4kb\" (UID: \"098474b9-bea8-400b-8b57-45594e62d0a5\") " pod="openshift-ingress-canary/ingress-canary-cm4kb"
Jul 24 12:53:24.729825 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729792    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-service-ca-bundle\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.730003 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729854    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-serving-cert\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.730003 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729893    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-trusted-ca\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.730003 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729923    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-serving-cert\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.730003 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729955    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9l55\" (UniqueName: \"kubernetes.io/projected/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-kube-api-access-q9l55\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.730003 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.729985    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5whc\" (UniqueName: \"kubernetes.io/projected/3c542e6f-6258-452c-a767-15d3f8b4db1d-kube-api-access-h5whc\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.730206 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730017    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-config\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.730206 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730046    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkdq9\" (UniqueName: \"kubernetes.io/projected/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-kube-api-access-rkdq9\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.730206 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730082    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-default-certificate\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.730206 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730139    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c542e6f-6258-452c-a767-15d3f8b4db1d-config-volume\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.730206 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730168    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqkf\" (UniqueName: \"kubernetes.io/projected/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-kube-api-access-nsqkf\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:24.730206 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730201    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6rhz\" (UniqueName: \"kubernetes.io/projected/e2accca2-63f7-4a38-a254-6c263c46b6c4-kube-api-access-h6rhz\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.730416 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730229    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-snapshots\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.730416 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730257    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-tmp\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.730416 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730290    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l96c\" (UniqueName: \"kubernetes.io/projected/098474b9-bea8-400b-8b57-45594e62d0a5-kube-api-access-2l96c\") pod \"ingress-canary-cm4kb\" (UID: \"098474b9-bea8-400b-8b57-45594e62d0a5\") " pod="openshift-ingress-canary/ingress-canary-cm4kb"
Jul 24 12:53:24.730416 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730321    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.730416 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730370    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b2befc-76b8-4d01-8d48-f4ce408b0e64-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.730416 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730398    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-image-registry-private-configuration\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730449    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-certificates\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.730536    2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730580    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-service-ca-bundle\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.730598    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:25.23058042 +0000 UTC m=+36.097815431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : secret "router-metrics-certs-default" not found
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730452    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730630    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730651    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxd7k\" (UniqueName: \"kubernetes.io/projected/79b2befc-76b8-4d01-8d48-f4ce408b0e64-kube-api-access-sxd7k\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730669    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2accca2-63f7-4a38-a254-6c263c46b6c4-config\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.730689 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730688    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-trusted-ca\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730708    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f7c78ef-5523-4980-8efd-01c82f503b00-ca-trust-extracted\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730725    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-installation-pull-secrets\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730758    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730779    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwj7\" (UniqueName: \"kubernetes.io/projected/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-kube-api-access-cjwj7\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730795    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntk8q\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-kube-api-access-ntk8q\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730862    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mpm2\" (UniqueName: \"kubernetes.io/projected/5719331e-0d15-4d71-ba61-f8203424fe14-kube-api-access-4mpm2\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.730871    2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.730888    2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948ff885d-6wkpw: secret "image-registry-tls" not found
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730929    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2accca2-63f7-4a38-a254-6c263c46b6c4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730961    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-bound-sa-token\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730983    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c542e6f-6258-452c-a767-15d3f8b4db1d-tmp-dir\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.731016    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26gv7\" (UniqueName: \"kubernetes.io/projected/b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd-kube-api-access-26gv7\") pod \"volume-data-source-validator-549c6d54cf-gzl8q\" (UID: \"b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.731061    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-stats-auth\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.731079 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.731082    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.731638 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.731132    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.731638 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.731153    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.731638 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.731173    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.731638 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.731438    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-snapshots\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.731801 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.731662    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-config\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.732785 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.732020    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.732785 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.732127    2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 12:53:24.732785 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.732187    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls podName:e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:25.232168557 +0000 UTC m=+36.099403567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls") pod "cluster-samples-operator-6748489656-d7ggc" (UID: "e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2") : secret "samples-operator-tls" not found
Jul 24 12:53:24.732785 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.732568    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b2befc-76b8-4d01-8d48-f4ce408b0e64-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.732785 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.732617    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls podName:2f7c78ef-5523-4980-8efd-01c82f503b00 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:25.232595836 +0000 UTC m=+36.099830850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls") pod "image-registry-948ff885d-6wkpw" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00") : secret "image-registry-tls" not found
Jul 24 12:53:24.733116 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.732794    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c542e6f-6258-452c-a767-15d3f8b4db1d-config-volume\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.733116 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.733013    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-tmp\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.733116 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.733071    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c542e6f-6258-452c-a767-15d3f8b4db1d-tmp-dir\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.733329 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.733303    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f7c78ef-5523-4980-8efd-01c82f503b00-ca-trust-extracted\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.733917 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.733888    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-trusted-ca\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.733996 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.733975    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:25.23395873 +0000 UTC m=+36.101193761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : configmap references non-existent config key: service-ca.crt
Jul 24 12:53:24.733996 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.730869    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-trusted-ca\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.734327 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.734135    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2accca2-63f7-4a38-a254-6c263c46b6c4-config\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.734327 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.734223    2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 12:53:24.734327 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.734234    2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:24.734327 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.734270    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls podName:3c542e6f-6258-452c-a767-15d3f8b4db1d nodeName:}" failed. No retries permitted until 2026-07-24 12:53:25.234256942 +0000 UTC m=+36.101491950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls") pod "dns-default-xmmx9" (UID: "3c542e6f-6258-452c-a767-15d3f8b4db1d") : secret "dns-default-metrics-tls" not found
Jul 24 12:53:24.734327 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:24.734288    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls podName:4c7a0e2e-be87-44c0-8e86-c0d305ef70f4 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:25.234278482 +0000 UTC m=+36.101513506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-j74fb" (UID: "4c7a0e2e-be87-44c0-8e86-c0d305ef70f4") : secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:24.735068 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.735019    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.735674 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.735648    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-default-certificate\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.736333 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.736290    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-serving-cert\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.737063 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.736858    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2accca2-63f7-4a38-a254-6c263c46b6c4-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.737063 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.736921    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-serving-cert\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.737063 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.737027    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b2befc-76b8-4d01-8d48-f4ce408b0e64-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.737063 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.737030    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-image-registry-private-configuration\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.737768 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.737719    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-stats-auth\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.738656 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.738622    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-installation-pull-secrets\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.740431 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.740126    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5whc\" (UniqueName: \"kubernetes.io/projected/3c542e6f-6258-452c-a767-15d3f8b4db1d-kube-api-access-h5whc\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:24.744917 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.744200    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw82j\" (UniqueName: \"kubernetes.io/projected/be2a6a03-51b1-406b-a9ac-cd971cc86a67-kube-api-access-bw82j\") pod \"network-check-source-7d88cb55d8-ngmfv\" (UID: \"be2a6a03-51b1-406b-a9ac-cd971cc86a67\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv"
Jul 24 12:53:24.744917 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.744658    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-bound-sa-token\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.745181 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.745083    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxd7k\" (UniqueName: \"kubernetes.io/projected/79b2befc-76b8-4d01-8d48-f4ce408b0e64-kube-api-access-sxd7k\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-42skj\" (UID: \"79b2befc-76b8-4d01-8d48-f4ce408b0e64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.745299 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.745129    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwj7\" (UniqueName: \"kubernetes.io/projected/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-kube-api-access-cjwj7\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:24.745682 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.745574    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkdq9\" (UniqueName: \"kubernetes.io/projected/a2bd0efd-2ad2-4ac9-999a-6755c799edfd-kube-api-access-rkdq9\") pod \"insights-operator-5885fdb759-krmkk\" (UID: \"a2bd0efd-2ad2-4ac9-999a-6755c799edfd\") " pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.746627 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.746597    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqkf\" (UniqueName: \"kubernetes.io/projected/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-kube-api-access-nsqkf\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:24.749859 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.749842    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gv7\" (UniqueName: \"kubernetes.io/projected/b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd-kube-api-access-26gv7\") pod \"volume-data-source-validator-549c6d54cf-gzl8q\" (UID: \"b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q"
Jul 24 12:53:24.750031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.749979    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9l55\" (UniqueName: \"kubernetes.io/projected/722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8-kube-api-access-q9l55\") pod \"console-operator-584dcb6b54-dl4wk\" (UID: \"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8\") " pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.753230 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.750240    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntk8q\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-kube-api-access-ntk8q\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:24.753230 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.750742    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mpm2\" (UniqueName: \"kubernetes.io/projected/5719331e-0d15-4d71-ba61-f8203424fe14-kube-api-access-4mpm2\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:24.754076 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.753824    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6rhz\" (UniqueName: \"kubernetes.io/projected/e2accca2-63f7-4a38-a254-6c263c46b6c4-kube-api-access-h6rhz\") pod \"service-ca-operator-5d6c75f84f-gmvp2\" (UID: \"e2accca2-63f7-4a38-a254-6c263c46b6c4\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.812311 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.812285    2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phqqp_6acfad45-c25e-49b1-8377-5c091d68f531/konnectivity-agent/0.log" limit=1024
Jul 24 12:53:24.832284 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.832261    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/098474b9-bea8-400b-8b57-45594e62d0a5-cert\") pod \"ingress-canary-cm4kb\" (UID: \"098474b9-bea8-400b-8b57-45594e62d0a5\") " pod="openshift-ingress-canary/ingress-canary-cm4kb"
Jul 24 12:53:24.832396 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.832302    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l96c\" (UniqueName: \"kubernetes.io/projected/098474b9-bea8-400b-8b57-45594e62d0a5-kube-api-access-2l96c\") pod \"ingress-canary-cm4kb\" (UID: \"098474b9-bea8-400b-8b57-45594e62d0a5\") " pod="openshift-ingress-canary/ingress-canary-cm4kb"
Jul 24 12:53:24.834779 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.834757    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/098474b9-bea8-400b-8b57-45594e62d0a5-cert\") pod \"ingress-canary-cm4kb\" (UID: \"098474b9-bea8-400b-8b57-45594e62d0a5\") " pod="openshift-ingress-canary/ingress-canary-cm4kb"
Jul 24 12:53:24.841533 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.841514    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l96c\" (UniqueName: \"kubernetes.io/projected/098474b9-bea8-400b-8b57-45594e62d0a5-kube-api-access-2l96c\") pod \"ingress-canary-cm4kb\" (UID: \"098474b9-bea8-400b-8b57-45594e62d0a5\") " pod="openshift-ingress-canary/ingress-canary-cm4kb"
Jul 24 12:53:24.859563 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.859541    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-krmkk"
Jul 24 12:53:24.867591 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.867573    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q"
Jul 24 12:53:24.883523 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.883501    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:24.891430 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.891409    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"
Jul 24 12:53:24.899300 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.899140    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv"
Jul 24 12:53:24.906244 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.906212    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"
Jul 24 12:53:24.921556 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:24.921351    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cm4kb"
Jul 24 12:53:25.166277 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.165901    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj"]
Jul 24 12:53:25.169025 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.168938    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dl4wk"]
Jul 24 12:53:25.170241 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.170211    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv"]
Jul 24 12:53:25.170934 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:25.170893    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b2befc_76b8_4d01_8d48_f4ce408b0e64.slice/crio-861c1a69fa0a13c8e95f5a451f7a98688c89c4b1ba1e545c73a00c5a627a1a40 WatchSource:0}: Error finding container 861c1a69fa0a13c8e95f5a451f7a98688c89c4b1ba1e545c73a00c5a627a1a40: Status 404 returned error can't find the container with id 861c1a69fa0a13c8e95f5a451f7a98688c89c4b1ba1e545c73a00c5a627a1a40
Jul 24 12:53:25.172061 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:25.172013    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2a6a03_51b1_406b_a9ac_cd971cc86a67.slice/crio-4a5b1ca7745e74be12ccd43f88467a85733f401a94cd2c09501f87cace673051 WatchSource:0}: Error finding container 4a5b1ca7745e74be12ccd43f88467a85733f401a94cd2c09501f87cace673051: Status 404 returned error can't find the container with id 4a5b1ca7745e74be12ccd43f88467a85733f401a94cd2c09501f87cace673051
Jul 24 12:53:25.172334 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.172316    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-krmkk"]
Jul 24 12:53:25.174304 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:25.174201    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722a7257_aa02_4fa6_bfd3_eb82f8fcfdb8.slice/crio-cc53abea6055c42af7ad9098d0588e8cbd55a3094f846e7e99f1d014a23777c2 WatchSource:0}: Error finding container cc53abea6055c42af7ad9098d0588e8cbd55a3094f846e7e99f1d014a23777c2: Status 404 returned error can't find the container with id cc53abea6055c42af7ad9098d0588e8cbd55a3094f846e7e99f1d014a23777c2
Jul 24 12:53:25.174735 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:25.174701    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bd0efd_2ad2_4ac9_999a_6755c799edfd.slice/crio-2373d25d88a37b8ed0ac019a8506837771ee84fafe8ed14b0398c2fc0fffff76 WatchSource:0}: Error finding container 2373d25d88a37b8ed0ac019a8506837771ee84fafe8ed14b0398c2fc0fffff76: Status 404 returned error can't find the container with id 2373d25d88a37b8ed0ac019a8506837771ee84fafe8ed14b0398c2fc0fffff76
Jul 24 12:53:25.180730 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.180713    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cm4kb"]
Jul 24 12:53:25.183809 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:25.183787    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098474b9_bea8_400b_8b57_45594e62d0a5.slice/crio-27778ab49d9b9f27c872631a0ce50bb86d4b2987f66e7fcd0438c6614c18981c WatchSource:0}: Error finding container 27778ab49d9b9f27c872631a0ce50bb86d4b2987f66e7fcd0438c6614c18981c: Status 404 returned error can't find the container with id 27778ab49d9b9f27c872631a0ce50bb86d4b2987f66e7fcd0438c6614c18981c
Jul 24 12:53:25.188924 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.188899    2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phqqp_6acfad45-c25e-49b1-8377-5c091d68f531/konnectivity-agent/0.log" limit=1024
Jul 24 12:53:25.196369 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.196286    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2"]
Jul 24 12:53:25.198868 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:25.198847    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2accca2_63f7_4a38_a254_6c263c46b6c4.slice/crio-2b53c3aa61b5da85704efea7e7175730f275d61ee37f6d657f7f27cff0ca10c7 WatchSource:0}: Error finding container 2b53c3aa61b5da85704efea7e7175730f275d61ee37f6d657f7f27cff0ca10c7: Status 404 returned error can't find the container with id 2b53c3aa61b5da85704efea7e7175730f275d61ee37f6d657f7f27cff0ca10c7
Jul 24 12:53:25.246204 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.246148    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:25.246291 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.246226    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:25.246291 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.246253    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:25.246390 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246314    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:26.246299019 +0000 UTC m=+37.113534240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : configmap references non-existent config key: service-ca.crt
Jul 24 12:53:25.246390 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.246348    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:25.246390 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.246380    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:25.246390 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246385    2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246386    2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.246400    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246432    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls podName:3c542e6f-6258-452c-a767-15d3f8b4db1d nodeName:}" failed. No retries permitted until 2026-07-24 12:53:26.246417048 +0000 UTC m=+37.113652055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls") pod "dns-default-xmmx9" (UID: "3c542e6f-6258-452c-a767-15d3f8b4db1d") : secret "dns-default-metrics-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246450    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls podName:4c7a0e2e-be87-44c0-8e86-c0d305ef70f4 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:26.246440944 +0000 UTC m=+37.113675955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-j74fb" (UID: "4c7a0e2e-be87-44c0-8e86-c0d305ef70f4") : secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246469    2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246478    2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948ff885d-6wkpw: secret "image-registry-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246503    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls podName:2f7c78ef-5523-4980-8efd-01c82f503b00 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:26.246492553 +0000 UTC m=+37.113727561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls") pod "image-registry-948ff885d-6wkpw" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00") : secret "image-registry-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246511    2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246543    2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246550    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls podName:e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:26.246538178 +0000 UTC m=+37.113773190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls") pod "cluster-samples-operator-6748489656-d7ggc" (UID: "e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2") : secret "samples-operator-tls" not found
Jul 24 12:53:25.246596 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:25.246564    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:26.246557597 +0000 UTC m=+37.113792604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : secret "router-metrics-certs-default" not found
Jul 24 12:53:25.261016 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.260992    2528 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phqqp_6acfad45-c25e-49b1-8377-5c091d68f531/konnectivity-agent/0.log" limit=1024
Jul 24 12:53:25.282078 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.282054    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q"]
Jul 24 12:53:25.284922 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:25.284902    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb967ff7e_a6c1_4f96_8ea8_1fa08c1208dd.slice/crio-7723ad0c7c91e28090a2e6cae5734a84f29ed86a17b7423618183a21aea86317 WatchSource:0}: Error finding container 7723ad0c7c91e28090a2e6cae5734a84f29ed86a17b7423618183a21aea86317: Status 404 returned error can't find the container with id 7723ad0c7c91e28090a2e6cae5734a84f29ed86a17b7423618183a21aea86317
Jul 24 12:53:25.832942 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.832678    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cm4kb" event={"ID":"098474b9-bea8-400b-8b57-45594e62d0a5","Type":"ContainerStarted","Data":"27778ab49d9b9f27c872631a0ce50bb86d4b2987f66e7fcd0438c6614c18981c"}
Jul 24 12:53:25.835775 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.835704    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q" event={"ID":"b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd","Type":"ContainerStarted","Data":"7723ad0c7c91e28090a2e6cae5734a84f29ed86a17b7423618183a21aea86317"}
Jul 24 12:53:25.837531 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.837468    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-krmkk" event={"ID":"a2bd0efd-2ad2-4ac9-999a-6755c799edfd","Type":"ContainerStarted","Data":"2373d25d88a37b8ed0ac019a8506837771ee84fafe8ed14b0398c2fc0fffff76"}
Jul 24 12:53:25.838973 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.838908    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv" event={"ID":"be2a6a03-51b1-406b-a9ac-cd971cc86a67","Type":"ContainerStarted","Data":"4a5b1ca7745e74be12ccd43f88467a85733f401a94cd2c09501f87cace673051"}
Jul 24 12:53:25.840051 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.839969    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk" event={"ID":"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8","Type":"ContainerStarted","Data":"cc53abea6055c42af7ad9098d0588e8cbd55a3094f846e7e99f1d014a23777c2"}
Jul 24 12:53:25.841194 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.841137    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2" event={"ID":"e2accca2-63f7-4a38-a254-6c263c46b6c4","Type":"ContainerStarted","Data":"2b53c3aa61b5da85704efea7e7175730f275d61ee37f6d657f7f27cff0ca10c7"}
Jul 24 12:53:25.842694 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:25.842639    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj" event={"ID":"79b2befc-76b8-4d01-8d48-f4ce408b0e64","Type":"ContainerStarted","Data":"861c1a69fa0a13c8e95f5a451f7a98688c89c4b1ba1e545c73a00c5a627a1a40"}
Jul 24 12:53:26.256705 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:26.256668    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:26.256875 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:26.256759    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:26.256875 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:26.256792    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:26.256875 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:26.256869    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:26.257046 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:26.256918    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:26.257046 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:26.256955    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:26.257283 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257086    2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 12:53:26.257283 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257166    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls podName:e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:28.257148381 +0000 UTC m=+39.124383394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls") pod "cluster-samples-operator-6748489656-d7ggc" (UID: "e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2") : secret "samples-operator-tls" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257559    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:28.257545345 +0000 UTC m=+39.124780360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : configmap references non-existent config key: service-ca.crt
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257629    2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257679    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls podName:4c7a0e2e-be87-44c0-8e86-c0d305ef70f4 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:28.257662838 +0000 UTC m=+39.124897848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-j74fb" (UID: "4c7a0e2e-be87-44c0-8e86-c0d305ef70f4") : secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257732    2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257758    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls podName:3c542e6f-6258-452c-a767-15d3f8b4db1d nodeName:}" failed. No retries permitted until 2026-07-24 12:53:28.257749276 +0000 UTC m=+39.124984286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls") pod "dns-default-xmmx9" (UID: "3c542e6f-6258-452c-a767-15d3f8b4db1d") : secret "dns-default-metrics-tls" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257813    2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257826    2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948ff885d-6wkpw: secret "image-registry-tls" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257862    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls podName:2f7c78ef-5523-4980-8efd-01c82f503b00 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:28.257851567 +0000 UTC m=+39.125086589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls") pod "image-registry-948ff885d-6wkpw" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00") : secret "image-registry-tls" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257909    2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 12:53:26.257973 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:26.257934    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:28.257925842 +0000 UTC m=+39.125160864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : secret "router-metrics-certs-default" not found
Jul 24 12:53:28.277555 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:28.277516    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:28.277568    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:28.277651    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.277701    2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.277776    2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.277779    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:32.277758861 +0000 UTC m=+43.144993883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : secret "router-metrics-certs-default" not found
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.277840    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:32.277827101 +0000 UTC m=+43.145062112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : configmap references non-existent config key: service-ca.crt
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:28.277855    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:28.277887    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:28.277956    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.277966    2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.278020    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls podName:4c7a0e2e-be87-44c0-8e86-c0d305ef70f4 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:32.278005796 +0000 UTC m=+43.145240805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-j74fb" (UID: "4c7a0e2e-be87-44c0-8e86-c0d305ef70f4") : secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.278042    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls podName:e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:32.278033225 +0000 UTC m=+43.145268233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls") pod "cluster-samples-operator-6748489656-d7ggc" (UID: "e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2") : secret "samples-operator-tls" not found
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.278047    2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 12:53:28.278062 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.278059    2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948ff885d-6wkpw: secret "image-registry-tls" not found
Jul 24 12:53:28.278917 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.278086    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls podName:2f7c78ef-5523-4980-8efd-01c82f503b00 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:32.278078795 +0000 UTC m=+43.145313803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls") pod "image-registry-948ff885d-6wkpw" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00") : secret "image-registry-tls" not found
Jul 24 12:53:28.278917 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.278142    2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 12:53:28.278917 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:28.278181    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls podName:3c542e6f-6258-452c-a767-15d3f8b4db1d nodeName:}" failed. No retries permitted until 2026-07-24 12:53:32.278170648 +0000 UTC m=+43.145405656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls") pod "dns-default-xmmx9" (UID: "3c542e6f-6258-452c-a767-15d3f8b4db1d") : secret "dns-default-metrics-tls" not found
Jul 24 12:53:32.318722 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:32.318681    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:32.318776    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:32.318815    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:32.318884    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:32.318926    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.318931    2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:32.318952    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.318999    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:40.318959001 +0000 UTC m=+51.186194017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : configmap references non-existent config key: service-ca.crt
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319020    2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319026    2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319032    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls podName:4c7a0e2e-be87-44c0-8e86-c0d305ef70f4 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:40.319021894 +0000 UTC m=+51.186256910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-j74fb" (UID: "4c7a0e2e-be87-44c0-8e86-c0d305ef70f4") : secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319056    2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319023    2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319117    2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948ff885d-6wkpw: secret "image-registry-tls" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319083    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls podName:3c542e6f-6258-452c-a767-15d3f8b4db1d nodeName:}" failed. No retries permitted until 2026-07-24 12:53:40.319068069 +0000 UTC m=+51.186303077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls") pod "dns-default-xmmx9" (UID: "3c542e6f-6258-452c-a767-15d3f8b4db1d") : secret "dns-default-metrics-tls" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319147    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls podName:e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:40.319139408 +0000 UTC m=+51.186374417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls") pod "cluster-samples-operator-6748489656-d7ggc" (UID: "e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2") : secret "samples-operator-tls" not found
Jul 24 12:53:32.319144 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319158    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:40.319153072 +0000 UTC m=+51.186388080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : secret "router-metrics-certs-default" not found
Jul 24 12:53:32.319625 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:32.319168    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls podName:2f7c78ef-5523-4980-8efd-01c82f503b00 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:40.31916356 +0000 UTC m=+51.186398568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls") pod "image-registry-948ff885d-6wkpw" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00") : secret "image-registry-tls" not found
Jul 24 12:53:35.876884 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.876848    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv" event={"ID":"be2a6a03-51b1-406b-a9ac-cd971cc86a67","Type":"ContainerStarted","Data":"400887375b09b8a289a5841592524c7ec25e3a0d81addaa433f79f2eb864cb66"}
Jul 24 12:53:35.878717 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.878696    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/0.log"
Jul 24 12:53:35.878857 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.878732    2528 generic.go:356] "Generic (PLEG): container finished" podID="722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8" containerID="b9513e7332da606265a78a5160588e16513791c119c9ae9cb403edbf729f9b19" exitCode=255
Jul 24 12:53:35.878857 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.878798    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk" event={"ID":"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8","Type":"ContainerDied","Data":"b9513e7332da606265a78a5160588e16513791c119c9ae9cb403edbf729f9b19"}
Jul 24 12:53:35.879016 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.879000    2528 scope.go:117] "RemoveContainer" containerID="b9513e7332da606265a78a5160588e16513791c119c9ae9cb403edbf729f9b19"
Jul 24 12:53:35.882085 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.882059    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2" event={"ID":"e2accca2-63f7-4a38-a254-6c263c46b6c4","Type":"ContainerStarted","Data":"cc549adf519d87eb7b1e74cb4d03e8e3aece5b3660fd6f25c24079fbb5c8f383"}
Jul 24 12:53:35.885420 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.885375    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj" event={"ID":"79b2befc-76b8-4d01-8d48-f4ce408b0e64","Type":"ContainerStarted","Data":"17fd665cf4d7159f1e800639882b1dc319ffd22286c304475d93d4299ab05a81"}
Jul 24 12:53:35.888958 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.888926    2528 generic.go:356] "Generic (PLEG): container finished" podID="34e5d295-1c9c-4afd-910b-0866fbc3f772" containerID="24b81979cea940b6135ea4f629c683132c7d85401e38e82394e002481228162b" exitCode=0
Jul 24 12:53:35.889058 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.888994    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" event={"ID":"34e5d295-1c9c-4afd-910b-0866fbc3f772","Type":"ContainerDied","Data":"24b81979cea940b6135ea4f629c683132c7d85401e38e82394e002481228162b"}
Jul 24 12:53:35.893287 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.893243    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cm4kb" event={"ID":"098474b9-bea8-400b-8b57-45594e62d0a5","Type":"ContainerStarted","Data":"e82d613faae63224ad67b1788fc34a4f431420eaa17a467a2c120830bed642a3"}
Jul 24 12:53:35.896931 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.894961    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ngmfv" podStartSLOduration=5.142864831 podStartE2EDuration="14.894944318s" totalImagesPullingTime="9.752079487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:35.893527882 +0000 UTC m=+46.760762913" watchObservedRunningTime="2026-07-24 12:53:35.894944318 +0000 UTC m=+46.762179328"
Jul 24 12:53:35.897510 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.897456    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q" event={"ID":"b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd","Type":"ContainerStarted","Data":"5745238a864aae489fa4a9678baae3bcd363bce196eee89ef6cf7c6631c59d48"}
Jul 24 12:53:35.899253 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.899235    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-krmkk" event={"ID":"a2bd0efd-2ad2-4ac9-999a-6755c799edfd","Type":"ContainerStarted","Data":"3865dc26453535abd975716c53a98171117ccb0b44ce6d88949c6a987a84562e"}
Jul 24 12:53:35.927918 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.927875    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj" podStartSLOduration=7.174082265 podStartE2EDuration="16.927859098s" totalImagesPullingTime="9.753776833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:35.927649523 +0000 UTC m=+46.794884553" watchObservedRunningTime="2026-07-24 12:53:35.927859098 +0000 UTC m=+46.795094128"
Jul 24 12:53:35.978868 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:35.977442    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2" podStartSLOduration=5.250840028 podStartE2EDuration="14.977401245s" totalImagesPullingTime="9.726561217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:35.947695855 +0000 UTC m=+46.814930886" watchObservedRunningTime="2026-07-24 12:53:35.977401245 +0000 UTC m=+46.844636277"
Jul 24 12:53:36.029927 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.028557    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cm4kb" podStartSLOduration=2.278803867 podStartE2EDuration="12.028536773s" totalImagesPullingTime="9.749732906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:36.000635079 +0000 UTC m=+46.867870128" watchObservedRunningTime="2026-07-24 12:53:36.028536773 +0000 UTC m=+46.895771809"
Jul 24 12:53:36.029927 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.029725    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-krmkk" podStartSLOduration=15.331469835 podStartE2EDuration="25.029714586s" totalImagesPullingTime="9.698244751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:36.028080921 +0000 UTC m=+46.895315956" watchObservedRunningTime="2026-07-24 12:53:36.029714586 +0000 UTC m=+46.896949622"
Jul 24 12:53:36.066288 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.064625    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gzl8q" podStartSLOduration=12.423849729 podStartE2EDuration="22.064603704s" totalImagesPullingTime="9.640753975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:36.063153764 +0000 UTC m=+46.930388790" watchObservedRunningTime="2026-07-24 12:53:36.064603704 +0000 UTC m=+46.931838735"
Jul 24 12:53:36.160666 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.159255    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dz76g"]
Jul 24 12:53:36.170082 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.170055    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.173067 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.172815    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 12:53:36.173067 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.172817    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 12:53:36.175046 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.174862    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ttjr9\""
Jul 24 12:53:36.175979 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.175909    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dz76g"]
Jul 24 12:53:36.251760 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.251724    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b6a8507-1e6a-4296-ad33-6eab919f852a-crio-socket\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.251925 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.251880    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkp4f\" (UniqueName: \"kubernetes.io/projected/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-api-access-vkp4f\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.251925 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.251909    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.252042 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.251984    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.252042 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.252025    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b6a8507-1e6a-4296-ad33-6eab919f852a-data-volume\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.353457 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.353419    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkp4f\" (UniqueName: \"kubernetes.io/projected/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-api-access-vkp4f\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.353662 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.353472    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.353662 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.353549    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.353662 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.353582    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b6a8507-1e6a-4296-ad33-6eab919f852a-data-volume\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.353662 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.353623    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b6a8507-1e6a-4296-ad33-6eab919f852a-crio-socket\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.353878 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.353816    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b6a8507-1e6a-4296-ad33-6eab919f852a-crio-socket\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.353878 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.353842    2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:36.353981 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.353905    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:36.853884534 +0000 UTC m=+47.721119547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:36.354109 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.354066    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b6a8507-1e6a-4296-ad33-6eab919f852a-data-volume\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.354109 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.354071    2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 12:53:36.354254 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.354161    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:36.854147815 +0000 UTC m=+47.721382826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : configmap "kube-rbac-proxy" not found
Jul 24 12:53:36.369139 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.369078    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkp4f\" (UniqueName: \"kubernetes.io/projected/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-api-access-vkp4f\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.858065 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.858029    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.858240 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.858128    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:36.858240 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.858184    2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 12:53:36.858341 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.858256    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:37.858237646 +0000 UTC m=+48.725472654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : configmap "kube-rbac-proxy" not found
Jul 24 12:53:36.858341 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.858259    2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:36.858341 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.858291    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:37.858281292 +0000 UTC m=+48.725516300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:36.904945 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.904913    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 12:53:36.905361 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.905332    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/0.log"
Jul 24 12:53:36.905421 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.905362    2528 generic.go:356] "Generic (PLEG): container finished" podID="722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8" containerID="0816593b1d7799fb05108d60e0326f4592530d2011d7b5abe799f1e6dfa5f372" exitCode=255
Jul 24 12:53:36.905421 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.905391    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk" event={"ID":"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8","Type":"ContainerDied","Data":"0816593b1d7799fb05108d60e0326f4592530d2011d7b5abe799f1e6dfa5f372"}
Jul 24 12:53:36.908426 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.908403    2528 generic.go:356] "Generic (PLEG): container finished" podID="34e5d295-1c9c-4afd-910b-0866fbc3f772" containerID="c2180df209f6cc50a28a8f77d39d60fde096ad5bc14e8fea3954b50066a54f55" exitCode=0
Jul 24 12:53:36.908577 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.908506    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" event={"ID":"34e5d295-1c9c-4afd-910b-0866fbc3f772","Type":"ContainerDied","Data":"c2180df209f6cc50a28a8f77d39d60fde096ad5bc14e8fea3954b50066a54f55"}
Jul 24 12:53:36.916436 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.916415    2528 scope.go:117] "RemoveContainer" containerID="b9513e7332da606265a78a5160588e16513791c119c9ae9cb403edbf729f9b19"
Jul 24 12:53:36.916538 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:36.916520    2528 scope.go:117] "RemoveContainer" containerID="0816593b1d7799fb05108d60e0326f4592530d2011d7b5abe799f1e6dfa5f372"
Jul 24 12:53:36.916713 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:36.916690    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dl4wk_openshift-console-operator(722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk" podUID="722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8"
Jul 24 12:53:37.867723 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:37.867694    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:37.867912 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:37.867805    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:37.867912 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:37.867860    2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:37.867912 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:37.867877    2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 12:53:37.868029 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:37.867929    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:39.867916741 +0000 UTC m=+50.735151749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : configmap "kube-rbac-proxy" not found
Jul 24 12:53:37.868029 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:37.867943    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:39.867935413 +0000 UTC m=+50.735170420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:37.912850 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:37.912827    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 12:53:37.913226 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:37.913209    2528 scope.go:117] "RemoveContainer" containerID="0816593b1d7799fb05108d60e0326f4592530d2011d7b5abe799f1e6dfa5f372"
Jul 24 12:53:37.913407 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:37.913379    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dl4wk_openshift-console-operator(722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk" podUID="722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8"
Jul 24 12:53:37.916106 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:37.916071    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" event={"ID":"34e5d295-1c9c-4afd-910b-0866fbc3f772","Type":"ContainerStarted","Data":"6cc26a5522d68419d0e68228c7e11052d94eefa5f2bd6f2f1e933a94ff31a014"}
Jul 24 12:53:37.969801 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:37.969757    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gp2kc" podStartSLOduration=9.319886969 podStartE2EDuration="48.969743573s" totalImagesPullingTime="39.649856604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:37.967927543 +0000 UTC m=+48.835162575" watchObservedRunningTime="2026-07-24 12:53:37.969743573 +0000 UTC m=+48.836978616"
Jul 24 12:53:37.973363 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:37.973344    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xtv6m_b83ced7e-49b7-4e77-8409-5cb62fa48bfd/dns-node-resolver/0.log"
Jul 24 12:53:38.773015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:38.772988    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrnvm_6b5d92cd-a6d1-4203-b62f-19b8d8d313df/node-ca/0.log"
Jul 24 12:53:39.572155 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:39.572126    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cm4kb_098474b9-bea8-400b-8b57-45594e62d0a5/serve-healthcheck-canary/0.log"
Jul 24 12:53:39.884240 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:39.884156    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:39.884240 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:39.884230    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:39.884420 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:39.884282    2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 12:53:39.884420 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:39.884349    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:43.884333098 +0000 UTC m=+54.751568110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : configmap "kube-rbac-proxy" not found
Jul 24 12:53:39.884420 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:39.884377    2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:39.884518 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:39.884443    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:43.88443007 +0000 UTC m=+54.751665079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:40.390011 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:40.389973    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:40.390192 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:40.390049    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:40.390192 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:40.390073    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:40.390192 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:40.390136    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:40.390192 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:40.390166    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:40.390192 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390183    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:56.390165891 +0000 UTC m=+67.257400901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : configmap references non-existent config key: service-ca.crt
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390199    2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390227    2528 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:40.390231    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390251    2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390258    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls podName:4c7a0e2e-be87-44c0-8e86-c0d305ef70f4 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:56.390242268 +0000 UTC m=+67.257477278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-j74fb" (UID: "4c7a0e2e-be87-44c0-8e86-c0d305ef70f4") : secret "cluster-monitoring-operator-tls" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390284    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs podName:5719331e-0d15-4d71-ba61-f8203424fe14 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:56.390273695 +0000 UTC m=+67.257508708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs") pod "router-default-6bff7c44df-l6pz9" (UID: "5719331e-0d15-4d71-ba61-f8203424fe14") : secret "router-metrics-certs-default" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390290    2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390292    2528 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390304    2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948ff885d-6wkpw: secret "image-registry-tls" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390300    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls podName:3c542e6f-6258-452c-a767-15d3f8b4db1d nodeName:}" failed. No retries permitted until 2026-07-24 12:53:56.39029189 +0000 UTC m=+67.257526899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls") pod "dns-default-xmmx9" (UID: "3c542e6f-6258-452c-a767-15d3f8b4db1d") : secret "dns-default-metrics-tls" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390346    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls podName:e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:56.390334177 +0000 UTC m=+67.257569190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls") pod "cluster-samples-operator-6748489656-d7ggc" (UID: "e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2") : secret "samples-operator-tls" not found
Jul 24 12:53:40.390450 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:40.390364    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls podName:2f7c78ef-5523-4980-8efd-01c82f503b00 nodeName:}" failed. No retries permitted until 2026-07-24 12:53:56.39035492 +0000 UTC m=+67.257589938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls") pod "image-registry-948ff885d-6wkpw" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00") : secret "image-registry-tls" not found
Jul 24 12:53:43.921798 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:43.921761    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:43.922265 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:43.921847    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:43.922265 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:43.921990    2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:43.922265 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:43.922066    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls podName:6b6a8507-1e6a-4296-ad33-6eab919f852a nodeName:}" failed. No retries permitted until 2026-07-24 12:53:51.922051404 +0000 UTC m=+62.789286412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dz76g" (UID: "6b6a8507-1e6a-4296-ad33-6eab919f852a") : secret "insights-runtime-extractor-tls" not found
Jul 24 12:53:43.922391 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:43.922373    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b6a8507-1e6a-4296-ad33-6eab919f852a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:44.884453 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:44.884409    2528 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:44.884629 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:44.884475    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:44.884862 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:44.884843    2528 scope.go:117] "RemoveContainer" containerID="0816593b1d7799fb05108d60e0326f4592530d2011d7b5abe799f1e6dfa5f372"
Jul 24 12:53:44.885042 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:53:44.885019    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dl4wk_openshift-console-operator(722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk" podUID="722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8"
Jul 24 12:53:50.830380 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:50.830349    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkwt4"
Jul 24 12:53:51.991184 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:51.991154    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:51.993544 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:51.993515    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b6a8507-1e6a-4296-ad33-6eab919f852a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dz76g\" (UID: \"6b6a8507-1e6a-4296-ad33-6eab919f852a\") " pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:52.113629 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:52.113603    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ttjr9\""
Jul 24 12:53:52.121503 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:52.121486    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dz76g"
Jul 24 12:53:52.257753 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:52.257681    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dz76g"]
Jul 24 12:53:52.260831 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:52.260802    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6a8507_1e6a_4296_ad33_6eab919f852a.slice/crio-f73723d0b85b2c5bbec38506d8c2342e109aafa04e166af07cae7661c324fb1b WatchSource:0}: Error finding container f73723d0b85b2c5bbec38506d8c2342e109aafa04e166af07cae7661c324fb1b: Status 404 returned error can't find the container with id f73723d0b85b2c5bbec38506d8c2342e109aafa04e166af07cae7661c324fb1b
Jul 24 12:53:52.965423 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:52.965328    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dz76g" event={"ID":"6b6a8507-1e6a-4296-ad33-6eab919f852a","Type":"ContainerStarted","Data":"f73723d0b85b2c5bbec38506d8c2342e109aafa04e166af07cae7661c324fb1b"}
Jul 24 12:53:55.221033 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.220998    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:55.221501 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.221118    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:55.223461 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.223442    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 12:53:55.224297 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.224279    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 12:53:55.234532 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.234507    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b0a70d49-090c-4dc3-98f3-85619a05c775-original-pull-secret\") pod \"global-pull-secret-syncer-b28qt\" (UID: \"b0a70d49-090c-4dc3-98f3-85619a05c775\") " pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:55.234624 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.234530    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478d3296-f563-4290-9d13-6450fd8167e1-metrics-certs\") pod \"network-metrics-daemon-lxs42\" (UID: \"478d3296-f563-4290-9d13-6450fd8167e1\") " pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:55.240447 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.240429    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b28qt"
Jul 24 12:53:55.255324 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.255126    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-txwsv\""
Jul 24 12:53:55.263042 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.263021    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxs42"
Jul 24 12:53:55.322475 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.322446    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:55.325421 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.325403    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s4w8\" (UniqueName: \"kubernetes.io/projected/537a1161-4b9b-4c97-a708-7dd7c2128bb1-kube-api-access-6s4w8\") pod \"network-check-target-z4mq5\" (UID: \"537a1161-4b9b-4c97-a708-7dd7c2128bb1\") " pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:55.549512 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.549290    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lv5pf\""
Jul 24 12:53:55.558019 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.557983    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:55.627003 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:55.626974    2528 scope.go:117] "RemoveContainer" containerID="0816593b1d7799fb05108d60e0326f4592530d2011d7b5abe799f1e6dfa5f372"
Jul 24 12:53:56.433230 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.433203    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:56.433666 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.433251    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:56.433666 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.433282    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:56.433666 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.433317    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:56.433666 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.433373    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:56.433666 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.433403    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:56.434363 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.434264    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5719331e-0d15-4d71-ba61-f8203424fe14-service-ca-bundle\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:56.436275 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.436251    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"image-registry-948ff885d-6wkpw\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") " pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:56.436391 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.436361    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c542e6f-6258-452c-a767-15d3f8b4db1d-metrics-tls\") pod \"dns-default-xmmx9\" (UID: \"3c542e6f-6258-452c-a767-15d3f8b4db1d\") " pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:56.436464 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.436361    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c7a0e2e-be87-44c0-8e86-c0d305ef70f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-j74fb\" (UID: \"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:56.436529 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.436474    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-d7ggc\" (UID: \"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:56.436671 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.436654    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5719331e-0d15-4d71-ba61-f8203424fe14-metrics-certs\") pod \"router-default-6bff7c44df-l6pz9\" (UID: \"5719331e-0d15-4d71-ba61-f8203424fe14\") " pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:56.626770 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.626692    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfr64\""
Jul 24 12:53:56.634073 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.634039    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:56.634550 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.634530    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w27c9\""
Jul 24 12:53:56.642797 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.642779    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"
Jul 24 12:53:56.645305 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.645285    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gbmm9\""
Jul 24 12:53:56.653429 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.653411    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:56.678912 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.678892    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nvgv5\""
Jul 24 12:53:56.687014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.686998    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"
Jul 24 12:53:56.716554 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.716536    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7xh6d\""
Jul 24 12:53:56.724732 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:56.724713    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:53:57.224975 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.221948    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b28qt"]
Jul 24 12:53:57.274267 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.273939    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lxs42"]
Jul 24 12:53:57.307038 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.307006    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z4mq5"]
Jul 24 12:53:57.317896 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:57.317862    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537a1161_4b9b_4c97_a708_7dd7c2128bb1.slice/crio-a32b70bb856c73b08f3a61ca100bf11d8c78efac31a7d97d899114627e3eaf20 WatchSource:0}: Error finding container a32b70bb856c73b08f3a61ca100bf11d8c78efac31a7d97d899114627e3eaf20: Status 404 returned error can't find the container with id a32b70bb856c73b08f3a61ca100bf11d8c78efac31a7d97d899114627e3eaf20
Jul 24 12:53:57.327822 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.327750    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-948ff885d-6wkpw"]
Jul 24 12:53:57.330879 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.330526    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bff7c44df-l6pz9"]
Jul 24 12:53:57.335982 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:57.335941    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7c78ef_5523_4980_8efd_01c82f503b00.slice/crio-007f6a32ba9fc324c22978489df494b33e8678df3812414a104f053d68de3645 WatchSource:0}: Error finding container 007f6a32ba9fc324c22978489df494b33e8678df3812414a104f053d68de3645: Status 404 returned error can't find the container with id 007f6a32ba9fc324c22978489df494b33e8678df3812414a104f053d68de3645
Jul 24 12:53:57.337647 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:57.337625    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5719331e_0d15_4d71_ba61_f8203424fe14.slice/crio-ae1b2fb2edf7e421c828ccbfc721897cd96367ba2ffbbbf9730c168ee55f2efb WatchSource:0}: Error finding container ae1b2fb2edf7e421c828ccbfc721897cd96367ba2ffbbbf9730c168ee55f2efb: Status 404 returned error can't find the container with id ae1b2fb2edf7e421c828ccbfc721897cd96367ba2ffbbbf9730c168ee55f2efb
Jul 24 12:53:57.568049 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.567976    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xmmx9"]
Jul 24 12:53:57.571479 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.571416    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb"]
Jul 24 12:53:57.572436 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.572411    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc"]
Jul 24 12:53:57.573410 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:57.573271    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c542e6f_6258_452c_a767_15d3f8b4db1d.slice/crio-20fa8b2b1674c838d3f96913db1669230e39e4356ee4e2ea2f134e4ad0457b96 WatchSource:0}: Error finding container 20fa8b2b1674c838d3f96913db1669230e39e4356ee4e2ea2f134e4ad0457b96: Status 404 returned error can't find the container with id 20fa8b2b1674c838d3f96913db1669230e39e4356ee4e2ea2f134e4ad0457b96
Jul 24 12:53:57.575528 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:53:57.575470    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7a0e2e_be87_44c0_8e86_c0d305ef70f4.slice/crio-0ac20cd5129a78ce0b5da42c52244bac816a71a0d735a33ff9f6c7001ecb375a WatchSource:0}: Error finding container 0ac20cd5129a78ce0b5da42c52244bac816a71a0d735a33ff9f6c7001ecb375a: Status 404 returned error can't find the container with id 0ac20cd5129a78ce0b5da42c52244bac816a71a0d735a33ff9f6c7001ecb375a
Jul 24 12:53:57.987514 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.987423    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dz76g" event={"ID":"6b6a8507-1e6a-4296-ad33-6eab919f852a","Type":"ContainerStarted","Data":"0f233e13b254779e6692de1c23cb19c7e95809dada96105802fa35e55437774b"}
Jul 24 12:53:57.990768 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.990688    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmmx9" event={"ID":"3c542e6f-6258-452c-a767-15d3f8b4db1d","Type":"ContainerStarted","Data":"20fa8b2b1674c838d3f96913db1669230e39e4356ee4e2ea2f134e4ad0457b96"}
Jul 24 12:53:57.995216 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.994005    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 12:53:57.995216 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.994125    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk" event={"ID":"722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8","Type":"ContainerStarted","Data":"b3a6702928f0efa42ace2f56ebaaa0b994bada85b72e8b97453c56776aadd464"}
Jul 24 12:53:57.995216 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:57.995164    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:58.000506 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.000421    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxs42" event={"ID":"478d3296-f563-4290-9d13-6450fd8167e1","Type":"ContainerStarted","Data":"1bc4197fb5cdaa1e4c7797bbf7b823119fc28bc3d74688533e09eac9228c109a"}
Jul 24 12:53:58.009220 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.009158    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc" event={"ID":"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2","Type":"ContainerStarted","Data":"131c3d4992be1bb30980989881cee1f56cfefb4cd6a5d05a9a3ffaf08d50cd97"}
Jul 24 12:53:58.015505 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.012687    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-948ff885d-6wkpw" event={"ID":"2f7c78ef-5523-4980-8efd-01c82f503b00","Type":"ContainerStarted","Data":"f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e"}
Jul 24 12:53:58.015505 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.012739    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-948ff885d-6wkpw" event={"ID":"2f7c78ef-5523-4980-8efd-01c82f503b00","Type":"ContainerStarted","Data":"007f6a32ba9fc324c22978489df494b33e8678df3812414a104f053d68de3645"}
Jul 24 12:53:58.015505 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.013278    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:53:58.016882 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.016074    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk" podStartSLOduration=33.264017893 podStartE2EDuration="43.01605642s" totalImagesPullingTime="9.752038527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:58.015108109 +0000 UTC m=+68.882343133" watchObservedRunningTime="2026-07-24 12:53:58.01605642 +0000 UTC m=+68.883291454"
Jul 24 12:53:58.017762 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.017681    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bff7c44df-l6pz9" event={"ID":"5719331e-0d15-4d71-ba61-f8203424fe14","Type":"ContainerStarted","Data":"eee199d3e4e226e3199a942026f0871977f6c8799f4e048520b199ebbd763ad4"}
Jul 24 12:53:58.017762 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.017723    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bff7c44df-l6pz9" event={"ID":"5719331e-0d15-4d71-ba61-f8203424fe14","Type":"ContainerStarted","Data":"ae1b2fb2edf7e421c828ccbfc721897cd96367ba2ffbbbf9730c168ee55f2efb"}
Jul 24 12:53:58.019593 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.019531    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb" event={"ID":"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4","Type":"ContainerStarted","Data":"0ac20cd5129a78ce0b5da42c52244bac816a71a0d735a33ff9f6c7001ecb375a"}
Jul 24 12:53:58.025203 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.025178    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z4mq5" event={"ID":"537a1161-4b9b-4c97-a708-7dd7c2128bb1","Type":"ContainerStarted","Data":"0617fe43c96ceb71a61db7232c00c36a6f8c92a1d4bc941c12d258115ab26b93"}
Jul 24 12:53:58.025310 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.025222    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z4mq5" event={"ID":"537a1161-4b9b-4c97-a708-7dd7c2128bb1","Type":"ContainerStarted","Data":"a32b70bb856c73b08f3a61ca100bf11d8c78efac31a7d97d899114627e3eaf20"}
Jul 24 12:53:58.025310 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.025270    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:53:58.027398 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.027291    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b28qt" event={"ID":"b0a70d49-090c-4dc3-98f3-85619a05c775","Type":"ContainerStarted","Data":"798a385569d6d9292b8197fa33d12877cb99d9403a794de9b37ae229edd218f2"}
Jul 24 12:53:58.039027 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.038973    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-948ff885d-6wkpw" podStartSLOduration=68.038956479 podStartE2EDuration="1m8.038956479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:58.037388561 +0000 UTC m=+68.904623595" watchObservedRunningTime="2026-07-24 12:53:58.038956479 +0000 UTC m=+68.906191510"
Jul 24 12:53:58.057339 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.056944    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bff7c44df-l6pz9" podStartSLOduration=48.056930375 podStartE2EDuration="48.056930375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:58.055614043 +0000 UTC m=+68.922849075" watchObservedRunningTime="2026-07-24 12:53:58.056930375 +0000 UTC m=+68.924165385"
Jul 24 12:53:58.346326 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.343034    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-dl4wk"
Jul 24 12:53:58.384657 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.384349    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z4mq5" podStartSLOduration=69.384324981 podStartE2EDuration="1m9.384324981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:53:58.073744438 +0000 UTC m=+68.940979461" watchObservedRunningTime="2026-07-24 12:53:58.384324981 +0000 UTC m=+69.251560015"
Jul 24 12:53:58.653981 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.653842    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:58.657057 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:58.656832    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:59.036184 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:59.036159    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:53:59.038466 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:53:59.038443    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bff7c44df-l6pz9"
Jul 24 12:54:00.040471 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:00.040435    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxs42" event={"ID":"478d3296-f563-4290-9d13-6450fd8167e1","Type":"ContainerStarted","Data":"5632971e79d9bbc7686a8a9679e57427e2f8156acfabf462de0e486f02018ebc"}
Jul 24 12:54:06.076580 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.076540    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dz76g" event={"ID":"6b6a8507-1e6a-4296-ad33-6eab919f852a","Type":"ContainerStarted","Data":"caff7661c657839716e290580a710904537ede1cbe28bf6065f90e1a69ad178c"}
Jul 24 12:54:06.078455 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.078431    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmmx9" event={"ID":"3c542e6f-6258-452c-a767-15d3f8b4db1d","Type":"ContainerStarted","Data":"a374c4868abecced5d41c6e5be8f73598dfbf75cc1d17334ce57f042b27625cf"}
Jul 24 12:54:06.078591 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.078484    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmmx9" event={"ID":"3c542e6f-6258-452c-a767-15d3f8b4db1d","Type":"ContainerStarted","Data":"0d2e053d65baf8f81e0af4b2f607ee262fff76d9b804414de8b9ff4b85a2eaec"}
Jul 24 12:54:06.078591 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.078518    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:54:06.080201 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.080170    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxs42" event={"ID":"478d3296-f563-4290-9d13-6450fd8167e1","Type":"ContainerStarted","Data":"9e53f8edf6021e9efebce60112e573bc53fe4840e79bc3e8e87d6d622f02152d"}
Jul 24 12:54:06.081985 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.081962    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc" event={"ID":"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2","Type":"ContainerStarted","Data":"ccbbb863e9a076a0f9f3627bc2c486b06f8ea237120bedb990619502e05293ec"}
Jul 24 12:54:06.082085 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.082014    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc" event={"ID":"e4cef0a2-ab69-4a42-b6f4-5760e7c8a5f2","Type":"ContainerStarted","Data":"8ffa659f832ee03eb85ebdc5acbe8b982bcced631f5793d790092b72769e9d04"}
Jul 24 12:54:06.083547 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.083514    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb" event={"ID":"4c7a0e2e-be87-44c0-8e86-c0d305ef70f4","Type":"ContainerStarted","Data":"20b53c6d2284a6e4a983e6886b9099e99ccdf838144594a6dda3eb64f9443925"}
Jul 24 12:54:06.084950 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.084931    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b28qt" event={"ID":"b0a70d49-090c-4dc3-98f3-85619a05c775","Type":"ContainerStarted","Data":"9e2eb05ef961940d3c82419e7094f53c0b6cb944a1bf8b04c5093bdbc21efd7e"}
Jul 24 12:54:06.100013 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.099974    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xmmx9" podStartSLOduration=34.189406081 podStartE2EDuration="42.099961701s" totalImagesPullingTime="7.91055562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:06.098515311 +0000 UTC m=+76.965750344" watchObservedRunningTime="2026-07-24 12:54:06.099961701 +0000 UTC m=+76.967196796"
Jul 24 12:54:06.115999 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.115957    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lxs42" podStartSLOduration=75.129403697 podStartE2EDuration="1m17.115943585s" totalImagesPullingTime="1.986539888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:06.115039472 +0000 UTC m=+76.982274503" watchObservedRunningTime="2026-07-24 12:54:06.115943585 +0000 UTC m=+76.983178617"
Jul 24 12:54:06.132843 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.132771    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-j74fb" podStartSLOduration=48.221820273 podStartE2EDuration="56.132759062s" totalImagesPullingTime="7.910938789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:06.131794047 +0000 UTC m=+76.999029077" watchObservedRunningTime="2026-07-24 12:54:06.132759062 +0000 UTC m=+76.999994092"
Jul 24 12:54:06.152913 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.152787    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-d7ggc" podStartSLOduration=45.298393381 podStartE2EDuration="53.152772792s" totalImagesPullingTime="7.854379411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:06.15226849 +0000 UTC m=+77.019503521" watchObservedRunningTime="2026-07-24 12:54:06.152772792 +0000 UTC m=+77.020007823"
Jul 24 12:54:06.171157 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:06.171121    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b28qt" podStartSLOduration=67.945241207 podStartE2EDuration="1m16.171082984s" totalImagesPullingTime="8.225841777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:06.170831682 +0000 UTC m=+77.038066702" watchObservedRunningTime="2026-07-24 12:54:06.171082984 +0000 UTC m=+77.038317991"
Jul 24 12:54:08.094651 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.094485    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4d5cfcbd-9nflx"]
Jul 24 12:54:08.110737 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.110713    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.113650 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.113624    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 12:54:08.113804 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.113624    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b8dbp\""
Jul 24 12:54:08.114348 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.114326    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 12:54:08.114515 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.114501    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 12:54:08.115358 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.114928    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 12:54:08.115358 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.115156    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 12:54:08.115543 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.115528    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 12:54:08.116420 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.116396    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4d5cfcbd-9nflx"]
Jul 24 12:54:08.126804 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.126783    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 12:54:08.238796 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.238762    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-service-ca\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.238929 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.238812    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-console-config\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.238929 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.238907    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-oauth-serving-cert\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.239056 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.238960    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-serving-cert\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.239056 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.239045    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-oauth-config\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.239166 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.239083    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntk9c\" (UniqueName: \"kubernetes.io/projected/2b397daf-7213-4b04-b063-702245d1ce16-kube-api-access-ntk9c\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.340064 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.340027    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-serving-cert\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.340259 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.340104    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-oauth-config\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.340259 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.340145    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntk9c\" (UniqueName: \"kubernetes.io/projected/2b397daf-7213-4b04-b063-702245d1ce16-kube-api-access-ntk9c\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.340259 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.340187    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-service-ca\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.340259 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.340211    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-console-config\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.340259 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.340250    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-oauth-serving-cert\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.341008 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.340933    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-service-ca\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.341008 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.340964    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-oauth-serving-cert\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.341259 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.341233    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-console-config\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.343007 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.342949    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-oauth-config\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.343118 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.343022    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-serving-cert\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.349378 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.349308    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntk9c\" (UniqueName: \"kubernetes.io/projected/2b397daf-7213-4b04-b063-702245d1ce16-kube-api-access-ntk9c\") pod \"console-5b4d5cfcbd-9nflx\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") " pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:08.422988 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:08.422950    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:10.165838 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:10.165814    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4d5cfcbd-9nflx"]
Jul 24 12:54:10.167573 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:10.167544    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b397daf_7213_4b04_b063_702245d1ce16.slice/crio-3331a199cc6ef013a77369ee40b84b0e91b2c72cb1c887454139b8f354d96d8a WatchSource:0}: Error finding container 3331a199cc6ef013a77369ee40b84b0e91b2c72cb1c887454139b8f354d96d8a: Status 404 returned error can't find the container with id 3331a199cc6ef013a77369ee40b84b0e91b2c72cb1c887454139b8f354d96d8a
Jul 24 12:54:11.109596 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:11.109555    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4d5cfcbd-9nflx" event={"ID":"2b397daf-7213-4b04-b063-702245d1ce16","Type":"ContainerStarted","Data":"3331a199cc6ef013a77369ee40b84b0e91b2c72cb1c887454139b8f354d96d8a"}
Jul 24 12:54:11.112271 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:11.112206    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dz76g" event={"ID":"6b6a8507-1e6a-4296-ad33-6eab919f852a","Type":"ContainerStarted","Data":"89e547d3d1504f267b78fc73cb47229f42ea7f2a45240e55925f37c526d9b3f1"}
Jul 24 12:54:14.125145 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:14.125086    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4d5cfcbd-9nflx" event={"ID":"2b397daf-7213-4b04-b063-702245d1ce16","Type":"ContainerStarted","Data":"66a3ccce3a53d5636fe20c6f72df1751d3b8604e6da992ba13abb650d728620c"}
Jul 24 12:54:14.144429 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:14.144383    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dz76g" podStartSLOduration=20.288144719 podStartE2EDuration="38.14436644s" totalImagesPullingTime="17.856221721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 12:53:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:11.135202005 +0000 UTC m=+82.002437037" watchObservedRunningTime="2026-07-24 12:54:14.14436644 +0000 UTC m=+85.011601469"
Jul 24 12:54:14.144574 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:14.144477    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4d5cfcbd-9nflx" podStartSLOduration=3.178980646 podStartE2EDuration="6.144472985s" totalImagesPullingTime="2.965492339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:14.143064407 +0000 UTC m=+85.010299437" watchObservedRunningTime="2026-07-24 12:54:14.144472985 +0000 UTC m=+85.011708016"
Jul 24 12:54:15.673492 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.673457    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"]
Jul 24 12:54:15.675765 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.675746    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.678620 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.678595    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 12:54:15.678783 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.678764    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 12:54:15.678923 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.678907    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ccr5v\""
Jul 24 12:54:15.679599 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.679580    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 12:54:15.685695 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.685678    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"]
Jul 24 12:54:15.696762 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.696741    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"]
Jul 24 12:54:15.698910 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.698892    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.701450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.701430    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 12:54:15.701549 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.701468    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 12:54:15.701763 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.701747    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 12:54:15.701836 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.701803    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zgdx6\""
Jul 24 12:54:15.709877 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.709855    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"]
Jul 24 12:54:15.713902 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.713884    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dh5xb"]
Jul 24 12:54:15.715865 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.715851    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.718207 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.718186    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 12:54:15.718296 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.718230    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9srnh\""
Jul 24 12:54:15.718344 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.718305    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 12:54:15.718478 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.718462    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 12:54:15.799809 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.799761    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8c91953d-d93a-41fa-993a-e7ed6b434918-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.799960 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.799824    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8shbn\" (UniqueName: \"kubernetes.io/projected/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-kube-api-access-8shbn\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.799960 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.799873    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdnv6\" (UniqueName: \"kubernetes.io/projected/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-api-access-wdnv6\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.799960 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.799906    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.800184 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.799982    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.800184 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.800011    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.800184 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.800044    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c91953d-d93a-41fa-993a-e7ed6b434918-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.800184 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.800141    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.800387 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.800213    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.800387 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.800242    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.900857 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.900821    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-sys\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.900857 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.900860    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdnv6\" (UniqueName: \"kubernetes.io/projected/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-api-access-wdnv6\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.901029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.900884    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.901029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.900910    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b58ab2-1c76-47b9-9bef-272dec6929ba-metrics-client-ca\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.901029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.900938    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-textfile\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.901029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.900992    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.901029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901018    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.901258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901038    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-root\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.901258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901060    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c91953d-d93a-41fa-993a-e7ed6b434918-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.901258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901107    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.901258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901151    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.901258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901170    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5wh\" (UniqueName: \"kubernetes.io/projected/90b58ab2-1c76-47b9-9bef-272dec6929ba-kube-api-access-gs5wh\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.901258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901222    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-tls\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.901258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901244    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.901599 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901268    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.901599 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901296    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.901599 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901326    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8c91953d-d93a-41fa-993a-e7ed6b434918-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.901599 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:54:15.901344    2528 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 24 12:54:15.901599 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901357    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8shbn\" (UniqueName: \"kubernetes.io/projected/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-kube-api-access-8shbn\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.901599 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901386    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-wtmp\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:15.901599 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:54:15.901411    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-tls podName:7c2e9b57-e5a6-4810-80ca-2f980cf0d41a nodeName:}" failed. No retries permitted until 2026-07-24 12:54:16.401390258 +0000 UTC m=+87.268625273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-57gtd" (UID: "7c2e9b57-e5a6-4810-80ca-2f980cf0d41a") : secret "openshift-state-metrics-tls" not found
Jul 24 12:54:15.901954 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901935    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8c91953d-d93a-41fa-993a-e7ed6b434918-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.902015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.901986    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c91953d-d93a-41fa-993a-e7ed6b434918-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.902071 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.902051    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.902144 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.902068    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.903514 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.903491    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.904004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.903988    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:15.904108 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.904027    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.911826 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.911773    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdnv6\" (UniqueName: \"kubernetes.io/projected/8c91953d-d93a-41fa-993a-e7ed6b434918-kube-api-access-wdnv6\") pod \"kube-state-metrics-56d9f944b4-khttx\" (UID: \"8c91953d-d93a-41fa-993a-e7ed6b434918\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:15.913436 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:15.913411    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8shbn\" (UniqueName: \"kubernetes.io/projected/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-kube-api-access-8shbn\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:16.002031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.001949    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-tls\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.001996    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002233 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002136    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-wtmp\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002233 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002181    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-sys\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002310 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002226    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b58ab2-1c76-47b9-9bef-272dec6929ba-metrics-client-ca\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002310 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002238    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-sys\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002310 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002269    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-textfile\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002309    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-root\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002351    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-wtmp\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002404    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90b58ab2-1c76-47b9-9bef-272dec6929ba-root\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002450 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002436    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002652 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002473    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5wh\" (UniqueName: \"kubernetes.io/projected/90b58ab2-1c76-47b9-9bef-272dec6929ba-kube-api-access-gs5wh\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002652 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002630    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-textfile\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.002958 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.002938    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.003020 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.003003    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b58ab2-1c76-47b9-9bef-272dec6929ba-metrics-client-ca\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.004465 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.004445    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-tls\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.004596 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.004576    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b58ab2-1c76-47b9-9bef-272dec6929ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.007451 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.007436    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"
Jul 24 12:54:16.011501 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.011475    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5wh\" (UniqueName: \"kubernetes.io/projected/90b58ab2-1c76-47b9-9bef-272dec6929ba-kube-api-access-gs5wh\") pod \"node-exporter-dh5xb\" (UID: \"90b58ab2-1c76-47b9-9bef-272dec6929ba\") " pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.024440 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.024419    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dh5xb"
Jul 24 12:54:16.035990 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:16.035967    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b58ab2_1c76_47b9_9bef_272dec6929ba.slice/crio-a84673ddb6bda52e5d4270aae1e64e6a0d8604b164294becea00162a0e5fd6d3 WatchSource:0}: Error finding container a84673ddb6bda52e5d4270aae1e64e6a0d8604b164294becea00162a0e5fd6d3: Status 404 returned error can't find the container with id a84673ddb6bda52e5d4270aae1e64e6a0d8604b164294becea00162a0e5fd6d3
Jul 24 12:54:16.094998 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.094964    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xmmx9"
Jul 24 12:54:16.133876 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.133844    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh5xb" event={"ID":"90b58ab2-1c76-47b9-9bef-272dec6929ba","Type":"ContainerStarted","Data":"a84673ddb6bda52e5d4270aae1e64e6a0d8604b164294becea00162a0e5fd6d3"}
Jul 24 12:54:16.145759 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.145726    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-khttx"]
Jul 24 12:54:16.154109 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:16.154061    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c91953d_d93a_41fa_993a_e7ed6b434918.slice/crio-fa1f26ba69c5083dd6fb87c697e0ac6ba769fe0d9402c206e6da8e64018bfa96 WatchSource:0}: Error finding container fa1f26ba69c5083dd6fb87c697e0ac6ba769fe0d9402c206e6da8e64018bfa96: Status 404 returned error can't find the container with id fa1f26ba69c5083dd6fb87c697e0ac6ba769fe0d9402c206e6da8e64018bfa96
Jul 24 12:54:16.404664 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.404591    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:16.407062 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.407037    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c2e9b57-e5a6-4810-80ca-2f980cf0d41a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-57gtd\" (UID: \"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:16.585132 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.585085    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"
Jul 24 12:54:16.639216 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.638904    2528 patch_prober.go:28] interesting pod/image-registry-948ff885d-6wkpw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 12:54:16.639216 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.638963    2528 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-948ff885d-6wkpw" podUID="2f7c78ef-5523-4980-8efd-01c82f503b00" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 12:54:16.741015 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:16.740985    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd"]
Jul 24 12:54:16.892658 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:16.892622    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2e9b57_e5a6_4810_80ca_2f980cf0d41a.slice/crio-7f526b62a56d9d2768e42590ffcd216daf4ca8aa7ceafd9328690fbec47591b8 WatchSource:0}: Error finding container 7f526b62a56d9d2768e42590ffcd216daf4ca8aa7ceafd9328690fbec47591b8: Status 404 returned error can't find the container with id 7f526b62a56d9d2768e42590ffcd216daf4ca8aa7ceafd9328690fbec47591b8
Jul 24 12:54:17.140401 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:17.140369    2528 generic.go:356] "Generic (PLEG): container finished" podID="90b58ab2-1c76-47b9-9bef-272dec6929ba" containerID="dbf77aeceef21c496aec4c5b416c03a16d49ad36bfaf790b9d4b1d0e36571279" exitCode=0
Jul 24 12:54:17.140528 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:17.140488    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh5xb" event={"ID":"90b58ab2-1c76-47b9-9bef-272dec6929ba","Type":"ContainerDied","Data":"dbf77aeceef21c496aec4c5b416c03a16d49ad36bfaf790b9d4b1d0e36571279"}
Jul 24 12:54:17.142504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:17.142481    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd" event={"ID":"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a","Type":"ContainerStarted","Data":"22ecc9b2563ae1e9ca9bf64f285b6b2c13bb9551cc785dbe2b25716f403de425"}
Jul 24 12:54:17.142625 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:17.142534    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd" event={"ID":"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a","Type":"ContainerStarted","Data":"8f03e131b1d05cc0e051ff58f87e3fba0cce1aab37837ebb6ee8ef8feb29ed64"}
Jul 24 12:54:17.142625 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:17.142555    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd" event={"ID":"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a","Type":"ContainerStarted","Data":"7f526b62a56d9d2768e42590ffcd216daf4ca8aa7ceafd9328690fbec47591b8"}
Jul 24 12:54:17.143797 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:17.143776    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx" event={"ID":"8c91953d-d93a-41fa-993a-e7ed6b434918","Type":"ContainerStarted","Data":"fa1f26ba69c5083dd6fb87c697e0ac6ba769fe0d9402c206e6da8e64018bfa96"}
Jul 24 12:54:18.154461 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.154375    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx" event={"ID":"8c91953d-d93a-41fa-993a-e7ed6b434918","Type":"ContainerStarted","Data":"eb92abf4fe0322795108159741d94b4096cb93073f63a8867473f4ff7e93fd38"}
Jul 24 12:54:18.154461 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.154441    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx" event={"ID":"8c91953d-d93a-41fa-993a-e7ed6b434918","Type":"ContainerStarted","Data":"50dbb677df8f0b1ecc712f5eac6f3991995b407b2bd8e4a415e6aa0a8006e01e"}
Jul 24 12:54:18.154980 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.154464    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx" event={"ID":"8c91953d-d93a-41fa-993a-e7ed6b434918","Type":"ContainerStarted","Data":"11043d9108124819a9205474b6a08964ee4fac65046d9c7ce7debc038494a4d3"}
Jul 24 12:54:18.156960 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.156932    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh5xb" event={"ID":"90b58ab2-1c76-47b9-9bef-272dec6929ba","Type":"ContainerStarted","Data":"ed2cc9154c70a9c4bf36a14aae46381fb8cb02125080e8edb55be9db17e277e3"}
Jul 24 12:54:18.157108 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.156983    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh5xb" event={"ID":"90b58ab2-1c76-47b9-9bef-272dec6929ba","Type":"ContainerStarted","Data":"5594d56945f2554128a0a1c70f305a7bd66a11e617ca0d648aa19914d2848bdb"}
Jul 24 12:54:18.178289 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.178248    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-khttx" podStartSLOduration=1.661323351 podStartE2EDuration="3.178232469s" totalImagesPullingTime="1.516909118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:18.177430685 +0000 UTC m=+89.044665716" watchObservedRunningTime="2026-07-24 12:54:18.178232469 +0000 UTC m=+89.045467495"
Jul 24 12:54:18.197774 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.197735    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dh5xb" podStartSLOduration=2.223692161 podStartE2EDuration="3.197721472s" totalImagesPullingTime="889.667587ms" totalInitContainerRuntime="84.361724ms" isStatefulPod=true podCreationTimestamp="2026-07-24 12:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:18.196580816 +0000 UTC m=+89.063815848" watchObservedRunningTime="2026-07-24 12:54:18.197721472 +0000 UTC m=+89.064956502"
Jul 24 12:54:18.423960 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.423931    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:18.424119 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.423996    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:18.428405 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.428385    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:18.690528 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.690458    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"]
Jul 24 12:54:18.693185 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.693165    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.695817 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.695792    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 12:54:18.695932 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.695864    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 12:54:18.696031 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.696018    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 12:54:18.696129 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.696108    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 12:54:18.696201 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.696136    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3lh3vap1g199c\""
Jul 24 12:54:18.696254 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.696221    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fnf55\""
Jul 24 12:54:18.696254 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.696246    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 12:54:18.707259 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.707235    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"]
Jul 24 12:54:18.724355 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.724331    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-grpc-tls\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.724435 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.724363    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-tls\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.724435 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.724390    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.724505 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.724451    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.724541 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.724510    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.724571 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.724543    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.724608 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.724568    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jhk\" (UniqueName: \"kubernetes.io/projected/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-kube-api-access-t7jhk\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.724641 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.724618    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-metrics-client-ca\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.824971 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.824944    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.825073 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.824981    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.825073 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.825005    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jhk\" (UniqueName: \"kubernetes.io/projected/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-kube-api-access-t7jhk\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.825073 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.825037    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-metrics-client-ca\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.825073 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.825066    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-grpc-tls\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.825318 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.825116    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-tls\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.825318 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.825155    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.825318 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.825197    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.826069 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.826046    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-metrics-client-ca\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.827872 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.827825    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.828009 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.827988    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-grpc-tls\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.828262 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.828239    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.828352 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.828286    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-tls\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.828352 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.828329    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.828352 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.828343    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:18.833349 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:18.833332    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jhk\" (UniqueName: \"kubernetes.io/projected/8b8ebb39-cfe7-4c42-8b84-46bb55a8f613-kube-api-access-t7jhk\") pod \"thanos-querier-5bf4698d4d-5lpbp\" (UID: \"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613\") " pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:19.002263 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:19.002208    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:19.136482 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:19.136455    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"]
Jul 24 12:54:19.138779 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:19.138753    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8ebb39_cfe7_4c42_8b84_46bb55a8f613.slice/crio-3e3309018d2af3f263c6accfceba8d225f381efd334537f1292cf54161a34e58 WatchSource:0}: Error finding container 3e3309018d2af3f263c6accfceba8d225f381efd334537f1292cf54161a34e58: Status 404 returned error can't find the container with id 3e3309018d2af3f263c6accfceba8d225f381efd334537f1292cf54161a34e58
Jul 24 12:54:19.162508 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:19.162483    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd" event={"ID":"7c2e9b57-e5a6-4810-80ca-2f980cf0d41a","Type":"ContainerStarted","Data":"b41ba6c25a66b29e7041b1c29b0a69a608ae711f92f7ec19d6942ce6883a54d4"}
Jul 24 12:54:19.163724 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:19.163702    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp" event={"ID":"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613","Type":"ContainerStarted","Data":"3e3309018d2af3f263c6accfceba8d225f381efd334537f1292cf54161a34e58"}
Jul 24 12:54:19.167842 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:19.167821    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:19.206285 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:19.206235    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-57gtd" podStartSLOduration=2.966835429 podStartE2EDuration="4.206221605s" totalImagesPullingTime="1.239386176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:19.182946423 +0000 UTC m=+90.050181453" watchObservedRunningTime="2026-07-24 12:54:19.206221605 +0000 UTC m=+90.073456634"
Jul 24 12:54:20.014907 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.014873    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d75766b95-v5bfq"]
Jul 24 12:54:20.017355 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.017332    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.020392 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.020373    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 12:54:20.020655 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.020632    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 12:54:20.020759 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.020681    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 12:54:20.021566 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.021535    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 12:54:20.021566 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.021548    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t79jl\""
Jul 24 12:54:20.021734 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.021597    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d2pno8re6d310\""
Jul 24 12:54:20.031654 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.031629    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d75766b95-v5bfq"]
Jul 24 12:54:20.033004 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.032978    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2edbf262-df42-4663-b0db-d84914dfede5-metrics-server-audit-profiles\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.033123 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.033032    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-client-ca-bundle\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.033186 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.033116    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-secret-metrics-server-tls\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.033186 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.033156    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-secret-metrics-server-client-certs\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.033280 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.033206    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zww52\" (UniqueName: \"kubernetes.io/projected/2edbf262-df42-4663-b0db-d84914dfede5-kube-api-access-zww52\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.033280 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.033235    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edbf262-df42-4663-b0db-d84914dfede5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.033280 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.033253    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2edbf262-df42-4663-b0db-d84914dfede5-audit-log\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.046685 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.046667    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:54:20.134298 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.134264    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2edbf262-df42-4663-b0db-d84914dfede5-metrics-server-audit-profiles\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.134456 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.134308    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-client-ca-bundle\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.134456 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.134333    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-secret-metrics-server-tls\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.134456 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.134358    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-secret-metrics-server-client-certs\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.134679 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.134654    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zww52\" (UniqueName: \"kubernetes.io/projected/2edbf262-df42-4663-b0db-d84914dfede5-kube-api-access-zww52\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.134762 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.134699    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edbf262-df42-4663-b0db-d84914dfede5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.134762 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.134748    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2edbf262-df42-4663-b0db-d84914dfede5-audit-log\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.135378 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.135348    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2edbf262-df42-4663-b0db-d84914dfede5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.135481 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.135405    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2edbf262-df42-4663-b0db-d84914dfede5-metrics-server-audit-profiles\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.135715 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.135689    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2edbf262-df42-4663-b0db-d84914dfede5-audit-log\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.137746 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.137725    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-client-ca-bundle\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.137746 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.137737    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-secret-metrics-server-client-certs\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.138443 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.138423    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2edbf262-df42-4663-b0db-d84914dfede5-secret-metrics-server-tls\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.145486 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.145465    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zww52\" (UniqueName: \"kubernetes.io/projected/2edbf262-df42-4663-b0db-d84914dfede5-kube-api-access-zww52\") pod \"metrics-server-d75766b95-v5bfq\" (UID: \"2edbf262-df42-4663-b0db-d84914dfede5\") " pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.329323 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.329252    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:20.931901 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.931877    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"]
Jul 24 12:54:20.934745 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.934682    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.937333 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.937308    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 12:54:20.937459 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.937337    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 12:54:20.937459 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.937445    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gkcpg\""
Jul 24 12:54:20.937594 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.937456    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 12:54:20.937594 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.937539    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 12:54:20.937762 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.937746    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 12:54:20.944014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.943502    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-serving-certs-ca-bundle\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.944014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.943560    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.944014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.943596    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-telemeter-client-tls\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.944014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.943633    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.944014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.943687    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-metrics-client-ca\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.944014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.943747    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qlrz\" (UniqueName: \"kubernetes.io/projected/bda193db-614f-4bdc-80de-25a081e84996-kube-api-access-2qlrz\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.944014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.943786    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-federate-client-tls\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.944014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.943830    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-secret-telemeter-client\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:20.954219 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.954016    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 12:54:20.955629 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.955609    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"]
Jul 24 12:54:20.984626 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:20.984605    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d75766b95-v5bfq"]
Jul 24 12:54:20.997633 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:20.997611    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2edbf262_df42_4663_b0db_d84914dfede5.slice/crio-7b2e38fabd57c991085b29ef17d1df4850237241c53463ede7170916bf881837 WatchSource:0}: Error finding container 7b2e38fabd57c991085b29ef17d1df4850237241c53463ede7170916bf881837: Status 404 returned error can't find the container with id 7b2e38fabd57c991085b29ef17d1df4850237241c53463ede7170916bf881837
Jul 24 12:54:21.044794 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.044770    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-serving-certs-ca-bundle\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.044880 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.044812    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.044880 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.044830    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-telemeter-client-tls\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.044880 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.044859    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.045029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.044903    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-metrics-client-ca\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.045029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.044951    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qlrz\" (UniqueName: \"kubernetes.io/projected/bda193db-614f-4bdc-80de-25a081e84996-kube-api-access-2qlrz\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.045029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.045000    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-federate-client-tls\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.045200 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.045033    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-secret-telemeter-client\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.045796 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.045767    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-serving-certs-ca-bundle\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.045988 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.045955    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-metrics-client-ca\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.046218 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.046198    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda193db-614f-4bdc-80de-25a081e84996-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.047643 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.047624    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-secret-telemeter-client\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.047978 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.047956    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.048299 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.048281    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-telemeter-client-tls\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.048493 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.048474    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bda193db-614f-4bdc-80de-25a081e84996-federate-client-tls\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.055343 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.055317    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qlrz\" (UniqueName: \"kubernetes.io/projected/bda193db-614f-4bdc-80de-25a081e84996-kube-api-access-2qlrz\") pod \"telemeter-client-7bd4499d78-jwjn9\" (UID: \"bda193db-614f-4bdc-80de-25a081e84996\") " pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.174991 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.174954    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq" event={"ID":"2edbf262-df42-4663-b0db-d84914dfede5","Type":"ContainerStarted","Data":"7b2e38fabd57c991085b29ef17d1df4850237241c53463ede7170916bf881837"}
Jul 24 12:54:21.177000 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.176976    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp" event={"ID":"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613","Type":"ContainerStarted","Data":"4628a67f7cd238b8fbd8779dd36f1d162ba931648f80e4ea2eeacec1935b3dbc"}
Jul 24 12:54:21.177133 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.177029    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp" event={"ID":"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613","Type":"ContainerStarted","Data":"26aff058b64b6a3049dc5fbe707c43bc4b92b12be030d21f637a9683128b7069"}
Jul 24 12:54:21.177133 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.177059    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp" event={"ID":"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613","Type":"ContainerStarted","Data":"f69ec437fd504fd1bc9b7d2861c147ce5ab0a4145e6982827d458e3dfc8a0fd9"}
Jul 24 12:54:21.259551 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.259526    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"
Jul 24 12:54:21.393453 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:21.393427    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bd4499d78-jwjn9"]
Jul 24 12:54:21.395537 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:21.395504    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda193db_614f_4bdc_80de_25a081e84996.slice/crio-5280e659fb29b9ea43467b373556b1945b2c4bfa4b6cfebbe5c33b5599069daf WatchSource:0}: Error finding container 5280e659fb29b9ea43467b373556b1945b2c4bfa4b6cfebbe5c33b5599069daf: Status 404 returned error can't find the container with id 5280e659fb29b9ea43467b373556b1945b2c4bfa4b6cfebbe5c33b5599069daf
Jul 24 12:54:22.183683 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:22.183639    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9" event={"ID":"bda193db-614f-4bdc-80de-25a081e84996","Type":"ContainerStarted","Data":"5280e659fb29b9ea43467b373556b1945b2c4bfa4b6cfebbe5c33b5599069daf"}
Jul 24 12:54:23.087276 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.087245    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4d5cfcbd-9nflx"]
Jul 24 12:54:23.189730 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.189700    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq" event={"ID":"2edbf262-df42-4663-b0db-d84914dfede5","Type":"ContainerStarted","Data":"154a5c587c29785b942cb7fb14424eba70f393a618e41e816b7bf0eef02a42b8"}
Jul 24 12:54:23.193303 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.193270    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp" event={"ID":"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613","Type":"ContainerStarted","Data":"16b23fc83fe1dc5638d7a62c45c062cdf10667c4cfdcb84c04d5be6aab332903"}
Jul 24 12:54:23.193525 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.193329    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp" event={"ID":"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613","Type":"ContainerStarted","Data":"fc6e07359ae5d5b7a15fb275798de339db76d69b3c21b66c337570125aa48fb9"}
Jul 24 12:54:23.193525 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.193361    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp" event={"ID":"8b8ebb39-cfe7-4c42-8b84-46bb55a8f613","Type":"ContainerStarted","Data":"3ca9e1460a9d59f516c15f36c6b683a5813dca0ff01ba3b43f02577b52895d12"}
Jul 24 12:54:23.193525 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.193403    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:23.209018 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.208972    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq" podStartSLOduration=2.929652018 podStartE2EDuration="4.208957709s" totalImagesPullingTime="1.279305691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:23.208871237 +0000 UTC m=+94.076106267" watchObservedRunningTime="2026-07-24 12:54:23.208957709 +0000 UTC m=+94.076192739"
Jul 24 12:54:23.233925 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.233873    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp" podStartSLOduration=2.336065614 podStartE2EDuration="5.233857523s" totalImagesPullingTime="2.897791909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:54:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:23.231678337 +0000 UTC m=+94.098913364" watchObservedRunningTime="2026-07-24 12:54:23.233857523 +0000 UTC m=+94.101092553"
Jul 24 12:54:23.466287 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.464125    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55bf577557-znll9"]
Jul 24 12:54:23.468223 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.468195    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.479818 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.479674    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bf577557-znll9"]
Jul 24 12:54:23.481499 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.481477    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 12:54:23.569045 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.569023    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-serving-cert\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.569204 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.569052    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-trusted-ca-bundle\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.569204 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.569074    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-oauth-serving-cert\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.569286 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.569209    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-config\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.569286 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.569252    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-service-ca\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.569352 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.569289    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klg4k\" (UniqueName: \"kubernetes.io/projected/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-kube-api-access-klg4k\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.569352 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.569332    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-oauth-config\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.669999 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.669967    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-config\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670154 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670006    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-service-ca\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670154 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670139    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klg4k\" (UniqueName: \"kubernetes.io/projected/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-kube-api-access-klg4k\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670272 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670183    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-oauth-config\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670272 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670255    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-serving-cert\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670379 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670277    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-trusted-ca-bundle\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670379 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670324    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-oauth-serving-cert\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670738 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670715    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-config\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670749    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-service-ca\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.670957 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.670909    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-oauth-serving-cert\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.671129 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.671084    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-trusted-ca-bundle\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.672768 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.672750    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-serving-cert\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.672904 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.672886    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-oauth-config\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.679845 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.679823    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klg4k\" (UniqueName: \"kubernetes.io/projected/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-kube-api-access-klg4k\") pod \"console-55bf577557-znll9\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") " pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.788963 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.788865    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:23.921645 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:23.921624    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bf577557-znll9"]
Jul 24 12:54:23.923700 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:23.923675    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e2593c_5eff_49e5_82cf_95d2c4e7dcb5.slice/crio-6979116969d9e0d40814f685fe3be07e105f47935f433ce7d1538b40ff2d9813 WatchSource:0}: Error finding container 6979116969d9e0d40814f685fe3be07e105f47935f433ce7d1538b40ff2d9813: Status 404 returned error can't find the container with id 6979116969d9e0d40814f685fe3be07e105f47935f433ce7d1538b40ff2d9813
Jul 24 12:54:24.201868 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:24.201824    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9" event={"ID":"bda193db-614f-4bdc-80de-25a081e84996","Type":"ContainerStarted","Data":"a354a9e9fe437f94302d18a8f7691f2dd206d60e16414cf872fe63989f377d08"}
Jul 24 12:54:24.204695 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:24.204665    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf577557-znll9" event={"ID":"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5","Type":"ContainerStarted","Data":"24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2"}
Jul 24 12:54:24.204807 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:24.204723    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf577557-znll9" event={"ID":"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5","Type":"ContainerStarted","Data":"6979116969d9e0d40814f685fe3be07e105f47935f433ce7d1538b40ff2d9813"}
Jul 24 12:54:24.225478 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:24.225426    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55bf577557-znll9" podStartSLOduration=1.225411667 podStartE2EDuration="1.225411667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:24.224391458 +0000 UTC m=+95.091626512" watchObservedRunningTime="2026-07-24 12:54:24.225411667 +0000 UTC m=+95.092646696"
Jul 24 12:54:25.209819 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:25.209786    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9" event={"ID":"bda193db-614f-4bdc-80de-25a081e84996","Type":"ContainerStarted","Data":"038f1ad7803de75bce286e8e785ada2ed4b32bded88a43728f2d536f8a7a4b14"}
Jul 24 12:54:25.210270 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:25.209850    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9" event={"ID":"bda193db-614f-4bdc-80de-25a081e84996","Type":"ContainerStarted","Data":"1eed2fc2600ba53ab6f323cd4d27a9c49d3b68508d4247faaa44d048e258e1e7"}
Jul 24 12:54:25.235477 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:25.235423    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bd4499d78-jwjn9" podStartSLOduration=2.1963316 podStartE2EDuration="5.235405256s" totalImagesPullingTime="3.039073656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:54:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:25.233555373 +0000 UTC m=+96.100790403" watchObservedRunningTime="2026-07-24 12:54:25.235405256 +0000 UTC m=+96.102640312"
Jul 24 12:54:26.065382 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.065347    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55bf577557-znll9"]
Jul 24 12:54:26.093666 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.093637    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d64569dd9-9spgm"]
Jul 24 12:54:26.096169 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.096147    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.108674 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.108654    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d64569dd9-9spgm"]
Jul 24 12:54:26.192323 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.192285    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-oauth-config\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.192463 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.192350    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-config\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.192463 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.192387    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svthr\" (UniqueName: \"kubernetes.io/projected/e8adc34a-fa79-40e9-8af1-10af936d1fe0-kube-api-access-svthr\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.192463 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.192412    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-service-ca\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.192463 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.192427    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-trusted-ca-bundle\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.192604 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.192486    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-oauth-serving-cert\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.192604 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.192512    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-serving-cert\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.293231 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.293196    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-config\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.293727 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.293299    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svthr\" (UniqueName: \"kubernetes.io/projected/e8adc34a-fa79-40e9-8af1-10af936d1fe0-kube-api-access-svthr\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.293727 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.293532    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-service-ca\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.293727 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.293562    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-trusted-ca-bundle\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.293727 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.293599    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-oauth-serving-cert\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.293727 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.293628    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-serving-cert\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.293727 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.293725    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-oauth-config\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.294056 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.294025    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-config\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.294229 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.294208    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-service-ca\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.294507 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.294484    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-trusted-ca-bundle\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.294675 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.294657    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-oauth-serving-cert\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.296195 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.296173    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-serving-cert\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.296264 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.296207    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-oauth-config\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.302758 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.302705    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svthr\" (UniqueName: \"kubernetes.io/projected/e8adc34a-fa79-40e9-8af1-10af936d1fe0-kube-api-access-svthr\") pod \"console-d64569dd9-9spgm\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") " pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.406016 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.405951    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:26.543713 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:26.543680    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d64569dd9-9spgm"]
Jul 24 12:54:26.547196 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:54:26.547158    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8adc34a_fa79_40e9_8af1_10af936d1fe0.slice/crio-914e458d4aeade87a320fc0b7537b6bcd4f60a4b994ddd44bbce737c70e6d52a WatchSource:0}: Error finding container 914e458d4aeade87a320fc0b7537b6bcd4f60a4b994ddd44bbce737c70e6d52a: Status 404 returned error can't find the container with id 914e458d4aeade87a320fc0b7537b6bcd4f60a4b994ddd44bbce737c70e6d52a
Jul 24 12:54:27.222064 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:27.222026    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d64569dd9-9spgm" event={"ID":"e8adc34a-fa79-40e9-8af1-10af936d1fe0","Type":"ContainerStarted","Data":"394b4b33b67e2980d07c824d78ebe09a03f208885ed49987a85bd46c17c8e324"}
Jul 24 12:54:27.222220 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:27.222084    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d64569dd9-9spgm" event={"ID":"e8adc34a-fa79-40e9-8af1-10af936d1fe0","Type":"ContainerStarted","Data":"914e458d4aeade87a320fc0b7537b6bcd4f60a4b994ddd44bbce737c70e6d52a"}
Jul 24 12:54:27.243387 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:27.243337    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d64569dd9-9spgm" podStartSLOduration=1.243322034 podStartE2EDuration="1.243322034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:54:27.241864957 +0000 UTC m=+98.109099988" watchObservedRunningTime="2026-07-24 12:54:27.243322034 +0000 UTC m=+98.110557064"
Jul 24 12:54:29.038967 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:29.038932    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z4mq5"
Jul 24 12:54:29.210523 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:29.210497    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bf4698d4d-5lpbp"
Jul 24 12:54:31.003555 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:31.003521    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-948ff885d-6wkpw"]
Jul 24 12:54:33.789534 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:33.789505    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:36.406844 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:36.406801    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:36.407332 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:36.406861    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:36.411982 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:36.411960    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:37.275796 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:37.275769    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:54:40.330923 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:40.330888    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:40.331542 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:40.331525    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:54:48.114671 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.114631    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b4d5cfcbd-9nflx" podUID="2b397daf-7213-4b04-b063-702245d1ce16" containerName="console" containerID="cri-o://66a3ccce3a53d5636fe20c6f72df1751d3b8604e6da992ba13abb650d728620c" gracePeriod=15
Jul 24 12:54:48.320516 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.320485    2528 generic.go:356] "Generic (PLEG): container finished" podID="2b397daf-7213-4b04-b063-702245d1ce16" containerID="66a3ccce3a53d5636fe20c6f72df1751d3b8604e6da992ba13abb650d728620c" exitCode=0
Jul 24 12:54:48.320669 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.320558    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4d5cfcbd-9nflx" event={"ID":"2b397daf-7213-4b04-b063-702245d1ce16","Type":"ContainerDied","Data":"66a3ccce3a53d5636fe20c6f72df1751d3b8604e6da992ba13abb650d728620c"}
Jul 24 12:54:48.361273 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.361251    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:48.486404 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.486371    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntk9c\" (UniqueName: \"kubernetes.io/projected/2b397daf-7213-4b04-b063-702245d1ce16-kube-api-access-ntk9c\") pod \"2b397daf-7213-4b04-b063-702245d1ce16\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") "
Jul 24 12:54:48.486563 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.486426    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-oauth-config\") pod \"2b397daf-7213-4b04-b063-702245d1ce16\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") "
Jul 24 12:54:48.486563 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.486475    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-oauth-serving-cert\") pod \"2b397daf-7213-4b04-b063-702245d1ce16\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") "
Jul 24 12:54:48.486563 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.486509    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-service-ca\") pod \"2b397daf-7213-4b04-b063-702245d1ce16\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") "
Jul 24 12:54:48.486563 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.486540    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-serving-cert\") pod \"2b397daf-7213-4b04-b063-702245d1ce16\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") "
Jul 24 12:54:48.486710 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.486591    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-console-config\") pod \"2b397daf-7213-4b04-b063-702245d1ce16\" (UID: \"2b397daf-7213-4b04-b063-702245d1ce16\") "
Jul 24 12:54:48.487028 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.486999    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b397daf-7213-4b04-b063-702245d1ce16" (UID: "2b397daf-7213-4b04-b063-702245d1ce16"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:48.487169 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.486999    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b397daf-7213-4b04-b063-702245d1ce16" (UID: "2b397daf-7213-4b04-b063-702245d1ce16"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:48.487169 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.487052    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-console-config" (OuterVolumeSpecName: "console-config") pod "2b397daf-7213-4b04-b063-702245d1ce16" (UID: "2b397daf-7213-4b04-b063-702245d1ce16"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:48.489010 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.488989    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b397daf-7213-4b04-b063-702245d1ce16" (UID: "2b397daf-7213-4b04-b063-702245d1ce16"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 12:54:48.489277 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.489258    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b397daf-7213-4b04-b063-702245d1ce16" (UID: "2b397daf-7213-4b04-b063-702245d1ce16"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 12:54:48.489346 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.489298    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b397daf-7213-4b04-b063-702245d1ce16-kube-api-access-ntk9c" (OuterVolumeSpecName: "kube-api-access-ntk9c") pod "2b397daf-7213-4b04-b063-702245d1ce16" (UID: "2b397daf-7213-4b04-b063-702245d1ce16"). InnerVolumeSpecName "kube-api-access-ntk9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 12:54:48.588109 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.588069    2528 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-oauth-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:48.588109 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.588105    2528 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:48.588225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.588114    2528 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:48.588225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.588123    2528 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b397daf-7213-4b04-b063-702245d1ce16-console-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:48.588225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.588132    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntk9c\" (UniqueName: \"kubernetes.io/projected/2b397daf-7213-4b04-b063-702245d1ce16-kube-api-access-ntk9c\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:48.588225 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:48.588141    2528 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b397daf-7213-4b04-b063-702245d1ce16-console-oauth-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:49.326425 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:49.326396    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4d5cfcbd-9nflx"
Jul 24 12:54:49.326425 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:49.326400    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4d5cfcbd-9nflx" event={"ID":"2b397daf-7213-4b04-b063-702245d1ce16","Type":"ContainerDied","Data":"3331a199cc6ef013a77369ee40b84b0e91b2c72cb1c887454139b8f354d96d8a"}
Jul 24 12:54:49.326909 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:49.326462    2528 scope.go:117] "RemoveContainer" containerID="66a3ccce3a53d5636fe20c6f72df1751d3b8604e6da992ba13abb650d728620c"
Jul 24 12:54:49.347902 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:49.347878    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4d5cfcbd-9nflx"]
Jul 24 12:54:49.352419 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:49.352399    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b4d5cfcbd-9nflx"]
Jul 24 12:54:49.632074 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:49.632013    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b397daf-7213-4b04-b063-702245d1ce16" path="/var/lib/kubelet/pods/2b397daf-7213-4b04-b063-702245d1ce16/volumes"
Jul 24 12:54:51.233640 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.233599    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55bf577557-znll9" podUID="81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" containerName="console" containerID="cri-o://24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2" gracePeriod=15
Jul 24 12:54:51.477818 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.477795    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:51.608916 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.608854    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-trusted-ca-bundle\") pod \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") "
Jul 24 12:54:51.608916 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.608886    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klg4k\" (UniqueName: \"kubernetes.io/projected/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-kube-api-access-klg4k\") pod \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") "
Jul 24 12:54:51.608916 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.608912    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-config\") pod \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") "
Jul 24 12:54:51.609275 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.608935    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-service-ca\") pod \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") "
Jul 24 12:54:51.609275 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609081    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-oauth-serving-cert\") pod \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") "
Jul 24 12:54:51.609275 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609171    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-oauth-config\") pod \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") "
Jul 24 12:54:51.609275 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609210    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-serving-cert\") pod \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\" (UID: \"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5\") "
Jul 24 12:54:51.609476 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609412    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-service-ca" (OuterVolumeSpecName: "service-ca") pod "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" (UID: "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:51.609476 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609423    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-config" (OuterVolumeSpecName: "console-config") pod "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" (UID: "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:51.609476 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609447    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" (UID: "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:51.609476 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609454    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" (UID: "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:51.609671 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609533    2528 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-trusted-ca-bundle\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:51.609671 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609550    2528 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:51.609671 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609559    2528 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:51.609671 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.609567    2528 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-oauth-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:51.611388 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.611363    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" (UID: "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 12:54:51.611472 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.611424    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-kube-api-access-klg4k" (OuterVolumeSpecName: "kube-api-access-klg4k") pod "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" (UID: "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5"). InnerVolumeSpecName "kube-api-access-klg4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 12:54:51.611584 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.611569    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" (UID: "81e2593c-5eff-49e5-82cf-95d2c4e7dcb5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 12:54:51.710735 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.710708    2528 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-oauth-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:51.710735 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.710728    2528 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-console-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:51.710865 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:51.710740    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klg4k\" (UniqueName: \"kubernetes.io/projected/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5-kube-api-access-klg4k\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:52.341267 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.341234    2528 generic.go:356] "Generic (PLEG): container finished" podID="81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" containerID="24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2" exitCode=0
Jul 24 12:54:52.341749 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.341287    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bf577557-znll9"
Jul 24 12:54:52.341749 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.341319    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf577557-znll9" event={"ID":"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5","Type":"ContainerDied","Data":"24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2"}
Jul 24 12:54:52.341749 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.341375    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bf577557-znll9" event={"ID":"81e2593c-5eff-49e5-82cf-95d2c4e7dcb5","Type":"ContainerDied","Data":"6979116969d9e0d40814f685fe3be07e105f47935f433ce7d1538b40ff2d9813"}
Jul 24 12:54:52.341749 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.341395    2528 scope.go:117] "RemoveContainer" containerID="24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2"
Jul 24 12:54:52.352649 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.352631    2528 scope.go:117] "RemoveContainer" containerID="24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2"
Jul 24 12:54:52.352907 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:54:52.352887    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2\": container with ID starting with 24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2 not found: ID does not exist" containerID="24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2"
Jul 24 12:54:52.352952 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.352917    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2"} err="failed to get container status \"24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2\": rpc error: code = NotFound desc = could not find container \"24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2\": container with ID starting with 24d53676fae407794fcebf6182c4a2ee649f4015d879c9f80131b56ae9bfdce2 not found: ID does not exist"
Jul 24 12:54:52.359974 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.359951    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55bf577557-znll9"]
Jul 24 12:54:52.368692 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:52.368667    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55bf577557-znll9"]
Jul 24 12:54:53.632773 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:53.632740    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" path="/var/lib/kubelet/pods/81e2593c-5eff-49e5-82cf-95d2c4e7dcb5/volumes"
Jul 24 12:54:56.024077 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.023975    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-948ff885d-6wkpw" podUID="2f7c78ef-5523-4980-8efd-01c82f503b00" containerName="registry" containerID="cri-o://f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e" gracePeriod=30
Jul 24 12:54:56.309922 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.309899    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:54:56.360256 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.360226    2528 generic.go:356] "Generic (PLEG): container finished" podID="e2accca2-63f7-4a38-a254-6c263c46b6c4" containerID="cc549adf519d87eb7b1e74cb4d03e8e3aece5b3660fd6f25c24079fbb5c8f383" exitCode=0
Jul 24 12:54:56.360387 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.360303    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2" event={"ID":"e2accca2-63f7-4a38-a254-6c263c46b6c4","Type":"ContainerDied","Data":"cc549adf519d87eb7b1e74cb4d03e8e3aece5b3660fd6f25c24079fbb5c8f383"}
Jul 24 12:54:56.360645 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.360618    2528 scope.go:117] "RemoveContainer" containerID="cc549adf519d87eb7b1e74cb4d03e8e3aece5b3660fd6f25c24079fbb5c8f383"
Jul 24 12:54:56.361937 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.361916    2528 generic.go:356] "Generic (PLEG): container finished" podID="79b2befc-76b8-4d01-8d48-f4ce408b0e64" containerID="17fd665cf4d7159f1e800639882b1dc319ffd22286c304475d93d4299ab05a81" exitCode=0
Jul 24 12:54:56.362003 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.361983    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj" event={"ID":"79b2befc-76b8-4d01-8d48-f4ce408b0e64","Type":"ContainerDied","Data":"17fd665cf4d7159f1e800639882b1dc319ffd22286c304475d93d4299ab05a81"}
Jul 24 12:54:56.362267 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.362254    2528 scope.go:117] "RemoveContainer" containerID="17fd665cf4d7159f1e800639882b1dc319ffd22286c304475d93d4299ab05a81"
Jul 24 12:54:56.363261 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.363241    2528 generic.go:356] "Generic (PLEG): container finished" podID="2f7c78ef-5523-4980-8efd-01c82f503b00" containerID="f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e" exitCode=0
Jul 24 12:54:56.363325 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.363276    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-948ff885d-6wkpw" event={"ID":"2f7c78ef-5523-4980-8efd-01c82f503b00","Type":"ContainerDied","Data":"f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e"}
Jul 24 12:54:56.363325 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.363283    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948ff885d-6wkpw"
Jul 24 12:54:56.363325 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.363303    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-948ff885d-6wkpw" event={"ID":"2f7c78ef-5523-4980-8efd-01c82f503b00","Type":"ContainerDied","Data":"007f6a32ba9fc324c22978489df494b33e8678df3812414a104f053d68de3645"}
Jul 24 12:54:56.363429 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.363322    2528 scope.go:117] "RemoveContainer" containerID="f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e"
Jul 24 12:54:56.371402 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.371387    2528 scope.go:117] "RemoveContainer" containerID="f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e"
Jul 24 12:54:56.371643 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:54:56.371621    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e\": container with ID starting with f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e not found: ID does not exist" containerID="f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e"
Jul 24 12:54:56.371706 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.371654    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e"} err="failed to get container status \"f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e\": rpc error: code = NotFound desc = could not find container \"f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e\": container with ID starting with f55d54d402cb57b48c9e2ea9173b02941a8a89b03885b5345e8fe1773347133e not found: ID does not exist"
Jul 24 12:54:56.444871 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.444848    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-certificates\") pod \"2f7c78ef-5523-4980-8efd-01c82f503b00\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") "
Jul 24 12:54:56.444962 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.444891    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") pod \"2f7c78ef-5523-4980-8efd-01c82f503b00\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") "
Jul 24 12:54:56.444962 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.444934    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-trusted-ca\") pod \"2f7c78ef-5523-4980-8efd-01c82f503b00\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") "
Jul 24 12:54:56.444962 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.444954    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f7c78ef-5523-4980-8efd-01c82f503b00-ca-trust-extracted\") pod \"2f7c78ef-5523-4980-8efd-01c82f503b00\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") "
Jul 24 12:54:56.445156 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.444970    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-bound-sa-token\") pod \"2f7c78ef-5523-4980-8efd-01c82f503b00\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") "
Jul 24 12:54:56.445156 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.444997    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntk8q\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-kube-api-access-ntk8q\") pod \"2f7c78ef-5523-4980-8efd-01c82f503b00\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") "
Jul 24 12:54:56.445156 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.445031    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-installation-pull-secrets\") pod \"2f7c78ef-5523-4980-8efd-01c82f503b00\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") "
Jul 24 12:54:56.445318 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.445164    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-image-registry-private-configuration\") pod \"2f7c78ef-5523-4980-8efd-01c82f503b00\" (UID: \"2f7c78ef-5523-4980-8efd-01c82f503b00\") "
Jul 24 12:54:56.445318 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.445169    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2f7c78ef-5523-4980-8efd-01c82f503b00" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:56.445427 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.445330    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2f7c78ef-5523-4980-8efd-01c82f503b00" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:54:56.446014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.445558    2528 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-trusted-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:56.446014 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.445582    2528 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-certificates\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:56.447431 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.447405    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2f7c78ef-5523-4980-8efd-01c82f503b00" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 12:54:56.447579 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.447558    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2f7c78ef-5523-4980-8efd-01c82f503b00" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 12:54:56.447719 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.447698    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-kube-api-access-ntk8q" (OuterVolumeSpecName: "kube-api-access-ntk8q") pod "2f7c78ef-5523-4980-8efd-01c82f503b00" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00"). InnerVolumeSpecName "kube-api-access-ntk8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 12:54:56.447771 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.447726    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2f7c78ef-5523-4980-8efd-01c82f503b00" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 12:54:56.447978 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.447963    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2f7c78ef-5523-4980-8efd-01c82f503b00" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 12:54:56.453528 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.453507    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7c78ef-5523-4980-8efd-01c82f503b00-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2f7c78ef-5523-4980-8efd-01c82f503b00" (UID: "2f7c78ef-5523-4980-8efd-01c82f503b00"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 12:54:56.546889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.546780    2528 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-image-registry-private-configuration\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:56.546889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.546813    2528 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-registry-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:56.546889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.546839    2528 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f7c78ef-5523-4980-8efd-01c82f503b00-ca-trust-extracted\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:56.546889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.546852    2528 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-bound-sa-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:56.546889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.546865    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntk8q\" (UniqueName: \"kubernetes.io/projected/2f7c78ef-5523-4980-8efd-01c82f503b00-kube-api-access-ntk8q\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:56.546889 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.546879    2528 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f7c78ef-5523-4980-8efd-01c82f503b00-installation-pull-secrets\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:54:56.688056 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.688030    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-948ff885d-6wkpw"]
Jul 24 12:54:56.692415 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:56.692393    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-948ff885d-6wkpw"]
Jul 24 12:54:57.369718 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:57.369687    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-42skj" event={"ID":"79b2befc-76b8-4d01-8d48-f4ce408b0e64","Type":"ContainerStarted","Data":"f9cac2c493a133827cec147bd6073decf028f3f36f1ac2b3e6c850d8f04123d6"}
Jul 24 12:54:57.372259 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:57.372237    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gmvp2" event={"ID":"e2accca2-63f7-4a38-a254-6c263c46b6c4","Type":"ContainerStarted","Data":"b4a55f9b30b93cbccfe69084d4000134a3e7e91209cb698632cfb35a80a34731"}
Jul 24 12:54:57.632070 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:54:57.631994    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f7c78ef-5523-4980-8efd-01c82f503b00" path="/var/lib/kubelet/pods/2f7c78ef-5523-4980-8efd-01c82f503b00/volumes"
Jul 24 12:55:00.335372 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:55:00.335341    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:55:00.339184 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:55:00.339163    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d75766b95-v5bfq"
Jul 24 12:55:06.412622 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:55:06.412590    2528 generic.go:356] "Generic (PLEG): container finished" podID="a2bd0efd-2ad2-4ac9-999a-6755c799edfd" containerID="3865dc26453535abd975716c53a98171117ccb0b44ce6d88949c6a987a84562e" exitCode=0
Jul 24 12:55:06.413013 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:55:06.412628    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-krmkk" event={"ID":"a2bd0efd-2ad2-4ac9-999a-6755c799edfd","Type":"ContainerDied","Data":"3865dc26453535abd975716c53a98171117ccb0b44ce6d88949c6a987a84562e"}
Jul 24 12:55:06.413013 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:55:06.412942    2528 scope.go:117] "RemoveContainer" containerID="3865dc26453535abd975716c53a98171117ccb0b44ce6d88949c6a987a84562e"
Jul 24 12:55:07.418998 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:55:07.418964    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-krmkk" event={"ID":"a2bd0efd-2ad2-4ac9-999a-6755c799edfd","Type":"ContainerStarted","Data":"eaf5146c17cfb123eb8a94df1375a55cdd22ce56e1a9a8b8b41757d5fddc4888"}
Jul 24 12:55:49.454380 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:55:49.454347    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d64569dd9-9spgm"]
Jul 24 12:56:14.474831 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.474757    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d64569dd9-9spgm" podUID="e8adc34a-fa79-40e9-8af1-10af936d1fe0" containerName="console" containerID="cri-o://394b4b33b67e2980d07c824d78ebe09a03f208885ed49987a85bd46c17c8e324" gracePeriod=15
Jul 24 12:56:14.695174 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.695144    2528 generic.go:356] "Generic (PLEG): container finished" podID="e8adc34a-fa79-40e9-8af1-10af936d1fe0" containerID="394b4b33b67e2980d07c824d78ebe09a03f208885ed49987a85bd46c17c8e324" exitCode=0
Jul 24 12:56:14.695330 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.695226    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d64569dd9-9spgm" event={"ID":"e8adc34a-fa79-40e9-8af1-10af936d1fe0","Type":"ContainerDied","Data":"394b4b33b67e2980d07c824d78ebe09a03f208885ed49987a85bd46c17c8e324"}
Jul 24 12:56:14.719110 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.719075    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:56:14.841947 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.841870    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-config\") pod \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") "
Jul 24 12:56:14.841947 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.841906    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-oauth-config\") pod \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") "
Jul 24 12:56:14.841947 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.841924    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-service-ca\") pod \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") "
Jul 24 12:56:14.841947 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.841946    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-serving-cert\") pod \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") "
Jul 24 12:56:14.842303 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.842013    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svthr\" (UniqueName: \"kubernetes.io/projected/e8adc34a-fa79-40e9-8af1-10af936d1fe0-kube-api-access-svthr\") pod \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") "
Jul 24 12:56:14.842303 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.842030    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-trusted-ca-bundle\") pod \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") "
Jul 24 12:56:14.842303 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.842053    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-oauth-serving-cert\") pod \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\" (UID: \"e8adc34a-fa79-40e9-8af1-10af936d1fe0\") "
Jul 24 12:56:14.842436 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.842369    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8adc34a-fa79-40e9-8af1-10af936d1fe0" (UID: "e8adc34a-fa79-40e9-8af1-10af936d1fe0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:56:14.842436 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.842399    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-config" (OuterVolumeSpecName: "console-config") pod "e8adc34a-fa79-40e9-8af1-10af936d1fe0" (UID: "e8adc34a-fa79-40e9-8af1-10af936d1fe0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:56:14.842611 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.842576    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8adc34a-fa79-40e9-8af1-10af936d1fe0" (UID: "e8adc34a-fa79-40e9-8af1-10af936d1fe0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:56:14.842723 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.842608    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8adc34a-fa79-40e9-8af1-10af936d1fe0" (UID: "e8adc34a-fa79-40e9-8af1-10af936d1fe0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 12:56:14.844198 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.844173    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8adc34a-fa79-40e9-8af1-10af936d1fe0" (UID: "e8adc34a-fa79-40e9-8af1-10af936d1fe0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 12:56:14.844286 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.844234    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8adc34a-fa79-40e9-8af1-10af936d1fe0" (UID: "e8adc34a-fa79-40e9-8af1-10af936d1fe0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 12:56:14.844332 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.844297    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8adc34a-fa79-40e9-8af1-10af936d1fe0-kube-api-access-svthr" (OuterVolumeSpecName: "kube-api-access-svthr") pod "e8adc34a-fa79-40e9-8af1-10af936d1fe0" (UID: "e8adc34a-fa79-40e9-8af1-10af936d1fe0"). InnerVolumeSpecName "kube-api-access-svthr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 12:56:14.943530 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.943485    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svthr\" (UniqueName: \"kubernetes.io/projected/e8adc34a-fa79-40e9-8af1-10af936d1fe0-kube-api-access-svthr\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:56:14.943530 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.943522    2528 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-trusted-ca-bundle\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:56:14.943530 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.943532    2528 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-oauth-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:56:14.943530 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.943543    2528 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:56:14.943793 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.943552    2528 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-oauth-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:56:14.943793 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.943561    2528 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8adc34a-fa79-40e9-8af1-10af936d1fe0-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:56:14.943793 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:14.943569    2528 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8adc34a-fa79-40e9-8af1-10af936d1fe0-console-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 12:56:15.699984 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:15.699953    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d64569dd9-9spgm"
Jul 24 12:56:15.700432 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:15.699977    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d64569dd9-9spgm" event={"ID":"e8adc34a-fa79-40e9-8af1-10af936d1fe0","Type":"ContainerDied","Data":"914e458d4aeade87a320fc0b7537b6bcd4f60a4b994ddd44bbce737c70e6d52a"}
Jul 24 12:56:15.700432 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:15.700034    2528 scope.go:117] "RemoveContainer" containerID="394b4b33b67e2980d07c824d78ebe09a03f208885ed49987a85bd46c17c8e324"
Jul 24 12:56:15.732204 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:15.732182    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d64569dd9-9spgm"]
Jul 24 12:56:15.739144 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:15.739124    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d64569dd9-9spgm"]
Jul 24 12:56:17.632078 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:56:17.632048    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8adc34a-fa79-40e9-8af1-10af936d1fe0" path="/var/lib/kubelet/pods/e8adc34a-fa79-40e9-8af1-10af936d1fe0/volumes"
Jul 24 12:57:30.510700 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.510672    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"]
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511067    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" containerName="console"
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511087    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" containerName="console"
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511118    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f7c78ef-5523-4980-8efd-01c82f503b00" containerName="registry"
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511125    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f7c78ef-5523-4980-8efd-01c82f503b00" containerName="registry"
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511133    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b397daf-7213-4b04-b063-702245d1ce16" containerName="console"
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511139    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b397daf-7213-4b04-b063-702245d1ce16" containerName="console"
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511145    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8adc34a-fa79-40e9-8af1-10af936d1fe0" containerName="console"
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511150    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8adc34a-fa79-40e9-8af1-10af936d1fe0" containerName="console"
Jul 24 12:57:30.511199 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511206    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f7c78ef-5523-4980-8efd-01c82f503b00" containerName="registry"
Jul 24 12:57:30.511493 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511214    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8adc34a-fa79-40e9-8af1-10af936d1fe0" containerName="console"
Jul 24 12:57:30.511493 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511221    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="81e2593c-5eff-49e5-82cf-95d2c4e7dcb5" containerName="console"
Jul 24 12:57:30.511493 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.511225    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b397daf-7213-4b04-b063-702245d1ce16" containerName="console"
Jul 24 12:57:30.514027 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.514012    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"
Jul 24 12:57:30.517243 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.517227    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dtbkd\""
Jul 24 12:57:30.517811 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.517798    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 12:57:30.517881 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.517812    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 12:57:30.528029 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.528005    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"]
Jul 24 12:57:30.629595 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.629572    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb7d8d07-95ef-4325-aea9-f6c4a376b2c8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv4vb\" (UID: \"cb7d8d07-95ef-4325-aea9-f6c4a376b2c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"
Jul 24 12:57:30.629710 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.629614    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx42c\" (UniqueName: \"kubernetes.io/projected/cb7d8d07-95ef-4325-aea9-f6c4a376b2c8-kube-api-access-bx42c\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv4vb\" (UID: \"cb7d8d07-95ef-4325-aea9-f6c4a376b2c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"
Jul 24 12:57:30.730319 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.730293    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb7d8d07-95ef-4325-aea9-f6c4a376b2c8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv4vb\" (UID: \"cb7d8d07-95ef-4325-aea9-f6c4a376b2c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"
Jul 24 12:57:30.730426 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.730334    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx42c\" (UniqueName: \"kubernetes.io/projected/cb7d8d07-95ef-4325-aea9-f6c4a376b2c8-kube-api-access-bx42c\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv4vb\" (UID: \"cb7d8d07-95ef-4325-aea9-f6c4a376b2c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"
Jul 24 12:57:30.730648 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.730626    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb7d8d07-95ef-4325-aea9-f6c4a376b2c8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv4vb\" (UID: \"cb7d8d07-95ef-4325-aea9-f6c4a376b2c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"
Jul 24 12:57:30.743591 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.743564    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx42c\" (UniqueName: \"kubernetes.io/projected/cb7d8d07-95ef-4325-aea9-f6c4a376b2c8-kube-api-access-bx42c\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv4vb\" (UID: \"cb7d8d07-95ef-4325-aea9-f6c4a376b2c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"
Jul 24 12:57:30.823393 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.823342    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"
Jul 24 12:57:30.958036 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.958000    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb"]
Jul 24 12:57:30.961859 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:57:30.961832    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7d8d07_95ef_4325_aea9_f6c4a376b2c8.slice/crio-074ecaa83d45a2f5000a695c63f68945f8507219db17cd703f8fbc6400dd3197 WatchSource:0}: Error finding container 074ecaa83d45a2f5000a695c63f68945f8507219db17cd703f8fbc6400dd3197: Status 404 returned error can't find the container with id 074ecaa83d45a2f5000a695c63f68945f8507219db17cd703f8fbc6400dd3197
Jul 24 12:57:30.994968 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:30.994935    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb" event={"ID":"cb7d8d07-95ef-4325-aea9-f6c4a376b2c8","Type":"ContainerStarted","Data":"074ecaa83d45a2f5000a695c63f68945f8507219db17cd703f8fbc6400dd3197"}
Jul 24 12:57:34.012274 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:34.012232    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb" event={"ID":"cb7d8d07-95ef-4325-aea9-f6c4a376b2c8","Type":"ContainerStarted","Data":"865daf63b53f53a4b7308cb83b642a66040707d45a0037f8dbcc64b0e241db65"}
Jul 24 12:57:34.037862 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:34.037796    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv4vb" podStartSLOduration=1.692829375 podStartE2EDuration="4.037774955s" totalImagesPullingTime="2.34494558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:57:34.036069979 +0000 UTC m=+284.903305010" watchObservedRunningTime="2026-07-24 12:57:34.037774955 +0000 UTC m=+284.905009985"
Jul 24 12:57:46.504337 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.504308    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wh6l8"]
Jul 24 12:57:46.507779 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.507762    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wh6l8"
Jul 24 12:57:46.510224 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.510208    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wdnsk\""
Jul 24 12:57:46.510552 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.510538    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 12:57:46.511008 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.510994    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 12:57:46.518606 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.518585    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wh6l8"]
Jul 24 12:57:46.564052 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.564021    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qst\" (UniqueName: \"kubernetes.io/projected/5489c117-b9bd-46b7-9592-f0f6348264d7-kube-api-access-g2qst\") pod \"cert-manager-55b4d954d5-wh6l8\" (UID: \"5489c117-b9bd-46b7-9592-f0f6348264d7\") " pod="cert-manager/cert-manager-55b4d954d5-wh6l8"
Jul 24 12:57:46.564214 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.564071    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5489c117-b9bd-46b7-9592-f0f6348264d7-bound-sa-token\") pod \"cert-manager-55b4d954d5-wh6l8\" (UID: \"5489c117-b9bd-46b7-9592-f0f6348264d7\") " pod="cert-manager/cert-manager-55b4d954d5-wh6l8"
Jul 24 12:57:46.664404 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.664382    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5489c117-b9bd-46b7-9592-f0f6348264d7-bound-sa-token\") pod \"cert-manager-55b4d954d5-wh6l8\" (UID: \"5489c117-b9bd-46b7-9592-f0f6348264d7\") " pod="cert-manager/cert-manager-55b4d954d5-wh6l8"
Jul 24 12:57:46.664540 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.664437    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qst\" (UniqueName: \"kubernetes.io/projected/5489c117-b9bd-46b7-9592-f0f6348264d7-kube-api-access-g2qst\") pod \"cert-manager-55b4d954d5-wh6l8\" (UID: \"5489c117-b9bd-46b7-9592-f0f6348264d7\") " pod="cert-manager/cert-manager-55b4d954d5-wh6l8"
Jul 24 12:57:46.674131 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.674082    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5489c117-b9bd-46b7-9592-f0f6348264d7-bound-sa-token\") pod \"cert-manager-55b4d954d5-wh6l8\" (UID: \"5489c117-b9bd-46b7-9592-f0f6348264d7\") " pod="cert-manager/cert-manager-55b4d954d5-wh6l8"
Jul 24 12:57:46.674260 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.674198    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qst\" (UniqueName: \"kubernetes.io/projected/5489c117-b9bd-46b7-9592-f0f6348264d7-kube-api-access-g2qst\") pod \"cert-manager-55b4d954d5-wh6l8\" (UID: \"5489c117-b9bd-46b7-9592-f0f6348264d7\") " pod="cert-manager/cert-manager-55b4d954d5-wh6l8"
Jul 24 12:57:46.833210 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.833152    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wh6l8"
Jul 24 12:57:46.948568 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.948539    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"]
Jul 24 12:57:46.952026 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.952003    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"
Jul 24 12:57:46.954504 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.954481    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7sv4t\""
Jul 24 12:57:46.962908 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.962886    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"]
Jul 24 12:57:46.973173 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.973072    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8a5bb00-be38-4c01-9578-2ac3ece21ad0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4zstg\" (UID: \"e8a5bb00-be38-4c01-9578-2ac3ece21ad0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"
Jul 24 12:57:46.973173 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.973148    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbmqh\" (UniqueName: \"kubernetes.io/projected/e8a5bb00-be38-4c01-9578-2ac3ece21ad0-kube-api-access-vbmqh\") pod \"cert-manager-cainjector-559cdd8c87-4zstg\" (UID: \"e8a5bb00-be38-4c01-9578-2ac3ece21ad0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"
Jul 24 12:57:46.973366 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:57:46.973341    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5489c117_b9bd_46b7_9592_f0f6348264d7.slice/crio-f841f7f267722331f1f6c450832aa15f338b86b8da3e7e7b70f87b1224ac90f4 WatchSource:0}: Error finding container f841f7f267722331f1f6c450832aa15f338b86b8da3e7e7b70f87b1224ac90f4: Status 404 returned error can't find the container with id f841f7f267722331f1f6c450832aa15f338b86b8da3e7e7b70f87b1224ac90f4
Jul 24 12:57:46.974798 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:46.974776    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wh6l8"]
Jul 24 12:57:47.069254 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:47.069229    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wh6l8" event={"ID":"5489c117-b9bd-46b7-9592-f0f6348264d7","Type":"ContainerStarted","Data":"f841f7f267722331f1f6c450832aa15f338b86b8da3e7e7b70f87b1224ac90f4"}
Jul 24 12:57:47.074034 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:47.074011    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8a5bb00-be38-4c01-9578-2ac3ece21ad0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4zstg\" (UID: \"e8a5bb00-be38-4c01-9578-2ac3ece21ad0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"
Jul 24 12:57:47.074134 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:47.074044    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbmqh\" (UniqueName: \"kubernetes.io/projected/e8a5bb00-be38-4c01-9578-2ac3ece21ad0-kube-api-access-vbmqh\") pod \"cert-manager-cainjector-559cdd8c87-4zstg\" (UID: \"e8a5bb00-be38-4c01-9578-2ac3ece21ad0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"
Jul 24 12:57:47.084505 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:47.084457    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbmqh\" (UniqueName: \"kubernetes.io/projected/e8a5bb00-be38-4c01-9578-2ac3ece21ad0-kube-api-access-vbmqh\") pod \"cert-manager-cainjector-559cdd8c87-4zstg\" (UID: \"e8a5bb00-be38-4c01-9578-2ac3ece21ad0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"
Jul 24 12:57:47.087009 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:47.086991    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8a5bb00-be38-4c01-9578-2ac3ece21ad0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4zstg\" (UID: \"e8a5bb00-be38-4c01-9578-2ac3ece21ad0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"
Jul 24 12:57:47.261675 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:47.261653    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"
Jul 24 12:57:47.390332 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:47.390309    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4zstg"]
Jul 24 12:57:47.392319 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:57:47.392293    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8a5bb00_be38_4c01_9578_2ac3ece21ad0.slice/crio-843b60c9b469f70c3bfa64c557d336092f8450d6a83b9521e72f35cbc72e779b WatchSource:0}: Error finding container 843b60c9b469f70c3bfa64c557d336092f8450d6a83b9521e72f35cbc72e779b: Status 404 returned error can't find the container with id 843b60c9b469f70c3bfa64c557d336092f8450d6a83b9521e72f35cbc72e779b
Jul 24 12:57:48.075850 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:48.075817    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg" event={"ID":"e8a5bb00-be38-4c01-9578-2ac3ece21ad0","Type":"ContainerStarted","Data":"843b60c9b469f70c3bfa64c557d336092f8450d6a83b9521e72f35cbc72e779b"}
Jul 24 12:57:49.591758 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:49.591732    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 12:57:49.592511 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:49.592490    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 12:57:49.601105 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:49.601079    2528 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 12:57:50.088567 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:50.088527    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg" event={"ID":"e8a5bb00-be38-4c01-9578-2ac3ece21ad0","Type":"ContainerStarted","Data":"8762cf2727e43084b523c01d73d9b415e463838b663bea94dd4688e649d3286c"}
Jul 24 12:57:50.090087 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:50.090059    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wh6l8" event={"ID":"5489c117-b9bd-46b7-9592-f0f6348264d7","Type":"ContainerStarted","Data":"12dd801d4821f4c37dedd5cbe8d13351c1bd783ea05990b40d2b7d513fb8fe8f"}
Jul 24 12:57:50.116642 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:50.116597    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4zstg" podStartSLOduration=1.847191444 podStartE2EDuration="4.116567535s" totalImagesPullingTime="2.269376091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:57:50.116420638 +0000 UTC m=+300.983655668" watchObservedRunningTime="2026-07-24 12:57:50.116567535 +0000 UTC m=+300.983802564"
Jul 24 12:57:50.142635 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:57:50.142582    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wh6l8" podStartSLOduration=1.4648971579999999 podStartE2EDuration="4.142562091s" totalImagesPullingTime="2.677664933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:57:50.142197678 +0000 UTC m=+301.009432705" watchObservedRunningTime="2026-07-24 12:57:50.142562091 +0000 UTC m=+301.009797122"
Jul 24 12:58:10.757664 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.757636    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"]
Jul 24 12:58:10.760910 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.760894    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.766562 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.766541    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 12:58:10.766562 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.766547    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 12:58:10.766745 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.766580    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 12:58:10.766745 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.766690    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 12:58:10.766891 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.766876    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pmmpb\""
Jul 24 12:58:10.784745 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.784718    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"]
Jul 24 12:58:10.860370 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.860340    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63a2786d-a0a9-44bc-bd33-6f6600f9729c-manifests\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.860538 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.860399    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63a2786d-a0a9-44bc-bd33-6f6600f9729c-webhook-cert\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.860538 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.860444    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63a2786d-a0a9-44bc-bd33-6f6600f9729c-tmp\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.860538 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.860468    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8zfl\" (UniqueName: \"kubernetes.io/projected/63a2786d-a0a9-44bc-bd33-6f6600f9729c-kube-api-access-j8zfl\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.860671 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.860541    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63a2786d-a0a9-44bc-bd33-6f6600f9729c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.961131 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.961073    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63a2786d-a0a9-44bc-bd33-6f6600f9729c-manifests\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.961346 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.961161    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63a2786d-a0a9-44bc-bd33-6f6600f9729c-webhook-cert\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.961346 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.961189    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63a2786d-a0a9-44bc-bd33-6f6600f9729c-tmp\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.961346 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.961205    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8zfl\" (UniqueName: \"kubernetes.io/projected/63a2786d-a0a9-44bc-bd33-6f6600f9729c-kube-api-access-j8zfl\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.961346 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.961246    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63a2786d-a0a9-44bc-bd33-6f6600f9729c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.961552 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.961524    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63a2786d-a0a9-44bc-bd33-6f6600f9729c-manifests\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.963671 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.963648    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63a2786d-a0a9-44bc-bd33-6f6600f9729c-tmp\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.963777 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.963683    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63a2786d-a0a9-44bc-bd33-6f6600f9729c-webhook-cert\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.963814 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.963773    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63a2786d-a0a9-44bc-bd33-6f6600f9729c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:10.971164 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:10.971145    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8zfl\" (UniqueName: \"kubernetes.io/projected/63a2786d-a0a9-44bc-bd33-6f6600f9729c-kube-api-access-j8zfl\") pod \"opendatahub-operator-controller-manager-77bd76cdcf-sdjqn\" (UID: \"63a2786d-a0a9-44bc-bd33-6f6600f9729c\") " pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:11.071560 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:11.071480    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:11.208054 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:11.208026    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"]
Jul 24 12:58:11.210680 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:58:11.210653    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a2786d_a0a9_44bc_bd33_6f6600f9729c.slice/crio-b309e0104faa3fba3f1ffdbe3c4c886d161b71016756787712908f8bebec1c5e WatchSource:0}: Error finding container b309e0104faa3fba3f1ffdbe3c4c886d161b71016756787712908f8bebec1c5e: Status 404 returned error can't find the container with id b309e0104faa3fba3f1ffdbe3c4c886d161b71016756787712908f8bebec1c5e
Jul 24 12:58:11.212546 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:11.212529    2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 12:58:12.186786 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:12.186698    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn" event={"ID":"63a2786d-a0a9-44bc-bd33-6f6600f9729c","Type":"ContainerStarted","Data":"b309e0104faa3fba3f1ffdbe3c4c886d161b71016756787712908f8bebec1c5e"}
Jul 24 12:58:15.202466 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:15.202423    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn" event={"ID":"63a2786d-a0a9-44bc-bd33-6f6600f9729c","Type":"ContainerStarted","Data":"d9891447787f8bf9a3838326767ebf8e2b6cc20ef8aecd965dec2243a319e676"}
Jul 24 12:58:16.208540 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:16.208504    2528 generic.go:356] "Generic (PLEG): container finished" podID="63a2786d-a0a9-44bc-bd33-6f6600f9729c" containerID="d9891447787f8bf9a3838326767ebf8e2b6cc20ef8aecd965dec2243a319e676" exitCode=0
Jul 24 12:58:16.209055 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:16.208561    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn" event={"ID":"63a2786d-a0a9-44bc-bd33-6f6600f9729c","Type":"ContainerDied","Data":"d9891447787f8bf9a3838326767ebf8e2b6cc20ef8aecd965dec2243a319e676"}
Jul 24 12:58:17.215073 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:17.215033    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn" event={"ID":"63a2786d-a0a9-44bc-bd33-6f6600f9729c","Type":"ContainerStarted","Data":"ba2e75783e3b4fd401c9f6255430c6ae0d5d061d39535e9d255d63dcf3087ac0"}
Jul 24 12:58:17.215498 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:17.215184    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:17.252329 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:17.252285    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn" podStartSLOduration=2.637214771 podStartE2EDuration="7.252270556s" totalImagesPullingTime="3.583417986s" totalInitContainerRuntime="1.031637799s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:58:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:58:17.251640537 +0000 UTC m=+328.118875567" watchObservedRunningTime="2026-07-24 12:58:17.252270556 +0000 UTC m=+328.119505586"
Jul 24 12:58:28.222179 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:28.222147    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77bd76cdcf-sdjqn"
Jul 24 12:58:32.209420 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.209388    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nnrzz"]
Jul 24 12:58:32.215821 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.215801    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:32.218590 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.218568    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 12:58:32.232781 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.232760    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nnrzz"]
Jul 24 12:58:32.332301 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.332271    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dr26\" (UniqueName: \"kubernetes.io/projected/77dcfa9d-18fd-4e95-9d22-0f7baf275470-kube-api-access-8dr26\") pod \"model-serving-api-54d89bd5fc-nnrzz\" (UID: \"77dcfa9d-18fd-4e95-9d22-0f7baf275470\") " pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:32.332412 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.332311    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77dcfa9d-18fd-4e95-9d22-0f7baf275470-tls-certs\") pod \"model-serving-api-54d89bd5fc-nnrzz\" (UID: \"77dcfa9d-18fd-4e95-9d22-0f7baf275470\") " pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:32.433751 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.433724    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dr26\" (UniqueName: \"kubernetes.io/projected/77dcfa9d-18fd-4e95-9d22-0f7baf275470-kube-api-access-8dr26\") pod \"model-serving-api-54d89bd5fc-nnrzz\" (UID: \"77dcfa9d-18fd-4e95-9d22-0f7baf275470\") " pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:32.433857 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.433760    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77dcfa9d-18fd-4e95-9d22-0f7baf275470-tls-certs\") pod \"model-serving-api-54d89bd5fc-nnrzz\" (UID: \"77dcfa9d-18fd-4e95-9d22-0f7baf275470\") " pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:32.436356 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.436339    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77dcfa9d-18fd-4e95-9d22-0f7baf275470-tls-certs\") pod \"model-serving-api-54d89bd5fc-nnrzz\" (UID: \"77dcfa9d-18fd-4e95-9d22-0f7baf275470\") " pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:32.448692 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.448664    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dr26\" (UniqueName: \"kubernetes.io/projected/77dcfa9d-18fd-4e95-9d22-0f7baf275470-kube-api-access-8dr26\") pod \"model-serving-api-54d89bd5fc-nnrzz\" (UID: \"77dcfa9d-18fd-4e95-9d22-0f7baf275470\") " pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:32.525731 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.525670    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:32.887333 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:32.886316    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nnrzz"]
Jul 24 12:58:32.891953 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:58:32.891919    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77dcfa9d_18fd_4e95_9d22_0f7baf275470.slice/crio-d7b086f9c1becbdde5d0d5b86b073932395df91a043e23baefe0079477a231ec WatchSource:0}: Error finding container d7b086f9c1becbdde5d0d5b86b073932395df91a043e23baefe0079477a231ec: Status 404 returned error can't find the container with id d7b086f9c1becbdde5d0d5b86b073932395df91a043e23baefe0079477a231ec
Jul 24 12:58:33.291228 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:33.291190    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz" event={"ID":"77dcfa9d-18fd-4e95-9d22-0f7baf275470","Type":"ContainerStarted","Data":"d7b086f9c1becbdde5d0d5b86b073932395df91a043e23baefe0079477a231ec"}
Jul 24 12:58:35.301389 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:35.301355    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz" event={"ID":"77dcfa9d-18fd-4e95-9d22-0f7baf275470","Type":"ContainerStarted","Data":"adff4036b506d0443d8494fd4279f724a77c5582d669eca3c57b0cc02e9e5b9e"}
Jul 24 12:58:35.301804 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:35.301489    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:35.326647 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:35.326607    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz" podStartSLOduration=1.688046639 podStartE2EDuration="3.326592638s" totalImagesPullingTime="1.638545999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:58:35.324937354 +0000 UTC m=+346.192172384" watchObservedRunningTime="2026-07-24 12:58:35.326592638 +0000 UTC m=+346.193827700"
Jul 24 12:58:41.514815 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.514733    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"]
Jul 24 12:58:41.518626 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.518604    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.519037 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.519008    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-tls-certs\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.519150 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.519051    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-tmp\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.519150 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.519082    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2stdj\" (UniqueName: \"kubernetes.io/projected/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-kube-api-access-2stdj\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.524590 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.524565    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 12:58:41.532217 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.532191    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 12:58:41.533757 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.533736    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"]
Jul 24 12:58:41.619539 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.619513    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-tls-certs\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.619539 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.619541    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-tmp\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.619767 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.619567    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2stdj\" (UniqueName: \"kubernetes.io/projected/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-kube-api-access-2stdj\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.622051 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.622027    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-tmp\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.622194 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.622176    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-tls-certs\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.652460 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.652429    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2stdj\" (UniqueName: \"kubernetes.io/projected/f73a5cd2-2ab0-41ae-a39f-c4dd7b197951-kube-api-access-2stdj\") pod \"kube-auth-proxy-7c6cb77c89-mdszj\" (UID: \"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951\") " pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:41.828560 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:41.828482    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"
Jul 24 12:58:42.112976 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.112901    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj"]
Jul 24 12:58:42.119799 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:58:42.119759    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73a5cd2_2ab0_41ae_a39f_c4dd7b197951.slice/crio-ad4c7723692067254c8bddb9a829e4aeadfcce3bb68da1f3167d76e9e1e5ec4a WatchSource:0}: Error finding container ad4c7723692067254c8bddb9a829e4aeadfcce3bb68da1f3167d76e9e1e5ec4a: Status 404 returned error can't find the container with id ad4c7723692067254c8bddb9a829e4aeadfcce3bb68da1f3167d76e9e1e5ec4a
Jul 24 12:58:42.216238 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.216181    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"]
Jul 24 12:58:42.221258 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.221240    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:42.224731 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.224706    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-cert\") pod \"kserve-controller-manager-d6f4b65b8-dwwb4\" (UID: \"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:42.224850 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.224832    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxxk9\" (UniqueName: \"kubernetes.io/projected/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-kube-api-access-hxxk9\") pod \"kserve-controller-manager-d6f4b65b8-dwwb4\" (UID: \"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:42.225187 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.225170    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-z5b6r\""
Jul 24 12:58:42.225277 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.225250    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 12:58:42.227910 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.227890    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"]
Jul 24 12:58:42.231383 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.231366    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:42.237714 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.237401    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 12:58:42.237853 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.237826    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nd4l4\""
Jul 24 12:58:42.239573 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.239550    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"]
Jul 24 12:58:42.249604 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.249584    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"]
Jul 24 12:58:42.327010 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.326959    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s8kz\" (UniqueName: \"kubernetes.io/projected/7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2-kube-api-access-8s8kz\") pod \"llmisvc-controller-manager-777c6bd7d5-9lt2p\" (UID: \"7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:42.327198 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.327126    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxxk9\" (UniqueName: \"kubernetes.io/projected/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-kube-api-access-hxxk9\") pod \"kserve-controller-manager-d6f4b65b8-dwwb4\" (UID: \"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:42.327198 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.327163    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9lt2p\" (UID: \"7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:42.327310 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.327212    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-cert\") pod \"kserve-controller-manager-d6f4b65b8-dwwb4\" (UID: \"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:42.327448 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:58:42.327421    2528 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 24 12:58:42.327532 ip-10-0-134-90 kubenswrapper[2528]: E0724 12:58:42.327514    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-cert podName:9174687c-e29e-4bf6-ac97-b4e4c9ab5cff nodeName:}" failed. No retries permitted until 2026-07-24 12:58:42.827493188 +0000 UTC m=+353.694728201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-cert") pod "kserve-controller-manager-d6f4b65b8-dwwb4" (UID: "9174687c-e29e-4bf6-ac97-b4e4c9ab5cff") : secret "kserve-webhook-server-cert" not found
Jul 24 12:58:42.336417 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.336386    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj" event={"ID":"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951","Type":"ContainerStarted","Data":"ad4c7723692067254c8bddb9a829e4aeadfcce3bb68da1f3167d76e9e1e5ec4a"}
Jul 24 12:58:42.367631 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.367569    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxxk9\" (UniqueName: \"kubernetes.io/projected/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-kube-api-access-hxxk9\") pod \"kserve-controller-manager-d6f4b65b8-dwwb4\" (UID: \"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:42.428367 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.428347    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s8kz\" (UniqueName: \"kubernetes.io/projected/7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2-kube-api-access-8s8kz\") pod \"llmisvc-controller-manager-777c6bd7d5-9lt2p\" (UID: \"7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:42.428479 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.428400    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9lt2p\" (UID: \"7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:42.430757 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.430737    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9lt2p\" (UID: \"7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:42.447124 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.447082    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s8kz\" (UniqueName: \"kubernetes.io/projected/7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2-kube-api-access-8s8kz\") pod \"llmisvc-controller-manager-777c6bd7d5-9lt2p\" (UID: \"7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:42.541283 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.541262    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:42.680228 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.680148    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"]
Jul 24 12:58:42.683023 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:58:42.682993    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7c5f1a61_bb61_4eda_89f5_cfd572ddc0e2.slice/crio-533632a92c93b70d336663d81253b1ab1d7c36688da39ab24cf08d714da25fd5 WatchSource:0}: Error finding container 533632a92c93b70d336663d81253b1ab1d7c36688da39ab24cf08d714da25fd5: Status 404 returned error can't find the container with id 533632a92c93b70d336663d81253b1ab1d7c36688da39ab24cf08d714da25fd5
Jul 24 12:58:42.832207 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.832176    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-cert\") pod \"kserve-controller-manager-d6f4b65b8-dwwb4\" (UID: \"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:42.834867 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:42.834841    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9174687c-e29e-4bf6-ac97-b4e4c9ab5cff-cert\") pod \"kserve-controller-manager-d6f4b65b8-dwwb4\" (UID: \"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:43.132508 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:43.132475    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:43.284749 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:43.284715    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"]
Jul 24 12:58:43.288114 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:58:43.288067    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9174687c_e29e_4bf6_ac97_b4e4c9ab5cff.slice/crio-f7a248f42c71cd362df7180c2fd4105b6352276eb2993c4e8d5db07b0f5f6889 WatchSource:0}: Error finding container f7a248f42c71cd362df7180c2fd4105b6352276eb2993c4e8d5db07b0f5f6889: Status 404 returned error can't find the container with id f7a248f42c71cd362df7180c2fd4105b6352276eb2993c4e8d5db07b0f5f6889
Jul 24 12:58:43.343024 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:43.342992    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4" event={"ID":"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff","Type":"ContainerStarted","Data":"f7a248f42c71cd362df7180c2fd4105b6352276eb2993c4e8d5db07b0f5f6889"}
Jul 24 12:58:43.344805 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:43.344780    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p" event={"ID":"7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2","Type":"ContainerStarted","Data":"533632a92c93b70d336663d81253b1ab1d7c36688da39ab24cf08d714da25fd5"}
Jul 24 12:58:45.783032 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.782983    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"]
Jul 24 12:58:45.786977 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.786958    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.794546 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.794522    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 12:58:45.795425 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.795408    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 12:58:45.795659 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.795644    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5z6nh\""
Jul 24 12:58:45.796235 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.796216    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 12:58:45.796912 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.796889    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 12:58:45.806294 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.806272    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"]
Jul 24 12:58:45.864285 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.864256    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0158efa3-0191-4066-938c-85ed6a869bd2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.864426 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.864310    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cbwb\" (UniqueName: \"kubernetes.io/projected/0158efa3-0191-4066-938c-85ed6a869bd2-kube-api-access-2cbwb\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.864426 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.864399    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.864518 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.864476    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.864518 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.864513    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0158efa3-0191-4066-938c-85ed6a869bd2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.864614 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.864539    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0158efa3-0191-4066-938c-85ed6a869bd2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.864614 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.864570    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.965005 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.964970    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.965226 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.965014    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0158efa3-0191-4066-938c-85ed6a869bd2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.965226 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.965055    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cbwb\" (UniqueName: \"kubernetes.io/projected/0158efa3-0191-4066-938c-85ed6a869bd2-kube-api-access-2cbwb\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.965226 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.965121    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.965226 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.965169    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.965226 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.965208    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0158efa3-0191-4066-938c-85ed6a869bd2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.965483 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.965241    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0158efa3-0191-4066-938c-85ed6a869bd2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.966679 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.965775    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0158efa3-0191-4066-938c-85ed6a869bd2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.968025 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.968000    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0158efa3-0191-4066-938c-85ed6a869bd2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.968174 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.968068    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.968238 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.968169    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.968463 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.968440    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0158efa3-0191-4066-938c-85ed6a869bd2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.977204 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.977183    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cbwb\" (UniqueName: \"kubernetes.io/projected/0158efa3-0191-4066-938c-85ed6a869bd2-kube-api-access-2cbwb\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:45.977436 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:45.977396    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0158efa3-0191-4066-938c-85ed6a869bd2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fjwlw\" (UID: \"0158efa3-0191-4066-938c-85ed6a869bd2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:46.096493 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:46.096423    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:46.310476 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:46.310446    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nnrzz"
Jul 24 12:58:46.577630 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:46.577596    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"]
Jul 24 12:58:46.580661 ip-10-0-134-90 kubenswrapper[2528]: W0724 12:58:46.580634    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0158efa3_0191_4066_938c_85ed6a869bd2.slice/crio-7f3f0a4b58d3c9516cb004d7b1830fef8db10043d725448754dc6d7859c4c9c9 WatchSource:0}: Error finding container 7f3f0a4b58d3c9516cb004d7b1830fef8db10043d725448754dc6d7859c4c9c9: Status 404 returned error can't find the container with id 7f3f0a4b58d3c9516cb004d7b1830fef8db10043d725448754dc6d7859c4c9c9
Jul 24 12:58:47.368655 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.368614    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw" event={"ID":"0158efa3-0191-4066-938c-85ed6a869bd2","Type":"ContainerStarted","Data":"7f3f0a4b58d3c9516cb004d7b1830fef8db10043d725448754dc6d7859c4c9c9"}
Jul 24 12:58:47.370154 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.370123    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj" event={"ID":"f73a5cd2-2ab0-41ae-a39f-c4dd7b197951","Type":"ContainerStarted","Data":"ea83973ba8f1e976b3178428968f6f8f263f95a94b9e427977f0129be998b452"}
Jul 24 12:58:47.371576 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.371553    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p" event={"ID":"7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2","Type":"ContainerStarted","Data":"73a5724472cdae4b190f12644edeedd135f60abae9591b8c50a9f291330f3819"}
Jul 24 12:58:47.371692 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.371625    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:58:47.373006 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.372986    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4" event={"ID":"9174687c-e29e-4bf6-ac97-b4e4c9ab5cff","Type":"ContainerStarted","Data":"ffa8e9e569bdbc9c3bc7211705b7c8f47f992aad3a18ae95494f58899e8a528f"}
Jul 24 12:58:47.373152 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.373139    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 12:58:47.399612 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.399571    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c6cb77c89-mdszj" podStartSLOduration=3.309630808 podStartE2EDuration="6.399557472s" totalImagesPullingTime="3.089926664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:58:47.39912633 +0000 UTC m=+358.266361360" watchObservedRunningTime="2026-07-24 12:58:47.399557472 +0000 UTC m=+358.266792509"
Jul 24 12:58:47.429869 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.429827    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p" podStartSLOduration=1.7316476729999999 podStartE2EDuration="5.4298131s" totalImagesPullingTime="3.698165427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:58:47.428995133 +0000 UTC m=+358.296230166" watchObservedRunningTime="2026-07-24 12:58:47.4298131 +0000 UTC m=+358.297048142"
Jul 24 12:58:47.453215 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:47.453170    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4" podStartSLOduration=2.344148911 podStartE2EDuration="5.453155704s" totalImagesPullingTime="3.109006793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:58:47.451488558 +0000 UTC m=+358.318723588" watchObservedRunningTime="2026-07-24 12:58:47.453155704 +0000 UTC m=+358.320390782"
Jul 24 12:58:49.369330 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:49.369294    2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 12:58:49.369693 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:49.369375    2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 12:58:50.396652 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:50.396591    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw" event={"ID":"0158efa3-0191-4066-938c-85ed6a869bd2","Type":"ContainerStarted","Data":"131e872c7bfdc4d487b73c475cbd8a30709f26267e3ff8de66bf356e9051f601"}
Jul 24 12:58:50.397061 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:50.396748    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:50.398296 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:50.398270    2528 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fjwlw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 12:58:50.398404 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:50.398318    2528 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw" podUID="0158efa3-0191-4066-938c-85ed6a869bd2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 12:58:51.402632 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:51.402606    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw"
Jul 24 12:58:51.448527 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:58:51.448481    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fjwlw" podStartSLOduration=3.662192654 podStartE2EDuration="6.44846179s" totalImagesPullingTime="2.786269136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 12:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 12:58:50.452797858 +0000 UTC m=+361.320032888" watchObservedRunningTime="2026-07-24 12:58:51.44846179 +0000 UTC m=+362.315696820"
Jul 24 12:59:18.381316 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:59:18.381283    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9lt2p"
Jul 24 12:59:18.384375 ip-10-0-134-90 kubenswrapper[2528]: I0724 12:59:18.384356    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dwwb4"
Jul 24 13:00:04.313171 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.313143    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"]
Jul 24 13:00:04.315629 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.315611    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:04.321058 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.321039    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 13:00:04.321787 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.321762    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 13:00:04.322294 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.321762    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xzmk5\""
Jul 24 13:00:04.326960 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.326939    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"]
Jul 24 13:00:04.405771 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.405745    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvndz\" (UniqueName: \"kubernetes.io/projected/fa8dec81-c4e1-48e6-8b0a-dde1be8635d6-kube-api-access-bvndz\") pod \"limitador-operator-controller-manager-859d7b78bd-vjvrg\" (UID: \"fa8dec81-c4e1-48e6-8b0a-dde1be8635d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:04.506653 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.506624    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvndz\" (UniqueName: \"kubernetes.io/projected/fa8dec81-c4e1-48e6-8b0a-dde1be8635d6-kube-api-access-bvndz\") pod \"limitador-operator-controller-manager-859d7b78bd-vjvrg\" (UID: \"fa8dec81-c4e1-48e6-8b0a-dde1be8635d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:04.524872 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.524844    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvndz\" (UniqueName: \"kubernetes.io/projected/fa8dec81-c4e1-48e6-8b0a-dde1be8635d6-kube-api-access-bvndz\") pod \"limitador-operator-controller-manager-859d7b78bd-vjvrg\" (UID: \"fa8dec81-c4e1-48e6-8b0a-dde1be8635d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:04.626121 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.626051    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:04.769342 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:04.769322    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"]
Jul 24 13:00:04.770338 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:00:04.770313    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8dec81_c4e1_48e6_8b0a_dde1be8635d6.slice/crio-f9e92ebf707f61bb3a5dbcf653473fe4697e04b81846d94ab35b758965b3aa5f WatchSource:0}: Error finding container f9e92ebf707f61bb3a5dbcf653473fe4697e04b81846d94ab35b758965b3aa5f: Status 404 returned error can't find the container with id f9e92ebf707f61bb3a5dbcf653473fe4697e04b81846d94ab35b758965b3aa5f
Jul 24 13:00:05.752668 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:05.752632    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg" event={"ID":"fa8dec81-c4e1-48e6-8b0a-dde1be8635d6","Type":"ContainerStarted","Data":"f9e92ebf707f61bb3a5dbcf653473fe4697e04b81846d94ab35b758965b3aa5f"}
Jul 24 13:00:07.769375 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:07.769341    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg" event={"ID":"fa8dec81-c4e1-48e6-8b0a-dde1be8635d6","Type":"ContainerStarted","Data":"8888c4f4d7e2625d837f60b6b25f6d828328d2940b95c285e5d9eab1ed93c147"}
Jul 24 13:00:07.770612 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:07.770588    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:07.795823 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:07.795767    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg" podStartSLOduration=1.808521813 podStartE2EDuration="3.795752187s" totalImagesPullingTime="1.987230374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:00:07.795035623 +0000 UTC m=+438.662270665" watchObservedRunningTime="2026-07-24 13:00:07.795752187 +0000 UTC m=+438.662987217"
Jul 24 13:00:19.782439 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:19.782368    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:36.478919 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.478880    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"]
Jul 24 13:00:36.482327 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.482311    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.485690 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.485669    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7djvc\""
Jul 24 13:00:36.504639 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.504617    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"]
Jul 24 13:00:36.579895 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.579868    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqjcw\" (UniqueName: \"kubernetes.io/projected/ee38a55c-3008-41b9-b937-840974f7658a-kube-api-access-lqjcw\") pod \"kuadrant-operator-controller-manager-55467d9f7-978xs\" (UID: \"ee38a55c-3008-41b9-b937-840974f7658a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.580050 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.579939    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee38a55c-3008-41b9-b937-840974f7658a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-978xs\" (UID: \"ee38a55c-3008-41b9-b937-840974f7658a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.604541 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.604521    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"]
Jul 24 13:00:36.604773 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:36.604752    2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-lqjcw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs" podUID="ee38a55c-3008-41b9-b937-840974f7658a"
Jul 24 13:00:36.680574 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.680544    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee38a55c-3008-41b9-b937-840974f7658a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-978xs\" (UID: \"ee38a55c-3008-41b9-b937-840974f7658a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.680686 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.680617    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqjcw\" (UniqueName: \"kubernetes.io/projected/ee38a55c-3008-41b9-b937-840974f7658a-kube-api-access-lqjcw\") pod \"kuadrant-operator-controller-manager-55467d9f7-978xs\" (UID: \"ee38a55c-3008-41b9-b937-840974f7658a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.680970 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.680953    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee38a55c-3008-41b9-b937-840974f7658a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-978xs\" (UID: \"ee38a55c-3008-41b9-b937-840974f7658a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.682377 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.682358    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"]
Jul 24 13:00:36.692593 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.692571    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"]
Jul 24 13:00:36.695646 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:36.695621    2528 projected.go:196] Error preparing data for projected volume kube-api-access-lqjcw for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs: failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-978xs" not found
Jul 24 13:00:36.695748 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:36.695699    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee38a55c-3008-41b9-b937-840974f7658a-kube-api-access-lqjcw podName:ee38a55c-3008-41b9-b937-840974f7658a nodeName:}" failed. No retries permitted until 2026-07-24 13:00:37.195679349 +0000 UTC m=+468.062914359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lqjcw" (UniqueName: "kubernetes.io/projected/ee38a55c-3008-41b9-b937-840974f7658a-kube-api-access-lqjcw") pod "kuadrant-operator-controller-manager-55467d9f7-978xs" (UID: "ee38a55c-3008-41b9-b937-840974f7658a") : failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-978xs" not found
Jul 24 13:00:36.760994 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.760932    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"]
Jul 24 13:00:36.761165 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.761126    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" containerName="manager" containerID="cri-o://8888c4f4d7e2625d837f60b6b25f6d828328d2940b95c285e5d9eab1ed93c147" gracePeriod=2
Jul 24 13:00:36.787003 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.786978    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"]
Jul 24 13:00:36.820021 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.819994    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"]
Jul 24 13:00:36.820411 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.820398    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" containerName="manager"
Jul 24 13:00:36.820459 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.820414    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" containerName="manager"
Jul 24 13:00:36.820495 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.820471    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" containerName="manager"
Jul 24 13:00:36.823792 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.823771    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"
Jul 24 13:00:36.838521 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.838495    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"]
Jul 24 13:00:36.865659 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:36.865620    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vjvrg\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:36.913417 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.913386    2528 generic.go:356] "Generic (PLEG): container finished" podID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" containerID="8888c4f4d7e2625d837f60b6b25f6d828328d2940b95c285e5d9eab1ed93c147" exitCode=0
Jul 24 13:00:36.913558 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.913460    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.917958 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:36.917929    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vjvrg\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:36.920009 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.919988    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.920450 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:36.920428    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-978xs\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="ee38a55c-3008-41b9-b937-840974f7658a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.922442 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:36.922416    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vjvrg\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:36.924579 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:36.924560    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-978xs\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="ee38a55c-3008-41b9-b937-840974f7658a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:36.983645 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:36.983622    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg86f\" (UniqueName: \"kubernetes.io/projected/f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96-kube-api-access-lg86f\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8ln\" (UID: \"f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"
Jul 24 13:00:37.002354 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.002329    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:37.004940 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:37.004917    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vjvrg\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:37.007342 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:37.007318    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-978xs\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="ee38a55c-3008-41b9-b937-840974f7658a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:37.084807 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.084756    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee38a55c-3008-41b9-b937-840974f7658a-extensions-socket-volume\") pod \"ee38a55c-3008-41b9-b937-840974f7658a\" (UID: \"ee38a55c-3008-41b9-b937-840974f7658a\") "
Jul 24 13:00:37.084933 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.084920    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg86f\" (UniqueName: \"kubernetes.io/projected/f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96-kube-api-access-lg86f\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8ln\" (UID: \"f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"
Jul 24 13:00:37.084985 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.084968    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee38a55c-3008-41b9-b937-840974f7658a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ee38a55c-3008-41b9-b937-840974f7658a" (UID: "ee38a55c-3008-41b9-b937-840974f7658a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:00:37.085063 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.085052    2528 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee38a55c-3008-41b9-b937-840974f7658a-extensions-socket-volume\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:00:37.085126 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.085068    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqjcw\" (UniqueName: \"kubernetes.io/projected/ee38a55c-3008-41b9-b937-840974f7658a-kube-api-access-lqjcw\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:00:37.101879 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.101855    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg86f\" (UniqueName: \"kubernetes.io/projected/f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96-kube-api-access-lg86f\") pod \"limitador-operator-controller-manager-859d7b78bd-ds8ln\" (UID: \"f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"
Jul 24 13:00:37.148569 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.148543    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"
Jul 24 13:00:37.185750 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.185722    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvndz\" (UniqueName: \"kubernetes.io/projected/fa8dec81-c4e1-48e6-8b0a-dde1be8635d6-kube-api-access-bvndz\") pod \"fa8dec81-c4e1-48e6-8b0a-dde1be8635d6\" (UID: \"fa8dec81-c4e1-48e6-8b0a-dde1be8635d6\") "
Jul 24 13:00:37.187919 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.187896    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8dec81-c4e1-48e6-8b0a-dde1be8635d6-kube-api-access-bvndz" (OuterVolumeSpecName: "kube-api-access-bvndz") pod "fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" (UID: "fa8dec81-c4e1-48e6-8b0a-dde1be8635d6"). InnerVolumeSpecName "kube-api-access-bvndz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:00:37.286650 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.286593    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvndz\" (UniqueName: \"kubernetes.io/projected/fa8dec81-c4e1-48e6-8b0a-dde1be8635d6-kube-api-access-bvndz\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:00:37.289690 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.289648    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"]
Jul 24 13:00:37.292054 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:00:37.292031    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3499ef0_5539_4b6a_bb1c_25bf7b0a9b96.slice/crio-00ff0aae09bf971cd2b169b0d2e333e631aea24203f01deb096ab5523afae0f5 WatchSource:0}: Error finding container 00ff0aae09bf971cd2b169b0d2e333e631aea24203f01deb096ab5523afae0f5: Status 404 returned error can't find the container with id 00ff0aae09bf971cd2b169b0d2e333e631aea24203f01deb096ab5523afae0f5
Jul 24 13:00:37.632995 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.632917    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee38a55c-3008-41b9-b937-840974f7658a" path="/var/lib/kubelet/pods/ee38a55c-3008-41b9-b937-840974f7658a/volumes"
Jul 24 13:00:37.633351 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.633181    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8dec81-c4e1-48e6-8b0a-dde1be8635d6" path="/var/lib/kubelet/pods/fa8dec81-c4e1-48e6-8b0a-dde1be8635d6/volumes"
Jul 24 13:00:37.919830 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.919805    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vjvrg"
Jul 24 13:00:37.920003 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.919811    2528 scope.go:117] "RemoveContainer" containerID="8888c4f4d7e2625d837f60b6b25f6d828328d2940b95c285e5d9eab1ed93c147"
Jul 24 13:00:37.921744 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.921713    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln" event={"ID":"f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96","Type":"ContainerStarted","Data":"c1416582d54e1a523264be6a6204d018cb44fec25b027da24a81facc9fc37832"}
Jul 24 13:00:37.921853 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.921768    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln" event={"ID":"f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96","Type":"ContainerStarted","Data":"00ff0aae09bf971cd2b169b0d2e333e631aea24203f01deb096ab5523afae0f5"}
Jul 24 13:00:37.922512 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.921971    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"
Jul 24 13:00:37.922512 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.922072    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:37.954565 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:37.954520    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln" podStartSLOduration=1.954505103 podStartE2EDuration="1.954505103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:00:37.95278104 +0000 UTC m=+468.820016073" watchObservedRunningTime="2026-07-24 13:00:37.954505103 +0000 UTC m=+468.821740133"
Jul 24 13:00:37.956287 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:37.956263    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-978xs\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="ee38a55c-3008-41b9-b937-840974f7658a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:39.633284 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:00:39.633240    2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-978xs\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="ee38a55c-3008-41b9-b937-840974f7658a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-978xs"
Jul 24 13:00:48.930455 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:00:48.930425    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ds8ln"
Jul 24 13:01:21.154499 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.154460    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"]
Jul 24 13:01:21.158110 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.158075    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:21.160613 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.160594    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 13:01:21.160710 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.160640    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nvm6g\""
Jul 24 13:01:21.168325 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.168306    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"]
Jul 24 13:01:21.247770 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.247741    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"]
Jul 24 13:01:21.270185 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.270156    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-config-file\") pod \"limitador-limitador-64c94fd64f-rdn2g\" (UID: \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:21.270345 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.270189    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9777\" (UniqueName: \"kubernetes.io/projected/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-kube-api-access-q9777\") pod \"limitador-limitador-64c94fd64f-rdn2g\" (UID: \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:21.371245 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.371214    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-config-file\") pod \"limitador-limitador-64c94fd64f-rdn2g\" (UID: \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:21.371245 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.371248    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9777\" (UniqueName: \"kubernetes.io/projected/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-kube-api-access-q9777\") pod \"limitador-limitador-64c94fd64f-rdn2g\" (UID: \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:21.371827 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.371799    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-config-file\") pod \"limitador-limitador-64c94fd64f-rdn2g\" (UID: \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:21.382986 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.382958    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9777\" (UniqueName: \"kubernetes.io/projected/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-kube-api-access-q9777\") pod \"limitador-limitador-64c94fd64f-rdn2g\" (UID: \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:21.468928 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.468893    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:21.621584 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:21.621535    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"]
Jul 24 13:01:21.624909 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:01:21.624879    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc30a371_2d5b_4b7b_bcf1_d71878c6f7c8.slice/crio-dcbbfca4f40046b8ffa09338751775ec66cdeb0041b0636e3ec5c7e234f88186 WatchSource:0}: Error finding container dcbbfca4f40046b8ffa09338751775ec66cdeb0041b0636e3ec5c7e234f88186: Status 404 returned error can't find the container with id dcbbfca4f40046b8ffa09338751775ec66cdeb0041b0636e3ec5c7e234f88186
Jul 24 13:01:22.140954 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:22.140920    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g" event={"ID":"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8","Type":"ContainerStarted","Data":"dcbbfca4f40046b8ffa09338751775ec66cdeb0041b0636e3ec5c7e234f88186"}
Jul 24 13:01:25.162452 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:25.162419    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g" event={"ID":"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8","Type":"ContainerStarted","Data":"f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf"}
Jul 24 13:01:25.162834 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:25.162491    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:25.185625 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:25.185562    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g" podStartSLOduration=1.467791467 podStartE2EDuration="4.185540864s" totalImagesPullingTime="2.717749397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:01:25.183994183 +0000 UTC m=+516.051229214" watchObservedRunningTime="2026-07-24 13:01:25.185540864 +0000 UTC m=+516.052775895"
Jul 24 13:01:36.169146 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:36.169088    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:38.558513 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:38.558474    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"]
Jul 24 13:01:38.558946 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:38.558725    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g" podUID="bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8" containerName="limitador" containerID="cri-o://f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf" gracePeriod=30
Jul 24 13:01:39.131563 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.131536    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:39.227426 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.227394    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-config-file\") pod \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\" (UID: \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\") "
Jul 24 13:01:39.227600 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.227458    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9777\" (UniqueName: \"kubernetes.io/projected/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-kube-api-access-q9777\") pod \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\" (UID: \"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8\") "
Jul 24 13:01:39.227835 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.227800    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-config-file" (OuterVolumeSpecName: "config-file") pod "bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8" (UID: "bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:01:39.230023 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.229995    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-kube-api-access-q9777" (OuterVolumeSpecName: "kube-api-access-q9777") pod "bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8" (UID: "bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8"). InnerVolumeSpecName "kube-api-access-q9777". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:01:39.232900 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.232876    2528 generic.go:356] "Generic (PLEG): container finished" podID="bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8" containerID="f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf" exitCode=0
Jul 24 13:01:39.232994 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.232918    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"
Jul 24 13:01:39.232994 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.232930    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g" event={"ID":"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8","Type":"ContainerDied","Data":"f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf"}
Jul 24 13:01:39.232994 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.232975    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rdn2g" event={"ID":"bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8","Type":"ContainerDied","Data":"dcbbfca4f40046b8ffa09338751775ec66cdeb0041b0636e3ec5c7e234f88186"}
Jul 24 13:01:39.233129 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.233000    2528 scope.go:117] "RemoveContainer" containerID="f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf"
Jul 24 13:01:39.242938 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.242920    2528 scope.go:117] "RemoveContainer" containerID="f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf"
Jul 24 13:01:39.243222 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:01:39.243206    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf\": container with ID starting with f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf not found: ID does not exist" containerID="f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf"
Jul 24 13:01:39.243272 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.243231    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf"} err="failed to get container status \"f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf\": rpc error: code = NotFound desc = could not find container \"f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf\": container with ID starting with f073dd1e0cf9122c78e35831638139e5eba380f6a9b8bcc048b063d5056b59bf not found: ID does not exist"
Jul 24 13:01:39.262629 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.262606    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"]
Jul 24 13:01:39.280423 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.280397    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rdn2g"]
Jul 24 13:01:39.328046 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.328017    2528 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-config-file\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:01:39.328046 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.328043    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9777\" (UniqueName: \"kubernetes.io/projected/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8-kube-api-access-q9777\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:01:39.632723 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:39.632691    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8" path="/var/lib/kubelet/pods/bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8/volumes"
Jul 24 13:01:43.051153 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.051058    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"]
Jul 24 13:01:43.051531 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.051515    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8" containerName="limitador"
Jul 24 13:01:43.051578 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.051534    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8" containerName="limitador"
Jul 24 13:01:43.051611 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.051604    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc30a371-2d5b-4b7b-bcf1-d71878c6f7c8" containerName="limitador"
Jul 24 13:01:43.054564 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.054545    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:43.057325 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.057299    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 13:01:43.057424 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.057326    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 24 13:01:43.057424 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.057337    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 13:01:43.058198 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.058180    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-j4h2r\""
Jul 24 13:01:43.065497 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.065477    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"]
Jul 24 13:01:43.160481 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.160452    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjwxm\" (UniqueName: \"kubernetes.io/projected/2f440687-f787-415f-8343-952004849928-kube-api-access-tjwxm\") pod \"postgres-69fb4594cf-22jhs\" (UID: \"2f440687-f787-415f-8343-952004849928\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:43.160643 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.160505    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f440687-f787-415f-8343-952004849928-data\") pod \"postgres-69fb4594cf-22jhs\" (UID: \"2f440687-f787-415f-8343-952004849928\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:43.261746 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.261713    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjwxm\" (UniqueName: \"kubernetes.io/projected/2f440687-f787-415f-8343-952004849928-kube-api-access-tjwxm\") pod \"postgres-69fb4594cf-22jhs\" (UID: \"2f440687-f787-415f-8343-952004849928\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:43.261910 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.261782    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f440687-f787-415f-8343-952004849928-data\") pod \"postgres-69fb4594cf-22jhs\" (UID: \"2f440687-f787-415f-8343-952004849928\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:43.262165 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.262148    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f440687-f787-415f-8343-952004849928-data\") pod \"postgres-69fb4594cf-22jhs\" (UID: \"2f440687-f787-415f-8343-952004849928\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:43.271737 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.271717    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjwxm\" (UniqueName: \"kubernetes.io/projected/2f440687-f787-415f-8343-952004849928-kube-api-access-tjwxm\") pod \"postgres-69fb4594cf-22jhs\" (UID: \"2f440687-f787-415f-8343-952004849928\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:43.365920 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.365833    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:43.527575 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:43.527550    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"]
Jul 24 13:01:43.530039 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:01:43.530008    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f440687_f787_415f_8343_952004849928.slice/crio-31d968b713207547a99beaa8c316cb8d2adba03bb24bc610df5795326f847f8b WatchSource:0}: Error finding container 31d968b713207547a99beaa8c316cb8d2adba03bb24bc610df5795326f847f8b: Status 404 returned error can't find the container with id 31d968b713207547a99beaa8c316cb8d2adba03bb24bc610df5795326f847f8b
Jul 24 13:01:44.258520 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:44.258488    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs" event={"ID":"2f440687-f787-415f-8343-952004849928","Type":"ContainerStarted","Data":"31d968b713207547a99beaa8c316cb8d2adba03bb24bc610df5795326f847f8b"}
Jul 24 13:01:49.291460 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:49.291422    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs" event={"ID":"2f440687-f787-415f-8343-952004849928","Type":"ContainerStarted","Data":"feab91cb046cce7cfbd13941fe656a3211f2addfbc57c3599611adbed31aa01e"}
Jul 24 13:01:49.291850 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:49.291543    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:01:49.312435 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:49.312388    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs" podStartSLOduration=0.980850336 podStartE2EDuration="6.312372894s" totalImagesPullingTime="5.331522558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:01:49.310204529 +0000 UTC m=+540.177439563" watchObservedRunningTime="2026-07-24 13:01:49.312372894 +0000 UTC m=+540.179607926"
Jul 24 13:01:55.326691 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:01:55.326659    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-22jhs"
Jul 24 13:02:03.686062 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.686020    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-96fd84db4-gvcl5"]
Jul 24 13:02:03.708889 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.708851    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-96fd84db4-gvcl5"]
Jul 24 13:02:03.709052 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.708938    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:03.713054 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.713024    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 13:02:03.713390 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.713372    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bdlvk\""
Jul 24 13:02:03.714357 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.714333    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 13:02:03.853729 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.853688    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5abe157-aac6-4ebf-955b-79dffe4cf898-webhook-cert\") pod \"maas-controller-96fd84db4-gvcl5\" (UID: \"e5abe157-aac6-4ebf-955b-79dffe4cf898\") " pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:03.853912 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.853833    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcr9k\" (UniqueName: \"kubernetes.io/projected/e5abe157-aac6-4ebf-955b-79dffe4cf898-kube-api-access-bcr9k\") pod \"maas-controller-96fd84db4-gvcl5\" (UID: \"e5abe157-aac6-4ebf-955b-79dffe4cf898\") " pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:03.898079 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.898045    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-595b47dc5f-97msz"]
Jul 24 13:02:03.901933 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.901912    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:03.922583 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.922549    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-595b47dc5f-97msz"]
Jul 24 13:02:03.954783 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.954684    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcr9k\" (UniqueName: \"kubernetes.io/projected/e5abe157-aac6-4ebf-955b-79dffe4cf898-kube-api-access-bcr9k\") pod \"maas-controller-96fd84db4-gvcl5\" (UID: \"e5abe157-aac6-4ebf-955b-79dffe4cf898\") " pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:03.954783 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.954739    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zq26\" (UniqueName: \"kubernetes.io/projected/76286feb-9d44-4511-80e1-bc7d6b0e56a9-kube-api-access-7zq26\") pod \"maas-controller-595b47dc5f-97msz\" (UID: \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\") " pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:03.954783 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.954777    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76286feb-9d44-4511-80e1-bc7d6b0e56a9-webhook-cert\") pod \"maas-controller-595b47dc5f-97msz\" (UID: \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\") " pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:03.955053 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.954819    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5abe157-aac6-4ebf-955b-79dffe4cf898-webhook-cert\") pod \"maas-controller-96fd84db4-gvcl5\" (UID: \"e5abe157-aac6-4ebf-955b-79dffe4cf898\") " pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:03.957622 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.957594    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5abe157-aac6-4ebf-955b-79dffe4cf898-webhook-cert\") pod \"maas-controller-96fd84db4-gvcl5\" (UID: \"e5abe157-aac6-4ebf-955b-79dffe4cf898\") " pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:03.966033 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:03.966010    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcr9k\" (UniqueName: \"kubernetes.io/projected/e5abe157-aac6-4ebf-955b-79dffe4cf898-kube-api-access-bcr9k\") pod \"maas-controller-96fd84db4-gvcl5\" (UID: \"e5abe157-aac6-4ebf-955b-79dffe4cf898\") " pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:04.027164 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.027124    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:04.055621 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.055584    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zq26\" (UniqueName: \"kubernetes.io/projected/76286feb-9d44-4511-80e1-bc7d6b0e56a9-kube-api-access-7zq26\") pod \"maas-controller-595b47dc5f-97msz\" (UID: \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\") " pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:04.055815 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.055640    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76286feb-9d44-4511-80e1-bc7d6b0e56a9-webhook-cert\") pod \"maas-controller-595b47dc5f-97msz\" (UID: \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\") " pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:04.059001 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.058973    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76286feb-9d44-4511-80e1-bc7d6b0e56a9-webhook-cert\") pod \"maas-controller-595b47dc5f-97msz\" (UID: \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\") " pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:04.066836 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.066809    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zq26\" (UniqueName: \"kubernetes.io/projected/76286feb-9d44-4511-80e1-bc7d6b0e56a9-kube-api-access-7zq26\") pod \"maas-controller-595b47dc5f-97msz\" (UID: \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\") " pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:04.173396 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.173368    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-96fd84db4-gvcl5"]
Jul 24 13:02:04.175723 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:02:04.175696    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5abe157_aac6_4ebf_955b_79dffe4cf898.slice/crio-cceb8533fe98acb25c3d6f228be13b5329bad4c0d58d7a585c6fcd18662aff9a WatchSource:0}: Error finding container cceb8533fe98acb25c3d6f228be13b5329bad4c0d58d7a585c6fcd18662aff9a: Status 404 returned error can't find the container with id cceb8533fe98acb25c3d6f228be13b5329bad4c0d58d7a585c6fcd18662aff9a
Jul 24 13:02:04.212415 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.212324    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:04.357451 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.357422    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-595b47dc5f-97msz"]
Jul 24 13:02:04.359010 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:02:04.358985    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76286feb_9d44_4511_80e1_bc7d6b0e56a9.slice/crio-76b00bb97172dd15fdfc202392c2978d8204ca18722f88d4c517f96148c08fc1 WatchSource:0}: Error finding container 76b00bb97172dd15fdfc202392c2978d8204ca18722f88d4c517f96148c08fc1: Status 404 returned error can't find the container with id 76b00bb97172dd15fdfc202392c2978d8204ca18722f88d4c517f96148c08fc1
Jul 24 13:02:04.369276 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.369237    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-96fd84db4-gvcl5" event={"ID":"e5abe157-aac6-4ebf-955b-79dffe4cf898","Type":"ContainerStarted","Data":"cceb8533fe98acb25c3d6f228be13b5329bad4c0d58d7a585c6fcd18662aff9a"}
Jul 24 13:02:04.370328 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:04.370302    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595b47dc5f-97msz" event={"ID":"76286feb-9d44-4511-80e1-bc7d6b0e56a9","Type":"ContainerStarted","Data":"76b00bb97172dd15fdfc202392c2978d8204ca18722f88d4c517f96148c08fc1"}
Jul 24 13:02:07.390881 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:07.390835    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-96fd84db4-gvcl5" event={"ID":"e5abe157-aac6-4ebf-955b-79dffe4cf898","Type":"ContainerStarted","Data":"c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6"}
Jul 24 13:02:07.391440 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:07.390980    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:07.392415 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:07.392388    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595b47dc5f-97msz" event={"ID":"76286feb-9d44-4511-80e1-bc7d6b0e56a9","Type":"ContainerStarted","Data":"d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202"}
Jul 24 13:02:07.392508 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:07.392454    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:07.418450 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:07.418396    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-96fd84db4-gvcl5" podStartSLOduration=1.7139731710000001 podStartE2EDuration="4.418377867s" totalImagesPullingTime="2.704404696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:02:07.4182683 +0000 UTC m=+558.285503329" watchObservedRunningTime="2026-07-24 13:02:07.418377867 +0000 UTC m=+558.285612930"
Jul 24 13:02:07.450634 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:07.450574    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-595b47dc5f-97msz" podStartSLOduration=1.935861624 podStartE2EDuration="4.450555365s" totalImagesPullingTime="2.514693741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:02:07.448493044 +0000 UTC m=+558.315728074" watchObservedRunningTime="2026-07-24 13:02:07.450555365 +0000 UTC m=+558.317790395"
Jul 24 13:02:18.399586 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.399544    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:02:18.400065 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.399866    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:18.491190 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.491152    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-96fd84db4-gvcl5"]
Jul 24 13:02:18.491436 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.491386    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-96fd84db4-gvcl5" podUID="e5abe157-aac6-4ebf-955b-79dffe4cf898" containerName="manager" containerID="cri-o://c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6" gracePeriod=30
Jul 24 13:02:18.752767 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.752737    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:18.896365 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.896326    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5abe157-aac6-4ebf-955b-79dffe4cf898-webhook-cert\") pod \"e5abe157-aac6-4ebf-955b-79dffe4cf898\" (UID: \"e5abe157-aac6-4ebf-955b-79dffe4cf898\") "
Jul 24 13:02:18.896537 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.896378    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcr9k\" (UniqueName: \"kubernetes.io/projected/e5abe157-aac6-4ebf-955b-79dffe4cf898-kube-api-access-bcr9k\") pod \"e5abe157-aac6-4ebf-955b-79dffe4cf898\" (UID: \"e5abe157-aac6-4ebf-955b-79dffe4cf898\") "
Jul 24 13:02:18.898680 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.898657    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5abe157-aac6-4ebf-955b-79dffe4cf898-kube-api-access-bcr9k" (OuterVolumeSpecName: "kube-api-access-bcr9k") pod "e5abe157-aac6-4ebf-955b-79dffe4cf898" (UID: "e5abe157-aac6-4ebf-955b-79dffe4cf898"). InnerVolumeSpecName "kube-api-access-bcr9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:02:18.898762 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.898740    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5abe157-aac6-4ebf-955b-79dffe4cf898-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e5abe157-aac6-4ebf-955b-79dffe4cf898" (UID: "e5abe157-aac6-4ebf-955b-79dffe4cf898"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:02:18.997587 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.997490    2528 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5abe157-aac6-4ebf-955b-79dffe4cf898-webhook-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:02:18.997587 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:18.997526    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcr9k\" (UniqueName: \"kubernetes.io/projected/e5abe157-aac6-4ebf-955b-79dffe4cf898-kube-api-access-bcr9k\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:02:19.456250 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.456217    2528 generic.go:356] "Generic (PLEG): container finished" podID="e5abe157-aac6-4ebf-955b-79dffe4cf898" containerID="c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6" exitCode=0
Jul 24 13:02:19.456665 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.456265    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-96fd84db4-gvcl5"
Jul 24 13:02:19.456665 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.456287    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-96fd84db4-gvcl5" event={"ID":"e5abe157-aac6-4ebf-955b-79dffe4cf898","Type":"ContainerDied","Data":"c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6"}
Jul 24 13:02:19.456665 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.456329    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-96fd84db4-gvcl5" event={"ID":"e5abe157-aac6-4ebf-955b-79dffe4cf898","Type":"ContainerDied","Data":"cceb8533fe98acb25c3d6f228be13b5329bad4c0d58d7a585c6fcd18662aff9a"}
Jul 24 13:02:19.456665 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.456350    2528 scope.go:117] "RemoveContainer" containerID="c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6"
Jul 24 13:02:19.465505 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.465485    2528 scope.go:117] "RemoveContainer" containerID="c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6"
Jul 24 13:02:19.465788 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:02:19.465768    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6\": container with ID starting with c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6 not found: ID does not exist" containerID="c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6"
Jul 24 13:02:19.465858 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.465795    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6"} err="failed to get container status \"c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6\": rpc error: code = NotFound desc = could not find container \"c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6\": container with ID starting with c2171d04de4392698d27d3cde2cf35e211251547640259b2cb960d636b63a1e6 not found: ID does not exist"
Jul 24 13:02:19.482794 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.482759    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-96fd84db4-gvcl5"]
Jul 24 13:02:19.484605 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.484589    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-96fd84db4-gvcl5"]
Jul 24 13:02:19.638645 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:19.638609    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5abe157-aac6-4ebf-955b-79dffe4cf898" path="/var/lib/kubelet/pods/e5abe157-aac6-4ebf-955b-79dffe4cf898/volumes"
Jul 24 13:02:39.492634 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.492596    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f5b677486-srfqc"]
Jul 24 13:02:39.493021 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.492997    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5abe157-aac6-4ebf-955b-79dffe4cf898" containerName="manager"
Jul 24 13:02:39.493021 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.493007    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5abe157-aac6-4ebf-955b-79dffe4cf898" containerName="manager"
Jul 24 13:02:39.493123 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.493067    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5abe157-aac6-4ebf-955b-79dffe4cf898" containerName="manager"
Jul 24 13:02:39.497758 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.497741    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:39.507107 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.507063    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 24 13:02:39.508164 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.508145    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v4vkb\""
Jul 24 13:02:39.524356 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.524325    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5b677486-srfqc"]
Jul 24 13:02:39.577610 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.577571    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwrw5\" (UniqueName: \"kubernetes.io/projected/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-kube-api-access-qwrw5\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:39.577610 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.577613    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:39.577825 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.577693    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-openshift-service-ca\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:39.678873 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.678832    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwrw5\" (UniqueName: \"kubernetes.io/projected/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-kube-api-access-qwrw5\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:39.678873 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.678875    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:39.679189 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.678942    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-openshift-service-ca\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:39.679189 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:02:39.679077    2528 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 24 13:02:39.679189 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:02:39.679177    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls podName:a731ca4b-beb3-4ca8-936e-656c77bf4bfe nodeName:}" failed. No retries permitted until 2026-07-24 13:02:40.17915828 +0000 UTC m=+591.046393308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls") pod "maas-api-f5b677486-srfqc" (UID: "a731ca4b-beb3-4ca8-936e-656c77bf4bfe") : secret "maas-api-serving-cert" not found
Jul 24 13:02:39.679625 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.679607    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-openshift-service-ca\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:39.692971 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:39.692927    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwrw5\" (UniqueName: \"kubernetes.io/projected/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-kube-api-access-qwrw5\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:40.183208 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.183170    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:40.183424 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:02:40.183301    2528 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 24 13:02:40.183424 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:02:40.183387    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls podName:a731ca4b-beb3-4ca8-936e-656c77bf4bfe nodeName:}" failed. No retries permitted until 2026-07-24 13:02:41.1833632 +0000 UTC m=+592.050598224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls") pod "maas-api-f5b677486-srfqc" (UID: "a731ca4b-beb3-4ca8-936e-656c77bf4bfe") : secret "maas-api-serving-cert" not found
Jul 24 13:02:40.456246 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.456160    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"]
Jul 24 13:02:40.465205 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.465175    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:40.468039 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.468013    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v84kz\""
Jul 24 13:02:40.468758 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.468743    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 13:02:40.482079 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.482046    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"]
Jul 24 13:02:40.536778 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.536738    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-nsl7k"]
Jul 24 13:02:40.541158 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.541132    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:40.558002 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.557969    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-nsl7k"]
Jul 24 13:02:40.587928 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.587894    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4884f871-f84c-4eea-9d61-04afaf71c072-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ns69l\" (UID: \"4884f871-f84c-4eea-9d61-04afaf71c072\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:40.588144 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.587968    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxzj\" (UniqueName: \"kubernetes.io/projected/d887a244-c888-4d7a-bb2e-3e00a06d5dea-kube-api-access-hpxzj\") pod \"payload-processing-5cc6cd444b-nsl7k\" (UID: \"d887a244-c888-4d7a-bb2e-3e00a06d5dea\") " pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:40.588144 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.588102    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk4s8\" (UniqueName: \"kubernetes.io/projected/4884f871-f84c-4eea-9d61-04afaf71c072-kube-api-access-mk4s8\") pod \"payload-pre-processing-687dbb6cf6-ns69l\" (UID: \"4884f871-f84c-4eea-9d61-04afaf71c072\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:40.588238 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.588152    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d887a244-c888-4d7a-bb2e-3e00a06d5dea-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-nsl7k\" (UID: \"d887a244-c888-4d7a-bb2e-3e00a06d5dea\") " pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:40.688911 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.688867    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk4s8\" (UniqueName: \"kubernetes.io/projected/4884f871-f84c-4eea-9d61-04afaf71c072-kube-api-access-mk4s8\") pod \"payload-pre-processing-687dbb6cf6-ns69l\" (UID: \"4884f871-f84c-4eea-9d61-04afaf71c072\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:40.689141 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.688932    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d887a244-c888-4d7a-bb2e-3e00a06d5dea-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-nsl7k\" (UID: \"d887a244-c888-4d7a-bb2e-3e00a06d5dea\") " pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:40.689141 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.688998    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4884f871-f84c-4eea-9d61-04afaf71c072-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ns69l\" (UID: \"4884f871-f84c-4eea-9d61-04afaf71c072\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:40.689141 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.689076    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxzj\" (UniqueName: \"kubernetes.io/projected/d887a244-c888-4d7a-bb2e-3e00a06d5dea-kube-api-access-hpxzj\") pod \"payload-processing-5cc6cd444b-nsl7k\" (UID: \"d887a244-c888-4d7a-bb2e-3e00a06d5dea\") " pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:40.689691 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.689667    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d887a244-c888-4d7a-bb2e-3e00a06d5dea-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-nsl7k\" (UID: \"d887a244-c888-4d7a-bb2e-3e00a06d5dea\") " pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:40.689769 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.689697    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4884f871-f84c-4eea-9d61-04afaf71c072-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ns69l\" (UID: \"4884f871-f84c-4eea-9d61-04afaf71c072\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:40.702325 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.702287    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxzj\" (UniqueName: \"kubernetes.io/projected/d887a244-c888-4d7a-bb2e-3e00a06d5dea-kube-api-access-hpxzj\") pod \"payload-processing-5cc6cd444b-nsl7k\" (UID: \"d887a244-c888-4d7a-bb2e-3e00a06d5dea\") " pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:40.702775 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.702754    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk4s8\" (UniqueName: \"kubernetes.io/projected/4884f871-f84c-4eea-9d61-04afaf71c072-kube-api-access-mk4s8\") pod \"payload-pre-processing-687dbb6cf6-ns69l\" (UID: \"4884f871-f84c-4eea-9d61-04afaf71c072\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:40.776984 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.776898    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:40.855018 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.854970    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:40.935675 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:40.935642    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"]
Jul 24 13:02:40.938247 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:02:40.938207    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4884f871_f84c_4eea_9d61_04afaf71c072.slice/crio-1f46d1ee27ee77d4c33a288cbe4f3aed73b53a289a5ac8409dc0e6659f736c46 WatchSource:0}: Error finding container 1f46d1ee27ee77d4c33a288cbe4f3aed73b53a289a5ac8409dc0e6659f736c46: Status 404 returned error can't find the container with id 1f46d1ee27ee77d4c33a288cbe4f3aed73b53a289a5ac8409dc0e6659f736c46
Jul 24 13:02:41.018531 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:41.018507    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-nsl7k"]
Jul 24 13:02:41.020344 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:02:41.020317    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd887a244_c888_4d7a_bb2e_3e00a06d5dea.slice/crio-ff71a472072e81f842f661bb799ce441794d8178284edc62b3b1de0d6171062e WatchSource:0}: Error finding container ff71a472072e81f842f661bb799ce441794d8178284edc62b3b1de0d6171062e: Status 404 returned error can't find the container with id ff71a472072e81f842f661bb799ce441794d8178284edc62b3b1de0d6171062e
Jul 24 13:02:41.194690 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:41.194649    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:41.197239 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:41.197220    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a731ca4b-beb3-4ca8-936e-656c77bf4bfe-maas-api-tls\") pod \"maas-api-f5b677486-srfqc\" (UID: \"a731ca4b-beb3-4ca8-936e-656c77bf4bfe\") " pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:41.310200 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:41.310163    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:41.475665 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:41.475641    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5b677486-srfqc"]
Jul 24 13:02:41.478186 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:02:41.478151    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda731ca4b_beb3_4ca8_936e_656c77bf4bfe.slice/crio-84d3bf26bbcbb4e8b26c925db9e730ea54494beb07ef0a351818efc14a4f21e9 WatchSource:0}: Error finding container 84d3bf26bbcbb4e8b26c925db9e730ea54494beb07ef0a351818efc14a4f21e9: Status 404 returned error can't find the container with id 84d3bf26bbcbb4e8b26c925db9e730ea54494beb07ef0a351818efc14a4f21e9
Jul 24 13:02:41.573350 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:41.573312    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k" event={"ID":"d887a244-c888-4d7a-bb2e-3e00a06d5dea","Type":"ContainerStarted","Data":"ff71a472072e81f842f661bb799ce441794d8178284edc62b3b1de0d6171062e"}
Jul 24 13:02:41.574517 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:41.574498    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l" event={"ID":"4884f871-f84c-4eea-9d61-04afaf71c072","Type":"ContainerStarted","Data":"1f46d1ee27ee77d4c33a288cbe4f3aed73b53a289a5ac8409dc0e6659f736c46"}
Jul 24 13:02:41.575677 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:41.575651    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc" event={"ID":"a731ca4b-beb3-4ca8-936e-656c77bf4bfe","Type":"ContainerStarted","Data":"84d3bf26bbcbb4e8b26c925db9e730ea54494beb07ef0a351818efc14a4f21e9"}
Jul 24 13:02:44.597378 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.597334    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc" event={"ID":"a731ca4b-beb3-4ca8-936e-656c77bf4bfe","Type":"ContainerStarted","Data":"24749e05baba6143f9bd31e5aa544945d93a087c612bba84c107a657dce87d70"}
Jul 24 13:02:44.597848 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.597406    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:44.598871 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.598836    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k" event={"ID":"d887a244-c888-4d7a-bb2e-3e00a06d5dea","Type":"ContainerStarted","Data":"7d63a6f5a7db15b15645780457c1d89e02c927730ffeaed95f426bd94ee2dbfc"}
Jul 24 13:02:44.598999 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.598909    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:44.600315 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.600294    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l" event={"ID":"4884f871-f84c-4eea-9d61-04afaf71c072","Type":"ContainerStarted","Data":"709e9604af895a34f4ebe146a99e924ab9add025e73bd03d74f3bb54a39dc003"}
Jul 24 13:02:44.600387 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.600339    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:44.634201 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.634140    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc" podStartSLOduration=3.584661204 podStartE2EDuration="5.634118971s" totalImagesPullingTime="2.049457767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:02:44.632330148 +0000 UTC m=+595.499565182" watchObservedRunningTime="2026-07-24 13:02:44.634118971 +0000 UTC m=+595.501354000"
Jul 24 13:02:44.671215 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.671154    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l" podStartSLOduration=2.082941036 podStartE2EDuration="4.671134788s" totalImagesPullingTime="2.588193752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:02:44.670184903 +0000 UTC m=+595.537419936" watchObservedRunningTime="2026-07-24 13:02:44.671134788 +0000 UTC m=+595.538369861"
Jul 24 13:02:44.701668 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:44.701615    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k" podStartSLOduration=2.188310014 podStartE2EDuration="4.701597968s" totalImagesPullingTime="2.513287954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:02:44.696614084 +0000 UTC m=+595.563849115" watchObservedRunningTime="2026-07-24 13:02:44.701597968 +0000 UTC m=+595.568832997"
Jul 24 13:02:49.628336 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:49.628303    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:02:49.628835 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:49.628732    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:02:50.612702 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:50.612670    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f5b677486-srfqc"
Jul 24 13:02:55.608580 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:55.608546    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ns69l"
Jul 24 13:02:55.609075 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:55.608627    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-nsl7k"
Jul 24 13:02:59.231601 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.231559    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"]
Jul 24 13:02:59.235531 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.235510    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.238293 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.238242    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpstm\""
Jul 24 13:02:59.239170 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.239148    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 13:02:59.239303 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.239240    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 13:02:59.239303 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.239263    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 13:02:59.250385 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.250357    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"]
Jul 24 13:02:59.375919 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.375877    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.376114 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.375943    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/583bbb93-3c8d-4edf-be59-9c2cf792eb97-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.376114 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.376055    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.376114 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.376081    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r65sk\" (UniqueName: \"kubernetes.io/projected/583bbb93-3c8d-4edf-be59-9c2cf792eb97-kube-api-access-r65sk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.376338 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.376130    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.376338 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.376216    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.476828 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.476793    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.476828 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.476829    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/583bbb93-3c8d-4edf-be59-9c2cf792eb97-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.477064 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.476975    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.477064 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.477007    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r65sk\" (UniqueName: \"kubernetes.io/projected/583bbb93-3c8d-4edf-be59-9c2cf792eb97-kube-api-access-r65sk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.477064 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.477047    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.477262 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.477072    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.477317 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.477293    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.477368 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.477342    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.477484 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.477459    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.479372 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.479340    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/583bbb93-3c8d-4edf-be59-9c2cf792eb97-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.479513 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.479497    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/583bbb93-3c8d-4edf-be59-9c2cf792eb97-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.487894 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.487835    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r65sk\" (UniqueName: \"kubernetes.io/projected/583bbb93-3c8d-4edf-be59-9c2cf792eb97-kube-api-access-r65sk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj\" (UID: \"583bbb93-3c8d-4edf-be59-9c2cf792eb97\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.546744 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.546703    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:02:59.710622 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:02:59.710599    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"]
Jul 24 13:02:59.713450 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:02:59.713423    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583bbb93_3c8d_4edf_be59_9c2cf792eb97.slice/crio-d74011fef1b85c382019220e75e79d124c511b8e29a749afc1bc395576d86750 WatchSource:0}: Error finding container d74011fef1b85c382019220e75e79d124c511b8e29a749afc1bc395576d86750: Status 404 returned error can't find the container with id d74011fef1b85c382019220e75e79d124c511b8e29a749afc1bc395576d86750
Jul 24 13:03:00.686028 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:00.685998    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj" event={"ID":"583bbb93-3c8d-4edf-be59-9c2cf792eb97","Type":"ContainerStarted","Data":"d74011fef1b85c382019220e75e79d124c511b8e29a749afc1bc395576d86750"}
Jul 24 13:03:01.693399 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:01.693365    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj" event={"ID":"583bbb93-3c8d-4edf-be59-9c2cf792eb97","Type":"ContainerStarted","Data":"1640fc6d0270bd19a0be8d495afc2c34b20453d26b10a903e8100d2d7b3d5b99"}
Jul 24 13:03:01.719182 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:01.719115    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj" podStartSLOduration=1.7478494009999999 podStartE2EDuration="2.719075712s" totalImagesPullingTime="971.226311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:03:01.71785359 +0000 UTC m=+612.585088620" watchObservedRunningTime="2026-07-24 13:03:01.719075712 +0000 UTC m=+612.586310742"
Jul 24 13:03:09.547300 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:09.547261    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:03:09.547745 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:09.547354    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:03:09.559924 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:09.559898    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:03:09.745633 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:09.745599    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj"
Jul 24 13:03:34.015676 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.015635    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"]
Jul 24 13:03:34.022389 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.022357    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.027439 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.027415    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 13:03:34.035347 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.035318    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"]
Jul 24 13:03:34.092424 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.092393    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.092624 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.092448    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.092624 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.092480    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.092624 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.092499    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8593a7c-bbf4-4de9-a38f-4510c5117669-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.092624 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.092517    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.092624 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.092565    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8xz5\" (UniqueName: \"kubernetes.io/projected/a8593a7c-bbf4-4de9-a38f-4510c5117669-kube-api-access-w8xz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.193504 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.193467    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.193715 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.193525    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.193715 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.193553    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.193715 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.193570    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8593a7c-bbf4-4de9-a38f-4510c5117669-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.193715 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.193586    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.193715 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.193617    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8xz5\" (UniqueName: \"kubernetes.io/projected/a8593a7c-bbf4-4de9-a38f-4510c5117669-kube-api-access-w8xz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.193983 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.193960    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.194031 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.193980    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.194080 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.194056    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.196194 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.196170    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8593a7c-bbf4-4de9-a38f-4510c5117669-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.196396 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.196378    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8593a7c-bbf4-4de9-a38f-4510c5117669-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.204990 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.204963    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8xz5\" (UniqueName: \"kubernetes.io/projected/a8593a7c-bbf4-4de9-a38f-4510c5117669-kube-api-access-w8xz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl\" (UID: \"a8593a7c-bbf4-4de9-a38f-4510c5117669\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.333369 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.333279    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:34.487118 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.487073    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"]
Jul 24 13:03:34.489239 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:03:34.489213    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8593a7c_bbf4_4de9_a38f_4510c5117669.slice/crio-672285da2166ae9132f4224b015b0ba4179e78db49bf798403e66c57c457c3ab WatchSource:0}: Error finding container 672285da2166ae9132f4224b015b0ba4179e78db49bf798403e66c57c457c3ab: Status 404 returned error can't find the container with id 672285da2166ae9132f4224b015b0ba4179e78db49bf798403e66c57c457c3ab
Jul 24 13:03:34.490799 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.490779    2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:03:34.864936 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.864903    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl" event={"ID":"a8593a7c-bbf4-4de9-a38f-4510c5117669","Type":"ContainerStarted","Data":"cd9d390a73ece15360d29e91933f5954fcbeb70f6abce002fa528f25fad8102b"}
Jul 24 13:03:34.865138 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.864962    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl" event={"ID":"a8593a7c-bbf4-4de9-a38f-4510c5117669","Type":"ContainerStarted","Data":"672285da2166ae9132f4224b015b0ba4179e78db49bf798403e66c57c457c3ab"}
Jul 24 13:03:34.887425 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:34.887370    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl" podStartSLOduration=1.666844049 podStartE2EDuration="1.887350765s" totalImagesPullingTime="220.506716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:03:34.887122791 +0000 UTC m=+645.754357818" watchObservedRunningTime="2026-07-24 13:03:34.887350765 +0000 UTC m=+645.754585794"
Jul 24 13:03:39.913702 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:39.913669    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"]
Jul 24 13:03:39.917601 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:39.917579    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:39.920768 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:39.920744    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 13:03:39.929127 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:39.929077    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"]
Jul 24 13:03:40.050390 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.050348    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4bc5\" (UniqueName: \"kubernetes.io/projected/35812892-3ee2-4ae8-9f78-6aa50509294c-kube-api-access-g4bc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.050390 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.050394    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.050651 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.050466    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.050651 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.050562    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35812892-3ee2-4ae8-9f78-6aa50509294c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.050651 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.050643    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.050758 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.050716    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.151468 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151425    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.151638 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151489    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.151638 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151576    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4bc5\" (UniqueName: \"kubernetes.io/projected/35812892-3ee2-4ae8-9f78-6aa50509294c-kube-api-access-g4bc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.151638 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151611    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.151793 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151654    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.151793 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151702    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35812892-3ee2-4ae8-9f78-6aa50509294c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.151903 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151869    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.151903 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151890    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.152032 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.151968    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.154174 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.154139    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35812892-3ee2-4ae8-9f78-6aa50509294c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.154364 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.154348    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35812892-3ee2-4ae8-9f78-6aa50509294c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.162957 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.162931    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4bc5\" (UniqueName: \"kubernetes.io/projected/35812892-3ee2-4ae8-9f78-6aa50509294c-kube-api-access-g4bc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t44kd\" (UID: \"35812892-3ee2-4ae8-9f78-6aa50509294c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.230221 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.230128    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:40.393563 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.393533    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"]
Jul 24 13:03:40.394733 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:03:40.394704    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35812892_3ee2_4ae8_9f78_6aa50509294c.slice/crio-e11bf39c2e3b71f524934c4aad689fb54aed41f7a359a4a761578b3d711c8440 WatchSource:0}: Error finding container e11bf39c2e3b71f524934c4aad689fb54aed41f7a359a4a761578b3d711c8440: Status 404 returned error can't find the container with id e11bf39c2e3b71f524934c4aad689fb54aed41f7a359a4a761578b3d711c8440
Jul 24 13:03:40.897600 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.897494    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd" event={"ID":"35812892-3ee2-4ae8-9f78-6aa50509294c","Type":"ContainerStarted","Data":"3d47a53d42a6565730a261c683ccefd1d3aa47dc59998cba80f19f30ef2a48c4"}
Jul 24 13:03:40.897600 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.897555    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd" event={"ID":"35812892-3ee2-4ae8-9f78-6aa50509294c","Type":"ContainerStarted","Data":"e11bf39c2e3b71f524934c4aad689fb54aed41f7a359a4a761578b3d711c8440"}
Jul 24 13:03:40.926760 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:40.926706    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd" podStartSLOduration=1.714575359 podStartE2EDuration="1.926655012s" totalImagesPullingTime="212.079653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:03:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:03:40.925805461 +0000 UTC m=+651.793040493" watchObservedRunningTime="2026-07-24 13:03:40.926655012 +0000 UTC m=+651.793890041"
Jul 24 13:03:44.333876 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:44.333837    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:44.334352 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:44.333901    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:44.346754 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:44.346721    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:44.930743 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:44.930714    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl"
Jul 24 13:03:50.231083 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:50.231031    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:50.231519 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:50.231158    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:50.244551 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:50.244523    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:03:50.964505 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:03:50.964469    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t44kd"
Jul 24 13:05:32.955649 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:32.955617    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-595b47dc5f-97msz"]
Jul 24 13:05:32.956140 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:32.955836    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-595b47dc5f-97msz" podUID="76286feb-9d44-4511-80e1-bc7d6b0e56a9" containerName="manager" containerID="cri-o://d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202" gracePeriod=30
Jul 24 13:05:33.215392 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.215330    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:05:33.273413 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.273376    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zq26\" (UniqueName: \"kubernetes.io/projected/76286feb-9d44-4511-80e1-bc7d6b0e56a9-kube-api-access-7zq26\") pod \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\" (UID: \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\") "
Jul 24 13:05:33.273581 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.273475    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76286feb-9d44-4511-80e1-bc7d6b0e56a9-webhook-cert\") pod \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\" (UID: \"76286feb-9d44-4511-80e1-bc7d6b0e56a9\") "
Jul 24 13:05:33.275595 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.275561    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76286feb-9d44-4511-80e1-bc7d6b0e56a9-kube-api-access-7zq26" (OuterVolumeSpecName: "kube-api-access-7zq26") pod "76286feb-9d44-4511-80e1-bc7d6b0e56a9" (UID: "76286feb-9d44-4511-80e1-bc7d6b0e56a9"). InnerVolumeSpecName "kube-api-access-7zq26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:05:33.275716 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.275631    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76286feb-9d44-4511-80e1-bc7d6b0e56a9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "76286feb-9d44-4511-80e1-bc7d6b0e56a9" (UID: "76286feb-9d44-4511-80e1-bc7d6b0e56a9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:05:33.374213 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.374179    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zq26\" (UniqueName: \"kubernetes.io/projected/76286feb-9d44-4511-80e1-bc7d6b0e56a9-kube-api-access-7zq26\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:05:33.374213 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.374207    2528 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76286feb-9d44-4511-80e1-bc7d6b0e56a9-webhook-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:05:33.488740 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.488651    2528 generic.go:356] "Generic (PLEG): container finished" podID="76286feb-9d44-4511-80e1-bc7d6b0e56a9" containerID="d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202" exitCode=0
Jul 24 13:05:33.488740 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.488697    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595b47dc5f-97msz"
Jul 24 13:05:33.488913 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.488736    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595b47dc5f-97msz" event={"ID":"76286feb-9d44-4511-80e1-bc7d6b0e56a9","Type":"ContainerDied","Data":"d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202"}
Jul 24 13:05:33.488913 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.488787    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595b47dc5f-97msz" event={"ID":"76286feb-9d44-4511-80e1-bc7d6b0e56a9","Type":"ContainerDied","Data":"76b00bb97172dd15fdfc202392c2978d8204ca18722f88d4c517f96148c08fc1"}
Jul 24 13:05:33.488913 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.488810    2528 scope.go:117] "RemoveContainer" containerID="d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202"
Jul 24 13:05:33.498580 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.498565    2528 scope.go:117] "RemoveContainer" containerID="d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202"
Jul 24 13:05:33.498872 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:05:33.498852    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202\": container with ID starting with d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202 not found: ID does not exist" containerID="d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202"
Jul 24 13:05:33.498933 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.498889    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202"} err="failed to get container status \"d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202\": rpc error: code = NotFound desc = could not find container \"d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202\": container with ID starting with d7907186aea163f264a522e4ef624fd803858b5bc3bc3c539dc086d858079202 not found: ID does not exist"
Jul 24 13:05:33.512607 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.512587    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-595b47dc5f-97msz"]
Jul 24 13:05:33.519975 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.519956    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-595b47dc5f-97msz"]
Jul 24 13:05:33.639601 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:05:33.639572    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76286feb-9d44-4511-80e1-bc7d6b0e56a9" path="/var/lib/kubelet/pods/76286feb-9d44-4511-80e1-bc7d6b0e56a9/volumes"
Jul 24 13:07:49.661225 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:07:49.661199    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:07:49.664108 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:07:49.664069    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:12:49.699605 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:12:49.699581    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:12:49.704867 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:12:49.704843    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:17:49.732213 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:17:49.732178    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:17:49.739794 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:17:49.739777    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:20:13.532246 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.532214    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"]
Jul 24 13:20:13.534662 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.532631    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76286feb-9d44-4511-80e1-bc7d6b0e56a9" containerName="manager"
Jul 24 13:20:13.534662 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.532642    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="76286feb-9d44-4511-80e1-bc7d6b0e56a9" containerName="manager"
Jul 24 13:20:13.534662 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.532712    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="76286feb-9d44-4511-80e1-bc7d6b0e56a9" containerName="manager"
Jul 24 13:20:13.535773 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.535754    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:13.538313 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.538275    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-acfcca72\""
Jul 24 13:20:13.538447 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.538337    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-acfcca72-dockercfg-9wmgd\""
Jul 24 13:20:13.548162 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.548143    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"]
Jul 24 13:20:13.590578 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.590546    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt\" (UID: \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:13.590946 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.590640    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjnc6\" (UniqueName: \"kubernetes.io/projected/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-kube-api-access-bjnc6\") pod \"payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt\" (UID: \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:13.691362 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.691333    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjnc6\" (UniqueName: \"kubernetes.io/projected/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-kube-api-access-bjnc6\") pod \"payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt\" (UID: \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:13.691515 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.691451    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt\" (UID: \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:13.692121 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.692081    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt\" (UID: \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:13.700284 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.700263    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjnc6\" (UniqueName: \"kubernetes.io/projected/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-kube-api-access-bjnc6\") pod \"payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt\" (UID: \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:13.847070 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.847004    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:13.987697 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:13.987673    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"]
Jul 24 13:20:13.990400 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:20:13.990368    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1f9aeb_dbc5_461b_b9b6_ce7c5167a23f.slice/crio-2e499e25025fb991c89d94f96dfc8753a96924731476d32c015df0f19c423a8e WatchSource:0}: Error finding container 2e499e25025fb991c89d94f96dfc8753a96924731476d32c015df0f19c423a8e: Status 404 returned error can't find the container with id 2e499e25025fb991c89d94f96dfc8753a96924731476d32c015df0f19c423a8e
Jul 24 13:20:14.091688 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:14.091656    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt" event={"ID":"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f","Type":"ContainerStarted","Data":"6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a"}
Jul 24 13:20:14.091823 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:14.091740    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt" event={"ID":"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f","Type":"ContainerStarted","Data":"2e499e25025fb991c89d94f96dfc8753a96924731476d32c015df0f19c423a8e"}
Jul 24 13:20:14.091823 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:14.091806    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:14.110267 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:14.110167    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt" podStartSLOduration=1.11015394 podStartE2EDuration="1.11015394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:20:14.108857224 +0000 UTC m=+1644.976092254" watchObservedRunningTime="2026-07-24 13:20:14.11015394 +0000 UTC m=+1644.977388970"
Jul 24 13:20:25.098721 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:25.098692    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:38.165700 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.165667    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"]
Jul 24 13:20:38.169330 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.169314    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"
Jul 24 13:20:38.171879 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.171860    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:20:38.179154 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.179131    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"]
Jul 24 13:20:38.307948 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.307920    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/135d9921-d8ab-46f3-82c1-e44b9ad9c17f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-acfcca72-78wxn\" (UID: \"135d9921-d8ab-46f3-82c1-e44b9ad9c17f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"
Jul 24 13:20:38.409240 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.409214    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/135d9921-d8ab-46f3-82c1-e44b9ad9c17f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-acfcca72-78wxn\" (UID: \"135d9921-d8ab-46f3-82c1-e44b9ad9c17f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"
Jul 24 13:20:38.409821 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.409803    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/135d9921-d8ab-46f3-82c1-e44b9ad9c17f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-acfcca72-78wxn\" (UID: \"135d9921-d8ab-46f3-82c1-e44b9ad9c17f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"
Jul 24 13:20:38.481207 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.481149    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"
Jul 24 13:20:38.617955 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.617933    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"]
Jul 24 13:20:38.619845 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:20:38.619821    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135d9921_d8ab_46f3_82c1_e44b9ad9c17f.slice/crio-4488463f997c376de05cefcdf5198f9940fcf25f610dcce104640960b6ba1eb2 WatchSource:0}: Error finding container 4488463f997c376de05cefcdf5198f9940fcf25f610dcce104640960b6ba1eb2: Status 404 returned error can't find the container with id 4488463f997c376de05cefcdf5198f9940fcf25f610dcce104640960b6ba1eb2
Jul 24 13:20:38.624838 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:38.624820    2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:20:39.219990 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:39.219957    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn" event={"ID":"135d9921-d8ab-46f3-82c1-e44b9ad9c17f","Type":"ContainerStarted","Data":"4488463f997c376de05cefcdf5198f9940fcf25f610dcce104640960b6ba1eb2"}
Jul 24 13:20:41.234170 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:41.234130    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn" event={"ID":"135d9921-d8ab-46f3-82c1-e44b9ad9c17f","Type":"ContainerStarted","Data":"0dad78d66daf893731a5b9335487a03e004fc80764abd6adee2763b5c81db8bf"}
Jul 24 13:20:41.252940 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:41.252894    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn" podStartSLOduration=1.113755735 podStartE2EDuration="3.252879224s" totalImagesPullingTime="2.139123489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:20:41.251083442 +0000 UTC m=+1672.118318473" watchObservedRunningTime="2026-07-24 13:20:41.252879224 +0000 UTC m=+1672.120114272"
Jul 24 13:20:42.241031 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:42.240997    2528 generic.go:356] "Generic (PLEG): container finished" podID="135d9921-d8ab-46f3-82c1-e44b9ad9c17f" containerID="0dad78d66daf893731a5b9335487a03e004fc80764abd6adee2763b5c81db8bf" exitCode=0
Jul 24 13:20:42.241455 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:42.241046    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn" event={"ID":"135d9921-d8ab-46f3-82c1-e44b9ad9c17f","Type":"ContainerDied","Data":"0dad78d66daf893731a5b9335487a03e004fc80764abd6adee2763b5c81db8bf"}
Jul 24 13:20:43.383683 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:43.383660    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"
Jul 24 13:20:43.455388 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:43.455358    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/135d9921-d8ab-46f3-82c1-e44b9ad9c17f-maas-api-service-ca\") pod \"135d9921-d8ab-46f3-82c1-e44b9ad9c17f\" (UID: \"135d9921-d8ab-46f3-82c1-e44b9ad9c17f\") "
Jul 24 13:20:43.455708 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:43.455686    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/135d9921-d8ab-46f3-82c1-e44b9ad9c17f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "135d9921-d8ab-46f3-82c1-e44b9ad9c17f" (UID: "135d9921-d8ab-46f3-82c1-e44b9ad9c17f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:20:43.556060 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:43.555982    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/135d9921-d8ab-46f3-82c1-e44b9ad9c17f-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:20:44.253905 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:44.253871    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"
Jul 24 13:20:44.254070 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:44.253904    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn" event={"ID":"135d9921-d8ab-46f3-82c1-e44b9ad9c17f","Type":"ContainerDied","Data":"4488463f997c376de05cefcdf5198f9940fcf25f610dcce104640960b6ba1eb2"}
Jul 24 13:20:44.254070 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:44.253945    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4488463f997c376de05cefcdf5198f9940fcf25f610dcce104640960b6ba1eb2"
Jul 24 13:20:48.884016 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:48.883979    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"]
Jul 24 13:20:48.884620 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:48.884252    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt" podUID="4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f" containerName="payload-pre-processing" containerID="cri-o://6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a" gracePeriod=30
Jul 24 13:20:49.143084 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.143025    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:49.203422 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.203393    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-plugins-config-volume\") pod \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\" (UID: \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\") "
Jul 24 13:20:49.203572 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.203435    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjnc6\" (UniqueName: \"kubernetes.io/projected/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-kube-api-access-bjnc6\") pod \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\" (UID: \"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f\") "
Jul 24 13:20:49.203833 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.203808    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f" (UID: "4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:20:49.205859 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.205825    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-kube-api-access-bjnc6" (OuterVolumeSpecName: "kube-api-access-bjnc6") pod "4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f" (UID: "4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f"). InnerVolumeSpecName "kube-api-access-bjnc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:20:49.280555 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.280520    2528 generic.go:356] "Generic (PLEG): container finished" podID="4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f" containerID="6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a" exitCode=0
Jul 24 13:20:49.280714 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.280572    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"
Jul 24 13:20:49.280714 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.280608    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt" event={"ID":"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f","Type":"ContainerDied","Data":"6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a"}
Jul 24 13:20:49.280714 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.280670    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt" event={"ID":"4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f","Type":"ContainerDied","Data":"2e499e25025fb991c89d94f96dfc8753a96924731476d32c015df0f19c423a8e"}
Jul 24 13:20:49.280714 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.280700    2528 scope.go:117] "RemoveContainer" containerID="6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a"
Jul 24 13:20:49.290662 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.290631    2528 scope.go:117] "RemoveContainer" containerID="6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a"
Jul 24 13:20:49.290920 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:20:49.290901    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a\": container with ID starting with 6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a not found: ID does not exist" containerID="6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a"
Jul 24 13:20:49.290991 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.290932    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a"} err="failed to get container status \"6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a\": rpc error: code = NotFound desc = could not find container \"6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a\": container with ID starting with 6adfe68b28484c3271092dff8db0b54c647ba93c3fcbb364a67d4356961e7c9a not found: ID does not exist"
Jul 24 13:20:49.302790 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.302766    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"]
Jul 24 13:20:49.304713 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.304695    2528 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-plugins-config-volume\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:20:49.304814 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.304717    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjnc6\" (UniqueName: \"kubernetes.io/projected/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f-kube-api-access-bjnc6\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:20:49.307331 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.307310    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-acfcca72-5f95f7f868-fc8kt"]
Jul 24 13:20:49.636049 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:49.636017    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f" path="/var/lib/kubelet/pods/4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f/volumes"
Jul 24 13:20:53.244969 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:53.244935    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"]
Jul 24 13:20:53.248682 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:53.248655    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-acfcca72-78wxn"]
Jul 24 13:20:53.633820 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:53.633745    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="135d9921-d8ab-46f3-82c1-e44b9ad9c17f" path="/var/lib/kubelet/pods/135d9921-d8ab-46f3-82c1-e44b9ad9c17f/volumes"
Jul 24 13:20:57.648224 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.648195    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"]
Jul 24 13:20:57.648649 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.648635    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135d9921-d8ab-46f3-82c1-e44b9ad9c17f" containerName="revoke-keys"
Jul 24 13:20:57.648693 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.648652    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="135d9921-d8ab-46f3-82c1-e44b9ad9c17f" containerName="revoke-keys"
Jul 24 13:20:57.648693 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.648665    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f" containerName="payload-pre-processing"
Jul 24 13:20:57.648693 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.648672    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f" containerName="payload-pre-processing"
Jul 24 13:20:57.648788 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.648734    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d1f9aeb-dbc5-461b-b9b6-ce7c5167a23f" containerName="payload-pre-processing"
Jul 24 13:20:57.648788 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.648746    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="135d9921-d8ab-46f3-82c1-e44b9ad9c17f" containerName="revoke-keys"
Jul 24 13:20:57.651956 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.651940    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:57.654472 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.654452    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-90d0d94f-dockercfg-jmhbs\""
Jul 24 13:20:57.654472 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.654465    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-90d0d94f\""
Jul 24 13:20:57.660647 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.660627    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"]
Jul 24 13:20:57.673841 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.673819    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"]
Jul 24 13:20:57.678383 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.678364    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:57.701185 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.701164    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"]
Jul 24 13:20:57.778883 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.778851    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zffq\" (UniqueName: \"kubernetes.io/projected/f7146c03-a24f-460b-890f-2d79ae3fba92-kube-api-access-2zffq\") pod \"payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k\" (UID: \"f7146c03-a24f-460b-890f-2d79ae3fba92\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:57.778883 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.778886    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7146c03-a24f-460b-890f-2d79ae3fba92-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k\" (UID: \"f7146c03-a24f-460b-890f-2d79ae3fba92\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:57.779066 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.778997    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65bzj\" (UniqueName: \"kubernetes.io/projected/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-kube-api-access-65bzj\") pod \"payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg\" (UID: \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\") " pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:57.779066 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.779031    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg\" (UID: \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\") " pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:57.879644 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.879613    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65bzj\" (UniqueName: \"kubernetes.io/projected/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-kube-api-access-65bzj\") pod \"payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg\" (UID: \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\") " pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:57.879644 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.879648    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg\" (UID: \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\") " pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:57.879842 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.879688    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zffq\" (UniqueName: \"kubernetes.io/projected/f7146c03-a24f-460b-890f-2d79ae3fba92-kube-api-access-2zffq\") pod \"payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k\" (UID: \"f7146c03-a24f-460b-890f-2d79ae3fba92\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:57.879842 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.879708    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7146c03-a24f-460b-890f-2d79ae3fba92-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k\" (UID: \"f7146c03-a24f-460b-890f-2d79ae3fba92\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:57.880318 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.880300    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg\" (UID: \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\") " pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:57.880400 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.880384    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7146c03-a24f-460b-890f-2d79ae3fba92-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k\" (UID: \"f7146c03-a24f-460b-890f-2d79ae3fba92\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:57.888999 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.888975    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zffq\" (UniqueName: \"kubernetes.io/projected/f7146c03-a24f-460b-890f-2d79ae3fba92-kube-api-access-2zffq\") pod \"payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k\" (UID: \"f7146c03-a24f-460b-890f-2d79ae3fba92\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:57.889131 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.889074    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65bzj\" (UniqueName: \"kubernetes.io/projected/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-kube-api-access-65bzj\") pod \"payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg\" (UID: \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\") " pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:57.963450 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.963428    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:57.998281 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:57.998260    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:58.129788 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:58.129762    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"]
Jul 24 13:20:58.132086 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:20:58.132055    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7146c03_a24f_460b_890f_2d79ae3fba92.slice/crio-368da60e17415d0d622e0df4fba33c2e46bd829d0a74c787c6431590a54a7a00 WatchSource:0}: Error finding container 368da60e17415d0d622e0df4fba33c2e46bd829d0a74c787c6431590a54a7a00: Status 404 returned error can't find the container with id 368da60e17415d0d622e0df4fba33c2e46bd829d0a74c787c6431590a54a7a00
Jul 24 13:20:58.327698 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:58.327601    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k" event={"ID":"f7146c03-a24f-460b-890f-2d79ae3fba92","Type":"ContainerStarted","Data":"22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237"}
Jul 24 13:20:58.327698 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:58.327667    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:20:58.327698 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:58.327687    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k" event={"ID":"f7146c03-a24f-460b-890f-2d79ae3fba92","Type":"ContainerStarted","Data":"368da60e17415d0d622e0df4fba33c2e46bd829d0a74c787c6431590a54a7a00"}
Jul 24 13:20:58.345405 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:58.345353    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k" podStartSLOduration=1.345331786 podStartE2EDuration="1.345331786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:20:58.342412057 +0000 UTC m=+1689.209647088" watchObservedRunningTime="2026-07-24 13:20:58.345331786 +0000 UTC m=+1689.212566816"
Jul 24 13:20:58.370284 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:58.370261    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"]
Jul 24 13:20:58.371615 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:20:58.371593    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fdd39a_1a7b_4a12_aa77_3126f89cb3a1.slice/crio-09a8b2d51a1449a2800754e873919ed1cb37a7c5ec01313be73132ca117e11ba WatchSource:0}: Error finding container 09a8b2d51a1449a2800754e873919ed1cb37a7c5ec01313be73132ca117e11ba: Status 404 returned error can't find the container with id 09a8b2d51a1449a2800754e873919ed1cb37a7c5ec01313be73132ca117e11ba
Jul 24 13:20:59.334135 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:59.334076    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg" event={"ID":"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1","Type":"ContainerStarted","Data":"fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581"}
Jul 24 13:20:59.334574 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:59.334160    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg" event={"ID":"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1","Type":"ContainerStarted","Data":"09a8b2d51a1449a2800754e873919ed1cb37a7c5ec01313be73132ca117e11ba"}
Jul 24 13:20:59.334574 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:59.334282    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:20:59.353110 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:20:59.353054    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg" podStartSLOduration=2.353041173 podStartE2EDuration="2.353041173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:20:59.350871551 +0000 UTC m=+1690.218106605" watchObservedRunningTime="2026-07-24 13:20:59.353041173 +0000 UTC m=+1690.220276203"
Jul 24 13:21:09.336724 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:09.336691    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:21:10.341071 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:10.341048    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:21:32.528652 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.528613    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"]
Jul 24 13:21:32.529178 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.528876    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg" podUID="12fdd39a-1a7b-4a12-aa77-3126f89cb3a1" containerName="payload-processing" containerID="cri-o://fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581" gracePeriod=30
Jul 24 13:21:32.536779 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.536754    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"]
Jul 24 13:21:32.537169 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.537145    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k" podUID="f7146c03-a24f-460b-890f-2d79ae3fba92" containerName="payload-pre-processing" containerID="cri-o://22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237" gracePeriod=30
Jul 24 13:21:32.803414 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.803386    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:21:32.826071 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.826034    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:21:32.891337 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.891317    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zffq\" (UniqueName: \"kubernetes.io/projected/f7146c03-a24f-460b-890f-2d79ae3fba92-kube-api-access-2zffq\") pod \"f7146c03-a24f-460b-890f-2d79ae3fba92\" (UID: \"f7146c03-a24f-460b-890f-2d79ae3fba92\") "
Jul 24 13:21:32.891488 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.891351    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7146c03-a24f-460b-890f-2d79ae3fba92-plugins-config-volume\") pod \"f7146c03-a24f-460b-890f-2d79ae3fba92\" (UID: \"f7146c03-a24f-460b-890f-2d79ae3fba92\") "
Jul 24 13:21:32.891488 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.891434    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65bzj\" (UniqueName: \"kubernetes.io/projected/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-kube-api-access-65bzj\") pod \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\" (UID: \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\") "
Jul 24 13:21:32.891488 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.891459    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-plugins-config-volume\") pod \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\" (UID: \"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1\") "
Jul 24 13:21:32.891818 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.891795    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7146c03-a24f-460b-890f-2d79ae3fba92-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f7146c03-a24f-460b-890f-2d79ae3fba92" (UID: "f7146c03-a24f-460b-890f-2d79ae3fba92"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:21:32.891909 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.891836    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12fdd39a-1a7b-4a12-aa77-3126f89cb3a1" (UID: "12fdd39a-1a7b-4a12-aa77-3126f89cb3a1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:21:32.893571 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.893552    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7146c03-a24f-460b-890f-2d79ae3fba92-kube-api-access-2zffq" (OuterVolumeSpecName: "kube-api-access-2zffq") pod "f7146c03-a24f-460b-890f-2d79ae3fba92" (UID: "f7146c03-a24f-460b-890f-2d79ae3fba92"). InnerVolumeSpecName "kube-api-access-2zffq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:21:32.893658 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.893629    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-kube-api-access-65bzj" (OuterVolumeSpecName: "kube-api-access-65bzj") pod "12fdd39a-1a7b-4a12-aa77-3126f89cb3a1" (UID: "12fdd39a-1a7b-4a12-aa77-3126f89cb3a1"). InnerVolumeSpecName "kube-api-access-65bzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:21:32.992374 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.992351    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65bzj\" (UniqueName: \"kubernetes.io/projected/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-kube-api-access-65bzj\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:21:32.992374 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.992372    2528 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1-plugins-config-volume\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:21:32.992514 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.992381    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zffq\" (UniqueName: \"kubernetes.io/projected/f7146c03-a24f-460b-890f-2d79ae3fba92-kube-api-access-2zffq\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:21:32.992514 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:32.992390    2528 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7146c03-a24f-460b-890f-2d79ae3fba92-plugins-config-volume\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:21:33.516118 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.516065    2528 generic.go:356] "Generic (PLEG): container finished" podID="f7146c03-a24f-460b-890f-2d79ae3fba92" containerID="22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237" exitCode=0
Jul 24 13:21:33.516280 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.516131    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"
Jul 24 13:21:33.516280 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.516127    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k" event={"ID":"f7146c03-a24f-460b-890f-2d79ae3fba92","Type":"ContainerDied","Data":"22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237"}
Jul 24 13:21:33.516280 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.516264    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k" event={"ID":"f7146c03-a24f-460b-890f-2d79ae3fba92","Type":"ContainerDied","Data":"368da60e17415d0d622e0df4fba33c2e46bd829d0a74c787c6431590a54a7a00"}
Jul 24 13:21:33.516433 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.516301    2528 scope.go:117] "RemoveContainer" containerID="22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237"
Jul 24 13:21:33.517574 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.517554    2528 generic.go:356] "Generic (PLEG): container finished" podID="12fdd39a-1a7b-4a12-aa77-3126f89cb3a1" containerID="fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581" exitCode=0
Jul 24 13:21:33.517688 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.517583    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg" event={"ID":"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1","Type":"ContainerDied","Data":"fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581"}
Jul 24 13:21:33.517688 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.517597    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"
Jul 24 13:21:33.517688 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.517614    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg" event={"ID":"12fdd39a-1a7b-4a12-aa77-3126f89cb3a1","Type":"ContainerDied","Data":"09a8b2d51a1449a2800754e873919ed1cb37a7c5ec01313be73132ca117e11ba"}
Jul 24 13:21:33.526071 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.526052    2528 scope.go:117] "RemoveContainer" containerID="22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237"
Jul 24 13:21:33.526389 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:21:33.526370    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237\": container with ID starting with 22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237 not found: ID does not exist" containerID="22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237"
Jul 24 13:21:33.526460 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.526397    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237"} err="failed to get container status \"22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237\": rpc error: code = NotFound desc = could not find container \"22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237\": container with ID starting with 22fb8f21961af0c0433fdbdf43c739d6d30eba6483afd524987d3a6763309237 not found: ID does not exist"
Jul 24 13:21:33.526460 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.526414    2528 scope.go:117] "RemoveContainer" containerID="fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581"
Jul 24 13:21:33.534590 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.534413    2528 scope.go:117] "RemoveContainer" containerID="fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581"
Jul 24 13:21:33.534806 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:21:33.534637    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581\": container with ID starting with fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581 not found: ID does not exist" containerID="fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581"
Jul 24 13:21:33.534806 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.534658    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581"} err="failed to get container status \"fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581\": rpc error: code = NotFound desc = could not find container \"fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581\": container with ID starting with fd83d75f4d10af70673ec7482f76b0ab9988bb3af746fdc906bf09c22c3cd581 not found: ID does not exist"
Jul 24 13:21:33.543423 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.543405    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"]
Jul 24 13:21:33.548498 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.548482    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-90d0d94f-79c946c589-bhpmg"]
Jul 24 13:21:33.561607 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.561566    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"]
Jul 24 13:21:33.563522 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.563502    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-90d0d94f-694d6b5488-8kt5k"]
Jul 24 13:21:33.634344 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.634318    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12fdd39a-1a7b-4a12-aa77-3126f89cb3a1" path="/var/lib/kubelet/pods/12fdd39a-1a7b-4a12-aa77-3126f89cb3a1/volumes"
Jul 24 13:21:33.634644 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:33.634632    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7146c03-a24f-460b-890f-2d79ae3fba92" path="/var/lib/kubelet/pods/f7146c03-a24f-460b-890f-2d79ae3fba92/volumes"
Jul 24 13:21:41.442955 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.442922    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"]
Jul 24 13:21:41.443382 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.443369    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7146c03-a24f-460b-890f-2d79ae3fba92" containerName="payload-pre-processing"
Jul 24 13:21:41.443422 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.443383    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7146c03-a24f-460b-890f-2d79ae3fba92" containerName="payload-pre-processing"
Jul 24 13:21:41.443422 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.443395    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fdd39a-1a7b-4a12-aa77-3126f89cb3a1" containerName="payload-processing"
Jul 24 13:21:41.443422 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.443400    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fdd39a-1a7b-4a12-aa77-3126f89cb3a1" containerName="payload-processing"
Jul 24 13:21:41.443512 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.443461    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7146c03-a24f-460b-890f-2d79ae3fba92" containerName="payload-pre-processing"
Jul 24 13:21:41.443512 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.443472    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fdd39a-1a7b-4a12-aa77-3126f89cb3a1" containerName="payload-processing"
Jul 24 13:21:41.448022 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.448005    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:41.451422 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.451403    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a54eb296-dockercfg-764jv\""
Jul 24 13:21:41.452500 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.452480    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a54eb296\""
Jul 24 13:21:41.458539 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.458520    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"]
Jul 24 13:21:41.570246 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.570217    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45892db2-d7d7-42ee-8a01-97b83e030535-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79\" (UID: \"45892db2-d7d7-42ee-8a01-97b83e030535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:41.570408 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.570325    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69lmj\" (UniqueName: \"kubernetes.io/projected/45892db2-d7d7-42ee-8a01-97b83e030535-kube-api-access-69lmj\") pod \"payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79\" (UID: \"45892db2-d7d7-42ee-8a01-97b83e030535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:41.670803 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.670769    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69lmj\" (UniqueName: \"kubernetes.io/projected/45892db2-d7d7-42ee-8a01-97b83e030535-kube-api-access-69lmj\") pod \"payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79\" (UID: \"45892db2-d7d7-42ee-8a01-97b83e030535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:41.670992 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.670833    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45892db2-d7d7-42ee-8a01-97b83e030535-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79\" (UID: \"45892db2-d7d7-42ee-8a01-97b83e030535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:41.671495 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.671476    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45892db2-d7d7-42ee-8a01-97b83e030535-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79\" (UID: \"45892db2-d7d7-42ee-8a01-97b83e030535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:41.683601 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.683583    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69lmj\" (UniqueName: \"kubernetes.io/projected/45892db2-d7d7-42ee-8a01-97b83e030535-kube-api-access-69lmj\") pod \"payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79\" (UID: \"45892db2-d7d7-42ee-8a01-97b83e030535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:41.759566 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.759502    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:41.903458 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:41.903432    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"]
Jul 24 13:21:41.905475 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:21:41.905443    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45892db2_d7d7_42ee_8a01_97b83e030535.slice/crio-45a1022aae40b85c735b072e90a1e5fcc6291bc1ac5fbe6674208bc5669cf059 WatchSource:0}: Error finding container 45a1022aae40b85c735b072e90a1e5fcc6291bc1ac5fbe6674208bc5669cf059: Status 404 returned error can't find the container with id 45a1022aae40b85c735b072e90a1e5fcc6291bc1ac5fbe6674208bc5669cf059
Jul 24 13:21:42.571147 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:42.571110    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79" event={"ID":"45892db2-d7d7-42ee-8a01-97b83e030535","Type":"ContainerStarted","Data":"586dbbcf310dec7096460bd8be05e7b6260602ef172145855fe747255fc4394b"}
Jul 24 13:21:42.571511 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:42.571170    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79" event={"ID":"45892db2-d7d7-42ee-8a01-97b83e030535","Type":"ContainerStarted","Data":"45a1022aae40b85c735b072e90a1e5fcc6291bc1ac5fbe6674208bc5669cf059"}
Jul 24 13:21:42.571511 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:42.571219    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:21:42.590976 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:42.590933    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79" podStartSLOduration=1.590917665 podStartE2EDuration="1.590917665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:21:42.590896902 +0000 UTC m=+1733.458131931" watchObservedRunningTime="2026-07-24 13:21:42.590917665 +0000 UTC m=+1733.458152694"
Jul 24 13:21:53.578876 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:21:53.578833    2528 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79" podUID="45892db2-d7d7-42ee-8a01-97b83e030535" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.53:9004: connect: connection refused"
Jul 24 13:22:03.578076 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:03.578048    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:22:05.864011 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:05.863981    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"]
Jul 24 13:22:05.867435 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:05.867418    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"
Jul 24 13:22:05.871076 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:05.871051    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:22:05.878847 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:05.878814    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"]
Jul 24 13:22:05.986798 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:05.986769    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7042f569-6c63-452e-9bb6-e29233ce91c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs\" (UID: \"7042f569-6c63-452e-9bb6-e29233ce91c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"
Jul 24 13:22:06.087488 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:06.087460    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7042f569-6c63-452e-9bb6-e29233ce91c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs\" (UID: \"7042f569-6c63-452e-9bb6-e29233ce91c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"
Jul 24 13:22:06.088035 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:06.088015    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7042f569-6c63-452e-9bb6-e29233ce91c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs\" (UID: \"7042f569-6c63-452e-9bb6-e29233ce91c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"
Jul 24 13:22:06.180452 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:06.180424    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"
Jul 24 13:22:06.340020 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:06.339996    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"]
Jul 24 13:22:06.342904 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:22:06.342876    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7042f569_6c63_452e_9bb6_e29233ce91c7.slice/crio-9516c915d62240d70e7b6cfbd923ea504699f97cc1978b3e387efad0dfccd0a7 WatchSource:0}: Error finding container 9516c915d62240d70e7b6cfbd923ea504699f97cc1978b3e387efad0dfccd0a7: Status 404 returned error can't find the container with id 9516c915d62240d70e7b6cfbd923ea504699f97cc1978b3e387efad0dfccd0a7
Jul 24 13:22:06.701808 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:06.701779    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs" event={"ID":"7042f569-6c63-452e-9bb6-e29233ce91c7","Type":"ContainerStarted","Data":"eebc356f49bcad184a2c0fc58963dee7b3fe8184363f68a09257e0356f263490"}
Jul 24 13:22:06.701897 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:06.701834    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs" event={"ID":"7042f569-6c63-452e-9bb6-e29233ce91c7","Type":"ContainerStarted","Data":"9516c915d62240d70e7b6cfbd923ea504699f97cc1978b3e387efad0dfccd0a7"}
Jul 24 13:22:06.723447 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:06.723406    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs" podStartSLOduration=1.7233933399999999 podStartE2EDuration="1.72339334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:22:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:22:06.721213811 +0000 UTC m=+1757.588448856" watchObservedRunningTime="2026-07-24 13:22:06.72339334 +0000 UTC m=+1757.590628370"
Jul 24 13:22:07.708860 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:07.708826    2528 generic.go:356] "Generic (PLEG): container finished" podID="7042f569-6c63-452e-9bb6-e29233ce91c7" containerID="eebc356f49bcad184a2c0fc58963dee7b3fe8184363f68a09257e0356f263490" exitCode=0
Jul 24 13:22:07.709243 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:07.708872    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs" event={"ID":"7042f569-6c63-452e-9bb6-e29233ce91c7","Type":"ContainerDied","Data":"eebc356f49bcad184a2c0fc58963dee7b3fe8184363f68a09257e0356f263490"}
Jul 24 13:22:08.855417 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:08.855397    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"
Jul 24 13:22:08.914784 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:08.914757    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7042f569-6c63-452e-9bb6-e29233ce91c7-maas-api-service-ca\") pod \"7042f569-6c63-452e-9bb6-e29233ce91c7\" (UID: \"7042f569-6c63-452e-9bb6-e29233ce91c7\") "
Jul 24 13:22:08.915147 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:08.915127    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7042f569-6c63-452e-9bb6-e29233ce91c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7042f569-6c63-452e-9bb6-e29233ce91c7" (UID: "7042f569-6c63-452e-9bb6-e29233ce91c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:22:09.015813 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:09.015755    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7042f569-6c63-452e-9bb6-e29233ce91c7-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:22:09.720903 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:09.720870    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"
Jul 24 13:22:09.721079 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:09.720906    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs" event={"ID":"7042f569-6c63-452e-9bb6-e29233ce91c7","Type":"ContainerDied","Data":"9516c915d62240d70e7b6cfbd923ea504699f97cc1978b3e387efad0dfccd0a7"}
Jul 24 13:22:09.721079 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:09.720952    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9516c915d62240d70e7b6cfbd923ea504699f97cc1978b3e387efad0dfccd0a7"
Jul 24 13:22:16.573534 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.573495    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"]
Jul 24 13:22:16.574010 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.573738    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79" podUID="45892db2-d7d7-42ee-8a01-97b83e030535" containerName="payload-pre-processing" containerID="cri-o://586dbbcf310dec7096460bd8be05e7b6260602ef172145855fe747255fc4394b" gracePeriod=30
Jul 24 13:22:16.766248 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.762958    2528 generic.go:356] "Generic (PLEG): container finished" podID="45892db2-d7d7-42ee-8a01-97b83e030535" containerID="586dbbcf310dec7096460bd8be05e7b6260602ef172145855fe747255fc4394b" exitCode=0
Jul 24 13:22:16.766248 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.763198    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79" event={"ID":"45892db2-d7d7-42ee-8a01-97b83e030535","Type":"ContainerDied","Data":"586dbbcf310dec7096460bd8be05e7b6260602ef172145855fe747255fc4394b"}
Jul 24 13:22:16.831605 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.831552    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:22:16.889351 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.889324    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69lmj\" (UniqueName: \"kubernetes.io/projected/45892db2-d7d7-42ee-8a01-97b83e030535-kube-api-access-69lmj\") pod \"45892db2-d7d7-42ee-8a01-97b83e030535\" (UID: \"45892db2-d7d7-42ee-8a01-97b83e030535\") "
Jul 24 13:22:16.889499 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.889435    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45892db2-d7d7-42ee-8a01-97b83e030535-plugins-config-volume\") pod \"45892db2-d7d7-42ee-8a01-97b83e030535\" (UID: \"45892db2-d7d7-42ee-8a01-97b83e030535\") "
Jul 24 13:22:16.889773 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.889753    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45892db2-d7d7-42ee-8a01-97b83e030535-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45892db2-d7d7-42ee-8a01-97b83e030535" (UID: "45892db2-d7d7-42ee-8a01-97b83e030535"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:22:16.891540 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.891516    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45892db2-d7d7-42ee-8a01-97b83e030535-kube-api-access-69lmj" (OuterVolumeSpecName: "kube-api-access-69lmj") pod "45892db2-d7d7-42ee-8a01-97b83e030535" (UID: "45892db2-d7d7-42ee-8a01-97b83e030535"). InnerVolumeSpecName "kube-api-access-69lmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:22:16.990040 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.990000    2528 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45892db2-d7d7-42ee-8a01-97b83e030535-plugins-config-volume\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:22:16.990040 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:16.990031    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69lmj\" (UniqueName: \"kubernetes.io/projected/45892db2-d7d7-42ee-8a01-97b83e030535-kube-api-access-69lmj\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:22:17.769231 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:17.769205    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"
Jul 24 13:22:17.769231 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:17.769213    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79" event={"ID":"45892db2-d7d7-42ee-8a01-97b83e030535","Type":"ContainerDied","Data":"45a1022aae40b85c735b072e90a1e5fcc6291bc1ac5fbe6674208bc5669cf059"}
Jul 24 13:22:17.769688 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:17.769275    2528 scope.go:117] "RemoveContainer" containerID="586dbbcf310dec7096460bd8be05e7b6260602ef172145855fe747255fc4394b"
Jul 24 13:22:17.791054 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:17.791027    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"]
Jul 24 13:22:17.799544 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:17.799521    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a54eb296-7f9b4d476d-l7f79"]
Jul 24 13:22:19.634032 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:19.633999    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45892db2-d7d7-42ee-8a01-97b83e030535" path="/var/lib/kubelet/pods/45892db2-d7d7-42ee-8a01-97b83e030535/volumes"
Jul 24 13:22:20.962981 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:20.962952    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"]
Jul 24 13:22:20.966870 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:20.966846    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a54eb296-bbrxs"]
Jul 24 13:22:21.633034 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:21.633007    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7042f569-6c63-452e-9bb6-e29233ce91c7" path="/var/lib/kubelet/pods/7042f569-6c63-452e-9bb6-e29233ce91c7/volumes"
Jul 24 13:22:49.765714 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:49.765687    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:22:49.773279 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:22:49.773259    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:26:25.602397 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.602360    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"]
Jul 24 13:26:25.602826 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.602813    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7042f569-6c63-452e-9bb6-e29233ce91c7" containerName="revoke-keys"
Jul 24 13:26:25.602826 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.602824    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7042f569-6c63-452e-9bb6-e29233ce91c7" containerName="revoke-keys"
Jul 24 13:26:25.602909 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.602835    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45892db2-d7d7-42ee-8a01-97b83e030535" containerName="payload-pre-processing"
Jul 24 13:26:25.602909 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.602841    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="45892db2-d7d7-42ee-8a01-97b83e030535" containerName="payload-pre-processing"
Jul 24 13:26:25.602976 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.602946    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="7042f569-6c63-452e-9bb6-e29233ce91c7" containerName="revoke-keys"
Jul 24 13:26:25.602976 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.602961    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="45892db2-d7d7-42ee-8a01-97b83e030535" containerName="payload-pre-processing"
Jul 24 13:26:25.605999 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.605983    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"
Jul 24 13:26:25.608537 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.608519    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:26:25.613675 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.613654    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"]
Jul 24 13:26:25.662661 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.662634    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5386912-5b96-456e-9ffb-9e411aaf941a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj\" (UID: \"a5386912-5b96-456e-9ffb-9e411aaf941a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"
Jul 24 13:26:25.764168 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.764130    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5386912-5b96-456e-9ffb-9e411aaf941a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj\" (UID: \"a5386912-5b96-456e-9ffb-9e411aaf941a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"
Jul 24 13:26:25.764767 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.764739    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5386912-5b96-456e-9ffb-9e411aaf941a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj\" (UID: \"a5386912-5b96-456e-9ffb-9e411aaf941a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"
Jul 24 13:26:25.918873 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:25.918836    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"
Jul 24 13:26:26.057400 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:26.057374    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"]
Jul 24 13:26:26.060293 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:26:26.060268    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5386912_5b96_456e_9ffb_9e411aaf941a.slice/crio-dc49f332211d4cdc9520e028cd6b34d08691f562f79f0f24a8356a5850e3d847 WatchSource:0}: Error finding container dc49f332211d4cdc9520e028cd6b34d08691f562f79f0f24a8356a5850e3d847: Status 404 returned error can't find the container with id dc49f332211d4cdc9520e028cd6b34d08691f562f79f0f24a8356a5850e3d847
Jul 24 13:26:26.070443 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:26.070410    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj" event={"ID":"a5386912-5b96-456e-9ffb-9e411aaf941a","Type":"ContainerStarted","Data":"dc49f332211d4cdc9520e028cd6b34d08691f562f79f0f24a8356a5850e3d847"}
Jul 24 13:26:27.077571 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:27.077489    2528 generic.go:356] "Generic (PLEG): container finished" podID="a5386912-5b96-456e-9ffb-9e411aaf941a" containerID="fc6fa514c4ac61a94f97b5e1b6dc5dc4ddc0e92352ea8f2478b6a12221a63cb2" exitCode=0
Jul 24 13:26:27.077571 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:27.077524    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj" event={"ID":"a5386912-5b96-456e-9ffb-9e411aaf941a","Type":"ContainerDied","Data":"fc6fa514c4ac61a94f97b5e1b6dc5dc4ddc0e92352ea8f2478b6a12221a63cb2"}
Jul 24 13:26:28.218264 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:28.218234    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"
Jul 24 13:26:28.288327 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:28.288299    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5386912-5b96-456e-9ffb-9e411aaf941a-maas-api-service-ca\") pod \"a5386912-5b96-456e-9ffb-9e411aaf941a\" (UID: \"a5386912-5b96-456e-9ffb-9e411aaf941a\") "
Jul 24 13:26:28.288598 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:28.288577    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5386912-5b96-456e-9ffb-9e411aaf941a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5386912-5b96-456e-9ffb-9e411aaf941a" (UID: "a5386912-5b96-456e-9ffb-9e411aaf941a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:26:28.389498 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:28.389424    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5386912-5b96-456e-9ffb-9e411aaf941a-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:26:29.090552 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:29.090526    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"
Jul 24 13:26:29.090724 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:29.090581    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj" event={"ID":"a5386912-5b96-456e-9ffb-9e411aaf941a","Type":"ContainerDied","Data":"dc49f332211d4cdc9520e028cd6b34d08691f562f79f0f24a8356a5850e3d847"}
Jul 24 13:26:29.090724 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:29.090624    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc49f332211d4cdc9520e028cd6b34d08691f562f79f0f24a8356a5850e3d847"
Jul 24 13:26:45.706929 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:45.706891    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"]
Jul 24 13:26:45.710425 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:45.710400    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-416b8ad5-wshtj"]
Jul 24 13:26:47.633373 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:47.633338    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5386912-5b96-456e-9ffb-9e411aaf941a" path="/var/lib/kubelet/pods/a5386912-5b96-456e-9ffb-9e411aaf941a/volumes"
Jul 24 13:26:49.755372 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:26:49.755342    2528 scope.go:117] "RemoveContainer" containerID="0dad78d66daf893731a5b9335487a03e004fc80764abd6adee2763b5c81db8bf"
Jul 24 13:27:49.800898 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:27:49.800866    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:27:49.809477 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:27:49.809460    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:28:49.783812 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:28:49.783782    2528 scope.go:117] "RemoveContainer" containerID="eebc356f49bcad184a2c0fc58963dee7b3fe8184363f68a09257e0356f263490"
Jul 24 13:30:00.144459 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.144429    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65"]
Jul 24 13:30:00.144922 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.144871    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5386912-5b96-456e-9ffb-9e411aaf941a" containerName="revoke-keys"
Jul 24 13:30:00.144922 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.144882    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5386912-5b96-456e-9ffb-9e411aaf941a" containerName="revoke-keys"
Jul 24 13:30:00.144998 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.144946    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5386912-5b96-456e-9ffb-9e411aaf941a" containerName="revoke-keys"
Jul 24 13:30:00.147949 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.147933    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"]
Jul 24 13:30:00.148070 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.148051    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65"
Jul 24 13:30:00.150554 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.150538    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:30:00.151168 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.151153    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"]
Jul 24 13:30:00.151289 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.151271    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"
Jul 24 13:30:00.154933 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.154466    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"
Jul 24 13:30:00.158022 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.158003    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"]
Jul 24 13:30:00.160773 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.160743    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65"]
Jul 24 13:30:00.162553 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.162521    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65"
Jul 24 13:30:00.163084 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.163068    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"]
Jul 24 13:30:00.173201 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.173185    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"
Jul 24 13:30:00.206999 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.206968    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"
Jul 24 13:30:00.398717 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.398693    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"]
Jul 24 13:30:00.400590 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:30:00.400560    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac53163c_7643_4255_8a1d_564c8764d870.slice/crio-a5db2eaed338caa5c7147e8bbf07aaf32e7c112559e820b4f07151d68dd26fa7 WatchSource:0}: Error finding container a5db2eaed338caa5c7147e8bbf07aaf32e7c112559e820b4f07151d68dd26fa7: Status 404 returned error can't find the container with id a5db2eaed338caa5c7147e8bbf07aaf32e7c112559e820b4f07151d68dd26fa7
Jul 24 13:30:00.551984 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.551958    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"]
Jul 24 13:30:00.552609 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:30:00.552580    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c960407_e5fb_40c4_9401_5bdfc738fcd1.slice/crio-71636abd35809cb58c956adf728a133ba1b6c21da7ff38aa3ba17abf98a11343 WatchSource:0}: Error finding container 71636abd35809cb58c956adf728a133ba1b6c21da7ff38aa3ba17abf98a11343: Status 404 returned error can't find the container with id 71636abd35809cb58c956adf728a133ba1b6c21da7ff38aa3ba17abf98a11343
Jul 24 13:30:00.577546 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:00.577496    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65"]
Jul 24 13:30:00.587279 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:30:00.587259    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4882d932_1635_4a2a_abd1_e08f04f86c85.slice/crio-671b0b68328ab9064a9a3bdd4fc0a03609e9ea338d32e2a60a522bf25e8b2c0b WatchSource:0}: Error finding container 671b0b68328ab9064a9a3bdd4fc0a03609e9ea338d32e2a60a522bf25e8b2c0b: Status 404 returned error can't find the container with id 671b0b68328ab9064a9a3bdd4fc0a03609e9ea338d32e2a60a522bf25e8b2c0b
Jul 24 13:30:01.199656 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.199622    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf" event={"ID":"ac53163c-7643-4255-8a1d-564c8764d870","Type":"ContainerStarted","Data":"04b253e36f59951d5112025ebc9c0f2f23cce2019331debbd890d3ab1dd57063"}
Jul 24 13:30:01.200110 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.199675    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf" event={"ID":"ac53163c-7643-4255-8a1d-564c8764d870","Type":"ContainerStarted","Data":"a5db2eaed338caa5c7147e8bbf07aaf32e7c112559e820b4f07151d68dd26fa7"}
Jul 24 13:30:01.201246 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.201218    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f" event={"ID":"9c960407-e5fb-40c4-9401-5bdfc738fcd1","Type":"ContainerStarted","Data":"0dde1d187d74d825aba1e941ec9897d2458c654f2937f91ff9a4ea67defc75a5"}
Jul 24 13:30:01.201410 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.201269    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f" event={"ID":"9c960407-e5fb-40c4-9401-5bdfc738fcd1","Type":"ContainerStarted","Data":"71636abd35809cb58c956adf728a133ba1b6c21da7ff38aa3ba17abf98a11343"}
Jul 24 13:30:01.202562 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.202541    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65" event={"ID":"4882d932-1635-4a2a-abd1-e08f04f86c85","Type":"ContainerStarted","Data":"cff07ae5c156d3b537f9864561c89789b1b2e34a2290e57295cfc715c75b07c1"}
Jul 24 13:30:01.202647 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.202581    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65" event={"ID":"4882d932-1635-4a2a-abd1-e08f04f86c85","Type":"ContainerStarted","Data":"671b0b68328ab9064a9a3bdd4fc0a03609e9ea338d32e2a60a522bf25e8b2c0b"}
Jul 24 13:30:01.217283 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.217245    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf" podStartSLOduration=1.217230402 podStartE2EDuration="1.217230402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:30:01.215741643 +0000 UTC m=+2232.082976674" watchObservedRunningTime="2026-07-24 13:30:01.217230402 +0000 UTC m=+2232.084465432"
Jul 24 13:30:01.239538 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.239483    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65" podStartSLOduration=1.23946341 podStartE2EDuration="1.23946341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:30:01.236911741 +0000 UTC m=+2232.104146771" watchObservedRunningTime="2026-07-24 13:30:01.23946341 +0000 UTC m=+2232.106698442"
Jul 24 13:30:01.255700 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:01.255660    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f" podStartSLOduration=1.2556464489999999 podStartE2EDuration="1.255646449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:30:01.253931284 +0000 UTC m=+2232.121166316" watchObservedRunningTime="2026-07-24 13:30:01.255646449 +0000 UTC m=+2232.122881479"
Jul 24 13:30:02.209334 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:02.209302    2528 generic.go:356] "Generic (PLEG): container finished" podID="ac53163c-7643-4255-8a1d-564c8764d870" containerID="04b253e36f59951d5112025ebc9c0f2f23cce2019331debbd890d3ab1dd57063" exitCode=0
Jul 24 13:30:02.209738 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:02.209392    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf" event={"ID":"ac53163c-7643-4255-8a1d-564c8764d870","Type":"ContainerDied","Data":"04b253e36f59951d5112025ebc9c0f2f23cce2019331debbd890d3ab1dd57063"}
Jul 24 13:30:02.210949 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:02.210923    2528 generic.go:356] "Generic (PLEG): container finished" podID="9c960407-e5fb-40c4-9401-5bdfc738fcd1" containerID="0dde1d187d74d825aba1e941ec9897d2458c654f2937f91ff9a4ea67defc75a5" exitCode=0
Jul 24 13:30:02.211068 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:02.211001    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f" event={"ID":"9c960407-e5fb-40c4-9401-5bdfc738fcd1","Type":"ContainerDied","Data":"0dde1d187d74d825aba1e941ec9897d2458c654f2937f91ff9a4ea67defc75a5"}
Jul 24 13:30:02.212505 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:02.212483    2528 generic.go:356] "Generic (PLEG): container finished" podID="4882d932-1635-4a2a-abd1-e08f04f86c85" containerID="cff07ae5c156d3b537f9864561c89789b1b2e34a2290e57295cfc715c75b07c1" exitCode=0
Jul 24 13:30:02.212602 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:02.212543    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65" event={"ID":"4882d932-1635-4a2a-abd1-e08f04f86c85","Type":"ContainerDied","Data":"cff07ae5c156d3b537f9864561c89789b1b2e34a2290e57295cfc715c75b07c1"}
Jul 24 13:30:03.362458 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:03.362434    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65"
Jul 24 13:30:03.407310 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:03.407288    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"
Jul 24 13:30:03.431282 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:03.431255    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"
Jul 24 13:30:04.226256 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.226224    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf" event={"ID":"ac53163c-7643-4255-8a1d-564c8764d870","Type":"ContainerDied","Data":"a5db2eaed338caa5c7147e8bbf07aaf32e7c112559e820b4f07151d68dd26fa7"}
Jul 24 13:30:04.226452 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.226276    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5db2eaed338caa5c7147e8bbf07aaf32e7c112559e820b4f07151d68dd26fa7"
Jul 24 13:30:04.226452 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.226234    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"
Jul 24 13:30:04.227694 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.227668    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"
Jul 24 13:30:04.227694 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.227686    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f" event={"ID":"9c960407-e5fb-40c4-9401-5bdfc738fcd1","Type":"ContainerDied","Data":"71636abd35809cb58c956adf728a133ba1b6c21da7ff38aa3ba17abf98a11343"}
Jul 24 13:30:04.227885 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.227720    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71636abd35809cb58c956adf728a133ba1b6c21da7ff38aa3ba17abf98a11343"
Jul 24 13:30:04.229207 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.229186    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65" event={"ID":"4882d932-1635-4a2a-abd1-e08f04f86c85","Type":"ContainerDied","Data":"671b0b68328ab9064a9a3bdd4fc0a03609e9ea338d32e2a60a522bf25e8b2c0b"}
Jul 24 13:30:04.229306 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.229225    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="671b0b68328ab9064a9a3bdd4fc0a03609e9ea338d32e2a60a522bf25e8b2c0b"
Jul 24 13:30:04.229306 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:04.229191    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748330-8rm65"
Jul 24 13:30:15.529639 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.529556    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"]
Jul 24 13:30:15.530028 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530009    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4882d932-1635-4a2a-abd1-e08f04f86c85" containerName="cleanup"
Jul 24 13:30:15.530028 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530023    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="4882d932-1635-4a2a-abd1-e08f04f86c85" containerName="cleanup"
Jul 24 13:30:15.530120 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530032    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac53163c-7643-4255-8a1d-564c8764d870" containerName="cleanup"
Jul 24 13:30:15.530120 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530038    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac53163c-7643-4255-8a1d-564c8764d870" containerName="cleanup"
Jul 24 13:30:15.530120 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530054    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c960407-e5fb-40c4-9401-5bdfc738fcd1" containerName="cleanup"
Jul 24 13:30:15.530120 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530059    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c960407-e5fb-40c4-9401-5bdfc738fcd1" containerName="cleanup"
Jul 24 13:30:15.530236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530157    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="4882d932-1635-4a2a-abd1-e08f04f86c85" containerName="cleanup"
Jul 24 13:30:15.530236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530167    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c960407-e5fb-40c4-9401-5bdfc738fcd1" containerName="cleanup"
Jul 24 13:30:15.530236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.530175    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac53163c-7643-4255-8a1d-564c8764d870" containerName="cleanup"
Jul 24 13:30:15.533372 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.533356    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"
Jul 24 13:30:15.536307 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.536281    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:30:15.546038 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.546005    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"]
Jul 24 13:30:15.670843 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.670813    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f813cb-376f-484d-bf1d-1f694de764e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262\" (UID: \"97f813cb-376f-484d-bf1d-1f694de764e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"
Jul 24 13:30:15.771658 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.771634    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f813cb-376f-484d-bf1d-1f694de764e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262\" (UID: \"97f813cb-376f-484d-bf1d-1f694de764e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"
Jul 24 13:30:15.772295 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.772276    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f813cb-376f-484d-bf1d-1f694de764e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262\" (UID: \"97f813cb-376f-484d-bf1d-1f694de764e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"
Jul 24 13:30:15.844367 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.844313    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"
Jul 24 13:30:15.983378 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:15.983354    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"]
Jul 24 13:30:15.985653 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:30:15.985623    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f813cb_376f_484d_bf1d_1f694de764e3.slice/crio-ebb1c9f417fb8e1cf07ebc58102edd5c0d27e273bafbc21d905c71775bb89915 WatchSource:0}: Error finding container ebb1c9f417fb8e1cf07ebc58102edd5c0d27e273bafbc21d905c71775bb89915: Status 404 returned error can't find the container with id ebb1c9f417fb8e1cf07ebc58102edd5c0d27e273bafbc21d905c71775bb89915
Jul 24 13:30:16.295430 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:16.295401    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262" event={"ID":"97f813cb-376f-484d-bf1d-1f694de764e3","Type":"ContainerStarted","Data":"9fef8a1afd081a42dc42cc39c9719468dbe57890cf61008278f11b66747fb77f"}
Jul 24 13:30:16.295586 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:16.295450    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262" event={"ID":"97f813cb-376f-484d-bf1d-1f694de764e3","Type":"ContainerStarted","Data":"ebb1c9f417fb8e1cf07ebc58102edd5c0d27e273bafbc21d905c71775bb89915"}
Jul 24 13:30:16.322927 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:16.322880    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262" podStartSLOduration=1.322864158 podStartE2EDuration="1.322864158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:30:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:30:16.321351856 +0000 UTC m=+2247.188586890" watchObservedRunningTime="2026-07-24 13:30:16.322864158 +0000 UTC m=+2247.190099222"
Jul 24 13:30:17.302623 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:17.302586    2528 generic.go:356] "Generic (PLEG): container finished" podID="97f813cb-376f-484d-bf1d-1f694de764e3" containerID="9fef8a1afd081a42dc42cc39c9719468dbe57890cf61008278f11b66747fb77f" exitCode=0
Jul 24 13:30:17.303032 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:17.302666    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262" event={"ID":"97f813cb-376f-484d-bf1d-1f694de764e3","Type":"ContainerDied","Data":"9fef8a1afd081a42dc42cc39c9719468dbe57890cf61008278f11b66747fb77f"}
Jul 24 13:30:18.444381 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:18.444354    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"
Jul 24 13:30:18.595292 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:18.595214    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f813cb-376f-484d-bf1d-1f694de764e3-maas-api-service-ca\") pod \"97f813cb-376f-484d-bf1d-1f694de764e3\" (UID: \"97f813cb-376f-484d-bf1d-1f694de764e3\") "
Jul 24 13:30:18.595539 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:18.595517    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97f813cb-376f-484d-bf1d-1f694de764e3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97f813cb-376f-484d-bf1d-1f694de764e3" (UID: "97f813cb-376f-484d-bf1d-1f694de764e3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:30:18.595621 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:18.595609    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f813cb-376f-484d-bf1d-1f694de764e3-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:30:19.315240 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:19.315211    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"
Jul 24 13:30:19.315443 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:19.315236    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262" event={"ID":"97f813cb-376f-484d-bf1d-1f694de764e3","Type":"ContainerDied","Data":"ebb1c9f417fb8e1cf07ebc58102edd5c0d27e273bafbc21d905c71775bb89915"}
Jul 24 13:30:19.315443 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:19.315291    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebb1c9f417fb8e1cf07ebc58102edd5c0d27e273bafbc21d905c71775bb89915"
Jul 24 13:30:26.255243 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:26.255204    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"]
Jul 24 13:30:26.258069 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:26.258043    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c72f4f-29748330-7m44f"]
Jul 24 13:30:27.633384 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:27.633352    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c960407-e5fb-40c4-9401-5bdfc738fcd1" path="/var/lib/kubelet/pods/9c960407-e5fb-40c4-9401-5bdfc738fcd1/volumes"
Jul 24 13:30:30.632973 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:30.632945    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"]
Jul 24 13:30:30.636401 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:30.636333    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c72f4f-lp262"]
Jul 24 13:30:31.633176 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:31.633080    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97f813cb-376f-484d-bf1d-1f694de764e3" path="/var/lib/kubelet/pods/97f813cb-376f-484d-bf1d-1f694de764e3/volumes"
Jul 24 13:30:38.670396 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.670345    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"]
Jul 24 13:30:38.671009 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.670988    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f813cb-376f-484d-bf1d-1f694de764e3" containerName="revoke-keys"
Jul 24 13:30:38.671113 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.671011    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f813cb-376f-484d-bf1d-1f694de764e3" containerName="revoke-keys"
Jul 24 13:30:38.671176 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.671135    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="97f813cb-376f-484d-bf1d-1f694de764e3" containerName="revoke-keys"
Jul 24 13:30:38.676006 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.675981    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"
Jul 24 13:30:38.678758 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.678734    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:30:38.694309 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.694285    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"]
Jul 24 13:30:38.775859 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.775831    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7df2a-0194-49f4-b1cc-0279a75bbbed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4\" (UID: \"1dd7df2a-0194-49f4-b1cc-0279a75bbbed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"
Jul 24 13:30:38.877233 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.877206    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7df2a-0194-49f4-b1cc-0279a75bbbed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4\" (UID: \"1dd7df2a-0194-49f4-b1cc-0279a75bbbed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"
Jul 24 13:30:38.877788 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.877769    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7df2a-0194-49f4-b1cc-0279a75bbbed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4\" (UID: \"1dd7df2a-0194-49f4-b1cc-0279a75bbbed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"
Jul 24 13:30:38.988132 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:38.988055    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"
Jul 24 13:30:39.126740 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:39.126718    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"]
Jul 24 13:30:39.129684 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:30:39.129660    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd7df2a_0194_49f4_b1cc_0279a75bbbed.slice/crio-30c5cdb5a4b8bfffcaff86b75622a967f622bbe26d7ae787d7653d35b8f1b834 WatchSource:0}: Error finding container 30c5cdb5a4b8bfffcaff86b75622a967f622bbe26d7ae787d7653d35b8f1b834: Status 404 returned error can't find the container with id 30c5cdb5a4b8bfffcaff86b75622a967f622bbe26d7ae787d7653d35b8f1b834
Jul 24 13:30:39.429047 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:39.429017    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4" event={"ID":"1dd7df2a-0194-49f4-b1cc-0279a75bbbed","Type":"ContainerStarted","Data":"30c5cdb5a4b8bfffcaff86b75622a967f622bbe26d7ae787d7653d35b8f1b834"}
Jul 24 13:30:40.435807 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:40.435769    2528 generic.go:356] "Generic (PLEG): container finished" podID="1dd7df2a-0194-49f4-b1cc-0279a75bbbed" containerID="bb04ddf4b5928d7c1ec19a52a88fd2f3cfd8e3448ae05bb011dbc7d302f2a4b2" exitCode=0
Jul 24 13:30:40.436251 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:40.435862    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4" event={"ID":"1dd7df2a-0194-49f4-b1cc-0279a75bbbed","Type":"ContainerDied","Data":"bb04ddf4b5928d7c1ec19a52a88fd2f3cfd8e3448ae05bb011dbc7d302f2a4b2"}
Jul 24 13:30:41.580948 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:41.580921    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"
Jul 24 13:30:41.702468 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:41.702411    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7df2a-0194-49f4-b1cc-0279a75bbbed-maas-api-service-ca\") pod \"1dd7df2a-0194-49f4-b1cc-0279a75bbbed\" (UID: \"1dd7df2a-0194-49f4-b1cc-0279a75bbbed\") "
Jul 24 13:30:41.702738 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:41.702717    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd7df2a-0194-49f4-b1cc-0279a75bbbed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1dd7df2a-0194-49f4-b1cc-0279a75bbbed" (UID: "1dd7df2a-0194-49f4-b1cc-0279a75bbbed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:30:41.803429 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:41.803401    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7df2a-0194-49f4-b1cc-0279a75bbbed-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:30:42.447942 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:42.447910    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4" event={"ID":"1dd7df2a-0194-49f4-b1cc-0279a75bbbed","Type":"ContainerDied","Data":"30c5cdb5a4b8bfffcaff86b75622a967f622bbe26d7ae787d7653d35b8f1b834"}
Jul 24 13:30:42.447942 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:42.447929    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"
Jul 24 13:30:42.448192 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:42.447956    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30c5cdb5a4b8bfffcaff86b75622a967f622bbe26d7ae787d7653d35b8f1b834"
Jul 24 13:30:49.217949 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:49.217914    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"]
Jul 24 13:30:49.223303 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:49.223279    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b318c6-29748330-kfnqf"]
Jul 24 13:30:49.633105 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:49.633017    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac53163c-7643-4255-8a1d-564c8764d870" path="/var/lib/kubelet/pods/ac53163c-7643-4255-8a1d-564c8764d870/volumes"
Jul 24 13:30:53.791897 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:53.791866    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"]
Jul 24 13:30:53.794105 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:53.794062    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b318c6-2smw4"]
Jul 24 13:30:55.633000 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:30:55.632959    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd7df2a-0194-49f4-b1cc-0279a75bbbed" path="/var/lib/kubelet/pods/1dd7df2a-0194-49f4-b1cc-0279a75bbbed/volumes"
Jul 24 13:31:25.598627 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.598595    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"]
Jul 24 13:31:25.601004 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.599105    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd7df2a-0194-49f4-b1cc-0279a75bbbed" containerName="revoke-keys"
Jul 24 13:31:25.601004 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.599121    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd7df2a-0194-49f4-b1cc-0279a75bbbed" containerName="revoke-keys"
Jul 24 13:31:25.601004 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.599184    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd7df2a-0194-49f4-b1cc-0279a75bbbed" containerName="revoke-keys"
Jul 24 13:31:25.602201 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.602186    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"
Jul 24 13:31:25.604620 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.604600    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:31:25.610391 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.610366    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"]
Jul 24 13:31:25.711185 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.711151    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9040f7-3dbf-4588-88af-09013e11d294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e530f2-schz6\" (UID: \"ba9040f7-3dbf-4588-88af-09013e11d294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"
Jul 24 13:31:25.812353 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.812325    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9040f7-3dbf-4588-88af-09013e11d294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e530f2-schz6\" (UID: \"ba9040f7-3dbf-4588-88af-09013e11d294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"
Jul 24 13:31:25.812907 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.812887    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9040f7-3dbf-4588-88af-09013e11d294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e530f2-schz6\" (UID: \"ba9040f7-3dbf-4588-88af-09013e11d294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"
Jul 24 13:31:25.913890 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:25.913867    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"
Jul 24 13:31:26.271780 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:26.271756    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"]
Jul 24 13:31:26.274030 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:31:26.274002    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9040f7_3dbf_4588_88af_09013e11d294.slice/crio-7e97c22ca94b838335ab2be773922269d357baff3ed11ec4b4450924ec00b2dd WatchSource:0}: Error finding container 7e97c22ca94b838335ab2be773922269d357baff3ed11ec4b4450924ec00b2dd: Status 404 returned error can't find the container with id 7e97c22ca94b838335ab2be773922269d357baff3ed11ec4b4450924ec00b2dd
Jul 24 13:31:26.692999 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:26.692958    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6" event={"ID":"ba9040f7-3dbf-4588-88af-09013e11d294","Type":"ContainerStarted","Data":"15ca43e6364e2e0b69b8681e958c416294e04005c41356062d1d1b9b1abc8350"}
Jul 24 13:31:26.693525 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:26.693013    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6" event={"ID":"ba9040f7-3dbf-4588-88af-09013e11d294","Type":"ContainerStarted","Data":"7e97c22ca94b838335ab2be773922269d357baff3ed11ec4b4450924ec00b2dd"}
Jul 24 13:31:26.712933 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:26.712881    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6" podStartSLOduration=1.712862553 podStartE2EDuration="1.712862553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:31:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:31:26.711482027 +0000 UTC m=+2317.578717058" watchObservedRunningTime="2026-07-24 13:31:26.712862553 +0000 UTC m=+2317.580097584"
Jul 24 13:31:27.700345 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:27.700311    2528 generic.go:356] "Generic (PLEG): container finished" podID="ba9040f7-3dbf-4588-88af-09013e11d294" containerID="15ca43e6364e2e0b69b8681e958c416294e04005c41356062d1d1b9b1abc8350" exitCode=0
Jul 24 13:31:27.700728 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:27.700377    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6" event={"ID":"ba9040f7-3dbf-4588-88af-09013e11d294","Type":"ContainerDied","Data":"15ca43e6364e2e0b69b8681e958c416294e04005c41356062d1d1b9b1abc8350"}
Jul 24 13:31:28.846291 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:28.846269    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"
Jul 24 13:31:28.940866 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:28.940824    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9040f7-3dbf-4588-88af-09013e11d294-maas-api-service-ca\") pod \"ba9040f7-3dbf-4588-88af-09013e11d294\" (UID: \"ba9040f7-3dbf-4588-88af-09013e11d294\") "
Jul 24 13:31:28.941236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:28.941204    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba9040f7-3dbf-4588-88af-09013e11d294-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba9040f7-3dbf-4588-88af-09013e11d294" (UID: "ba9040f7-3dbf-4588-88af-09013e11d294"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:31:29.042597 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:29.042509    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba9040f7-3dbf-4588-88af-09013e11d294-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:31:29.712510 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:29.712485    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"
Jul 24 13:31:29.712696 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:29.712525    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6" event={"ID":"ba9040f7-3dbf-4588-88af-09013e11d294","Type":"ContainerDied","Data":"7e97c22ca94b838335ab2be773922269d357baff3ed11ec4b4450924ec00b2dd"}
Jul 24 13:31:29.712696 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:29.712571    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e97c22ca94b838335ab2be773922269d357baff3ed11ec4b4450924ec00b2dd"
Jul 24 13:31:45.698685 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:45.698647    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"]
Jul 24 13:31:45.701934 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:45.701907    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e530f2-schz6"]
Jul 24 13:31:47.632964 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:47.632933    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9040f7-3dbf-4588-88af-09013e11d294" path="/var/lib/kubelet/pods/ba9040f7-3dbf-4588-88af-09013e11d294/volumes"
Jul 24 13:31:53.138593 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.138565    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"]
Jul 24 13:31:53.139045 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.138989    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9040f7-3dbf-4588-88af-09013e11d294" containerName="revoke-keys"
Jul 24 13:31:53.139045 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.138999    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9040f7-3dbf-4588-88af-09013e11d294" containerName="revoke-keys"
Jul 24 13:31:53.139140 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.139071    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9040f7-3dbf-4588-88af-09013e11d294" containerName="revoke-keys"
Jul 24 13:31:53.142295 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.142278    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"
Jul 24 13:31:53.144670 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.144646    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:31:53.150553 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.150260    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"]
Jul 24 13:31:53.267747 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.267710    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39085f74-c55e-49f0-b3fb-28359e4f93fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a9463a-47nrd\" (UID: \"39085f74-c55e-49f0-b3fb-28359e4f93fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"
Jul 24 13:31:53.369007 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.368973    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39085f74-c55e-49f0-b3fb-28359e4f93fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a9463a-47nrd\" (UID: \"39085f74-c55e-49f0-b3fb-28359e4f93fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"
Jul 24 13:31:53.369618 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.369598    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39085f74-c55e-49f0-b3fb-28359e4f93fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a9463a-47nrd\" (UID: \"39085f74-c55e-49f0-b3fb-28359e4f93fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"
Jul 24 13:31:53.455009 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.454988    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"
Jul 24 13:31:53.588808 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.588785    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"]
Jul 24 13:31:53.591730 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:31:53.591701    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39085f74_c55e_49f0_b3fb_28359e4f93fb.slice/crio-cc13aa455a52a186da19b95898f25b4839d23efbc710d0b7ae5c195a9662f686 WatchSource:0}: Error finding container cc13aa455a52a186da19b95898f25b4839d23efbc710d0b7ae5c195a9662f686: Status 404 returned error can't find the container with id cc13aa455a52a186da19b95898f25b4839d23efbc710d0b7ae5c195a9662f686
Jul 24 13:31:53.864497 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.864465    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd" event={"ID":"39085f74-c55e-49f0-b3fb-28359e4f93fb","Type":"ContainerStarted","Data":"c6430e9492d1ec7acb1df5d521eba9b8afe3f797492a21731a102231ef04feb6"}
Jul 24 13:31:53.864621 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.864539    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd" event={"ID":"39085f74-c55e-49f0-b3fb-28359e4f93fb","Type":"ContainerStarted","Data":"cc13aa455a52a186da19b95898f25b4839d23efbc710d0b7ae5c195a9662f686"}
Jul 24 13:31:53.882064 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:53.882018    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd" podStartSLOduration=0.882001354 podStartE2EDuration="882.001354ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:31:53.881889381 +0000 UTC m=+2344.749124402" watchObservedRunningTime="2026-07-24 13:31:53.882001354 +0000 UTC m=+2344.749236386"
Jul 24 13:31:54.874183 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:54.874151    2528 generic.go:356] "Generic (PLEG): container finished" podID="39085f74-c55e-49f0-b3fb-28359e4f93fb" containerID="c6430e9492d1ec7acb1df5d521eba9b8afe3f797492a21731a102231ef04feb6" exitCode=0
Jul 24 13:31:54.874567 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:54.874243    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd" event={"ID":"39085f74-c55e-49f0-b3fb-28359e4f93fb","Type":"ContainerDied","Data":"c6430e9492d1ec7acb1df5d521eba9b8afe3f797492a21731a102231ef04feb6"}
Jul 24 13:31:56.012756 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:56.012731    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"
Jul 24 13:31:56.092157 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:56.092127    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39085f74-c55e-49f0-b3fb-28359e4f93fb-maas-api-service-ca\") pod \"39085f74-c55e-49f0-b3fb-28359e4f93fb\" (UID: \"39085f74-c55e-49f0-b3fb-28359e4f93fb\") "
Jul 24 13:31:56.092450 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:56.092429    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39085f74-c55e-49f0-b3fb-28359e4f93fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "39085f74-c55e-49f0-b3fb-28359e4f93fb" (UID: "39085f74-c55e-49f0-b3fb-28359e4f93fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:31:56.193611 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:56.193579    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39085f74-c55e-49f0-b3fb-28359e4f93fb-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:31:56.886865 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:56.886838    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"
Jul 24 13:31:56.886865 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:56.886848    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd" event={"ID":"39085f74-c55e-49f0-b3fb-28359e4f93fb","Type":"ContainerDied","Data":"cc13aa455a52a186da19b95898f25b4839d23efbc710d0b7ae5c195a9662f686"}
Jul 24 13:31:56.887085 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:31:56.886890    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc13aa455a52a186da19b95898f25b4839d23efbc710d0b7ae5c195a9662f686"
Jul 24 13:32:13.254140 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:32:13.254087    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"]
Jul 24 13:32:13.257960 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:32:13.257926    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9463a-47nrd"]
Jul 24 13:32:13.634006 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:32:13.633930    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39085f74-c55e-49f0-b3fb-28359e4f93fb" path="/var/lib/kubelet/pods/39085f74-c55e-49f0-b3fb-28359e4f93fb/volumes"
Jul 24 13:32:49.835213 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:32:49.835186    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:32:49.836836 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:32:49.836812    2528 scope.go:117] "RemoveContainer" containerID="fc6fa514c4ac61a94f97b5e1b6dc5dc4ddc0e92352ea8f2478b6a12221a63cb2"
Jul 24 13:32:49.845747 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:32:49.845730    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:36:25.510926 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.510897    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"]
Jul 24 13:36:25.511398 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.511384    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39085f74-c55e-49f0-b3fb-28359e4f93fb" containerName="revoke-keys"
Jul 24 13:36:25.511445 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.511400    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="39085f74-c55e-49f0-b3fb-28359e4f93fb" containerName="revoke-keys"
Jul 24 13:36:25.511483 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.511463    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="39085f74-c55e-49f0-b3fb-28359e4f93fb" containerName="revoke-keys"
Jul 24 13:36:25.514600 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.514583    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.517489 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.517466    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f3a913\"/\"openshift-service-ca.crt\""
Jul 24 13:36:25.517606 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.517518    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f3a913\"/\"rate-test-model-f3a913-kserve-self-signed-certs\""
Jul 24 13:36:25.518422 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.518406    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f3a913\"/\"default-dockercfg-psg89\""
Jul 24 13:36:25.518644 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.518632    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f3a913\"/\"kube-root-ca.crt\""
Jul 24 13:36:25.528175 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.528152    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"]
Jul 24 13:36:25.601420 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.601310    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tls-certs\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.601420 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.601351    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tmp-dir\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.609050 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.601432    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-home\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.609050 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.601508    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-model-cache\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.609050 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.601555    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-dshm\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.609050 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.601579    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64sck\" (UniqueName: \"kubernetes.io/projected/e6231b34-fe31-4c81-8ca9-ad60f6e62975-kube-api-access-64sck\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.702562 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.702541    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tls-certs\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.702686 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.702568    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tmp-dir\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.702686 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.702607    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-home\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.702686 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.702625    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-model-cache\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.702686 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.702660    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-dshm\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.702856 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.702689    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64sck\" (UniqueName: \"kubernetes.io/projected/e6231b34-fe31-4c81-8ca9-ad60f6e62975-kube-api-access-64sck\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.703016 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.702996    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tmp-dir\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.703080 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.703020    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-model-cache\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.703080 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.703055    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-home\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.705083 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.705065    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-dshm\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.705269 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.705253    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tls-certs\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.712736 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.712701    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64sck\" (UniqueName: \"kubernetes.io/projected/e6231b34-fe31-4c81-8ca9-ad60f6e62975-kube-api-access-64sck\") pod \"rate-test-model-f3a913-kserve-699b874f7f-95lqq\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") " pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.824462 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.824384    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:25.964552 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:25.964523    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"]
Jul 24 13:36:25.966162 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:36:25.966138    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6231b34_fe31_4c81_8ca9_ad60f6e62975.slice/crio-2d8c526b1f08a801d89960b857fc85d4b1109294b5cde91a8f2a6d9b1b903961 WatchSource:0}: Error finding container 2d8c526b1f08a801d89960b857fc85d4b1109294b5cde91a8f2a6d9b1b903961: Status 404 returned error can't find the container with id 2d8c526b1f08a801d89960b857fc85d4b1109294b5cde91a8f2a6d9b1b903961
Jul 24 13:36:26.377733 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:26.377699    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq" event={"ID":"e6231b34-fe31-4c81-8ca9-ad60f6e62975","Type":"ContainerStarted","Data":"886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf"}
Jul 24 13:36:26.377733 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:26.377740    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq" event={"ID":"e6231b34-fe31-4c81-8ca9-ad60f6e62975","Type":"ContainerStarted","Data":"2d8c526b1f08a801d89960b857fc85d4b1109294b5cde91a8f2a6d9b1b903961"}
Jul 24 13:36:26.400454 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:26.400401    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq" podStartSLOduration=1.400386107 podStartE2EDuration="1.400386107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:26.39762333 +0000 UTC m=+2617.264858360" watchObservedRunningTime="2026-07-24 13:36:26.400386107 +0000 UTC m=+2617.267621143"
Jul 24 13:36:35.824529 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:35.824488    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:35.824529 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:35.824536    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:35.837360 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:35.837338    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:36.441546 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:36.441520    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:36:49.889722 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:49.889686    2528 scope.go:117] "RemoveContainer" containerID="04b253e36f59951d5112025ebc9c0f2f23cce2019331debbd890d3ab1dd57063"
Jul 24 13:36:49.898392 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:49.898375    2528 scope.go:117] "RemoveContainer" containerID="0dde1d187d74d825aba1e941ec9897d2458c654f2937f91ff9a4ea67defc75a5"
Jul 24 13:36:49.906120 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:49.906078    2528 scope.go:117] "RemoveContainer" containerID="bb04ddf4b5928d7c1ec19a52a88fd2f3cfd8e3448ae05bb011dbc7d302f2a4b2"
Jul 24 13:36:49.913378 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:36:49.913361    2528 scope.go:117] "RemoveContainer" containerID="9fef8a1afd081a42dc42cc39c9719468dbe57890cf61008278f11b66747fb77f"
Jul 24 13:37:30.981651 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:30.981619    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"]
Jul 24 13:37:46.001290 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.001221    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq" podUID="e6231b34-fe31-4c81-8ca9-ad60f6e62975" containerName="main" containerID="cri-o://886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf" gracePeriod=45
Jul 24 13:37:46.254898 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.254831    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:37:46.428958 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.428924    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tmp-dir\") pod \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") "
Jul 24 13:37:46.428958 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.428966    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-home\") pod \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") "
Jul 24 13:37:46.429266 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429029    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-dshm\") pod \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") "
Jul 24 13:37:46.429266 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429052    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-model-cache\") pod \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") "
Jul 24 13:37:46.429266 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429126    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tls-certs\") pod \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") "
Jul 24 13:37:46.429266 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429184    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64sck\" (UniqueName: \"kubernetes.io/projected/e6231b34-fe31-4c81-8ca9-ad60f6e62975-kube-api-access-64sck\") pod \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\" (UID: \"e6231b34-fe31-4c81-8ca9-ad60f6e62975\") "
Jul 24 13:37:46.429474 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429302    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-home" (OuterVolumeSpecName: "home") pod "e6231b34-fe31-4c81-8ca9-ad60f6e62975" (UID: "e6231b34-fe31-4c81-8ca9-ad60f6e62975"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:37:46.429474 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429339    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-model-cache" (OuterVolumeSpecName: "model-cache") pod "e6231b34-fe31-4c81-8ca9-ad60f6e62975" (UID: "e6231b34-fe31-4c81-8ca9-ad60f6e62975"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:37:46.429474 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429328    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e6231b34-fe31-4c81-8ca9-ad60f6e62975" (UID: "e6231b34-fe31-4c81-8ca9-ad60f6e62975"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:37:46.429622 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429610    2528 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:37:46.429678 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429628    2528 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:37:46.429678 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.429641    2528 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:37:46.431508 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.431483    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-dshm" (OuterVolumeSpecName: "dshm") pod "e6231b34-fe31-4c81-8ca9-ad60f6e62975" (UID: "e6231b34-fe31-4c81-8ca9-ad60f6e62975"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:37:46.431609 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.431583    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e6231b34-fe31-4c81-8ca9-ad60f6e62975" (UID: "e6231b34-fe31-4c81-8ca9-ad60f6e62975"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:37:46.431609 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.431587    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6231b34-fe31-4c81-8ca9-ad60f6e62975-kube-api-access-64sck" (OuterVolumeSpecName: "kube-api-access-64sck") pod "e6231b34-fe31-4c81-8ca9-ad60f6e62975" (UID: "e6231b34-fe31-4c81-8ca9-ad60f6e62975"). InnerVolumeSpecName "kube-api-access-64sck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:37:46.530598 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.530504    2528 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6231b34-fe31-4c81-8ca9-ad60f6e62975-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:37:46.530598 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.530538    2528 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6231b34-fe31-4c81-8ca9-ad60f6e62975-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:37:46.530598 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.530549    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64sck\" (UniqueName: \"kubernetes.io/projected/e6231b34-fe31-4c81-8ca9-ad60f6e62975-kube-api-access-64sck\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:37:46.814149 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.814018    2528 generic.go:356] "Generic (PLEG): container finished" podID="e6231b34-fe31-4c81-8ca9-ad60f6e62975" containerID="886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf" exitCode=0
Jul 24 13:37:46.814149 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.814074    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"
Jul 24 13:37:46.814149 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.814116    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq" event={"ID":"e6231b34-fe31-4c81-8ca9-ad60f6e62975","Type":"ContainerDied","Data":"886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf"}
Jul 24 13:37:46.814408 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.814164    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq" event={"ID":"e6231b34-fe31-4c81-8ca9-ad60f6e62975","Type":"ContainerDied","Data":"2d8c526b1f08a801d89960b857fc85d4b1109294b5cde91a8f2a6d9b1b903961"}
Jul 24 13:37:46.814408 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.814181    2528 scope.go:117] "RemoveContainer" containerID="886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf"
Jul 24 13:37:46.826651 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.826632    2528 scope.go:117] "RemoveContainer" containerID="886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf"
Jul 24 13:37:46.827035 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:37:46.827016    2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf\": container with ID starting with 886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf not found: ID does not exist" containerID="886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf"
Jul 24 13:37:46.827175 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.827045    2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf"} err="failed to get container status \"886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf\": rpc error: code = NotFound desc = could not find container \"886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf\": container with ID starting with 886a16a38bfc125996d19b9a8fa197169fc6246a87c5b6877daff55cebccadaf not found: ID does not exist"
Jul 24 13:37:46.845908 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.845847    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"]
Jul 24 13:37:46.848394 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:46.848368    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f3a913/rate-test-model-f3a913-kserve-699b874f7f-95lqq"]
Jul 24 13:37:47.634084 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:47.634048    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6231b34-fe31-4c81-8ca9-ad60f6e62975" path="/var/lib/kubelet/pods/e6231b34-fe31-4c81-8ca9-ad60f6e62975/volumes"
Jul 24 13:37:49.869908 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:49.869861    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:37:49.881565 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:49.881541    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:37:49.944258 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:37:49.944229    2528 scope.go:117] "RemoveContainer" containerID="15ca43e6364e2e0b69b8681e958c416294e04005c41356062d1d1b9b1abc8350"
Jul 24 13:38:11.013990 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.013951    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"]
Jul 24 13:38:11.014432 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.014415    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6231b34-fe31-4c81-8ca9-ad60f6e62975" containerName="main"
Jul 24 13:38:11.014432 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.014433    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6231b34-fe31-4c81-8ca9-ad60f6e62975" containerName="main"
Jul 24 13:38:11.014517 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.014508    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6231b34-fe31-4c81-8ca9-ad60f6e62975" containerName="main"
Jul 24 13:38:11.025062 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.025024    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.031371 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.031349    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-472106-openshift-default-dockercfg-whn52\""
Jul 24 13:38:11.070454 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.070422    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"]
Jul 24 13:38:11.148749 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.148718    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c5be30-58f0-4c86-a64f-181895616d1d-istio-podinfo\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.148749 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.148750    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-socket\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.149008 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.148779    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-credential-socket\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.149008 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.148829    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-certs\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.149008 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.148900    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncpx9\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-kube-api-access-ncpx9\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.149008 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.148940    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-data\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.149008 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.148984    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-envoy\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.149234 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.149017    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c5be30-58f0-4c86-a64f-181895616d1d-istiod-ca-cert\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.149234 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.149040    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-istio-token\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250417 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250379    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-credential-socket\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250417 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250415    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-certs\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250684 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250463    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncpx9\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-kube-api-access-ncpx9\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250684 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250491    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-data\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250684 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250528    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-envoy\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250684 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250563    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c5be30-58f0-4c86-a64f-181895616d1d-istiod-ca-cert\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250684 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250592    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-istio-token\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250684 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250644    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c5be30-58f0-4c86-a64f-181895616d1d-istio-podinfo\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.250684 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250668    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-socket\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.251053 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250890    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-credential-socket\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.251053 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.250948    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-data\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.251053 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.251032    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-socket\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.251266 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.251163    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-certs\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.251334 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.251314    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c5be30-58f0-4c86-a64f-181895616d1d-istiod-ca-cert\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.253045 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.253023    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-envoy\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.253465 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.253444    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c5be30-58f0-4c86-a64f-181895616d1d-istio-podinfo\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.260901 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.260877    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-istio-token\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.261000 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.260989    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncpx9\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-kube-api-access-ncpx9\") pod \"e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") " pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.335079 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.334986    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:11.489659 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.489633    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"]
Jul 24 13:38:11.492024 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:38:11.491995    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c5be30_58f0_4c86_a64f_181895616d1d.slice/crio-fe449bc909ea295f4f157d98596f01980768e2c5d651e86d1fb6c57f02b23902 WatchSource:0}: Error finding container fe449bc909ea295f4f157d98596f01980768e2c5d651e86d1fb6c57f02b23902: Status 404 returned error can't find the container with id fe449bc909ea295f4f157d98596f01980768e2c5d651e86d1fb6c57f02b23902
Jul 24 13:38:11.494120 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.494086    2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:38:11.952151 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:11.952117    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" event={"ID":"89c5be30-58f0-4c86-a64f-181895616d1d","Type":"ContainerStarted","Data":"fe449bc909ea295f4f157d98596f01980768e2c5d651e86d1fb6c57f02b23902"}
Jul 24 13:38:14.286263 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:14.286231    2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 13:38:14.286511 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:14.286304    2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 13:38:14.286511 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:14.286334    2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 13:38:14.972534 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:14.972500    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" event={"ID":"89c5be30-58f0-4c86-a64f-181895616d1d","Type":"ContainerStarted","Data":"dbad898ca7e56c02b9a67c3acb9d77044350540f87e5f294dde42d603ade1532"}
Jul 24 13:38:14.999958 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:14.999912    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" podStartSLOduration=2.208355182 podStartE2EDuration="4.9998961s" totalImagesPullingTime="2.791540918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:14.998385864 +0000 UTC m=+2725.865620894" watchObservedRunningTime="2026-07-24 13:38:14.9998961 +0000 UTC m=+2725.867131130"
Jul 24 13:38:15.335231 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:15.335159    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:15.341162 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:15.341139    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:15.978251 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:15.978225    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:15.979038 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:15.979019    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:17.491046 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.491009    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"]
Jul 24 13:38:17.494811 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.494782    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:17.497464 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.497440    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-472106-serving-cert\""
Jul 24 13:38:17.506330 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.506304    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"]
Jul 24 13:38:17.613972 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.613938    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9n2g\" (UniqueName: \"kubernetes.io/projected/bd0b0302-362a-4306-8966-1026bfb9750f-kube-api-access-m9n2g\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:17.614171 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.614004    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:17.614171 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.614064    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0b0302-362a-4306-8966-1026bfb9750f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:17.715372 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.715340    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0b0302-362a-4306-8966-1026bfb9750f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:17.715531 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.715399    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9n2g\" (UniqueName: \"kubernetes.io/projected/bd0b0302-362a-4306-8966-1026bfb9750f-kube-api-access-m9n2g\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:17.715531 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.715476    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:17.715653 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:38:17.715602    2528 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-serving-cert: secret "maas-api-e2e-ipp-b-472106-serving-cert" not found
Jul 24 13:38:17.715711 ip-10-0-134-90 kubenswrapper[2528]: E0724 13:38:17.715687    2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls podName:bd0b0302-362a-4306-8966-1026bfb9750f nodeName:}" failed. No retries permitted until 2026-07-24 13:38:18.215667129 +0000 UTC m=+2729.082902154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls") pod "maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz" (UID: "bd0b0302-362a-4306-8966-1026bfb9750f") : secret "maas-api-e2e-ipp-b-472106-serving-cert" not found
Jul 24 13:38:17.716144 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.716083    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0b0302-362a-4306-8966-1026bfb9750f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:17.726766 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:17.726747    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9n2g\" (UniqueName: \"kubernetes.io/projected/bd0b0302-362a-4306-8966-1026bfb9750f-kube-api-access-m9n2g\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:18.220670 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:18.220640    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:18.223347 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:18.223324    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:18.407331 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:18.407298    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:18.558811 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:18.558780    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"]
Jul 24 13:38:18.560488 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:38:18.560460    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0b0302_362a_4306_8966_1026bfb9750f.slice/crio-762dbd22f21cb5f6503325938f4905a6f1d441abaa11ccad5ae98495e3555dad WatchSource:0}: Error finding container 762dbd22f21cb5f6503325938f4905a6f1d441abaa11ccad5ae98495e3555dad: Status 404 returned error can't find the container with id 762dbd22f21cb5f6503325938f4905a6f1d441abaa11ccad5ae98495e3555dad
Jul 24 13:38:18.998072 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:18.998045    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz" event={"ID":"bd0b0302-362a-4306-8966-1026bfb9750f","Type":"ContainerStarted","Data":"542900d45a5a9ff18e47dabf974505c1544add19691e686722a04fdf8cc91526"}
Jul 24 13:38:18.998185 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:18.998102    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz" event={"ID":"bd0b0302-362a-4306-8966-1026bfb9750f","Type":"ContainerStarted","Data":"762dbd22f21cb5f6503325938f4905a6f1d441abaa11ccad5ae98495e3555dad"}
Jul 24 13:38:18.998185 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:18.998146    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:19.019972 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:19.019928    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz" podStartSLOduration=1.65781686 podStartE2EDuration="2.019911144s" totalImagesPullingTime="362.094284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:19.019056391 +0000 UTC m=+2729.886291420" watchObservedRunningTime="2026-07-24 13:38:19.019911144 +0000 UTC m=+2729.887146177"
Jul 24 13:38:25.009452 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:25.009420    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:38:30.056049 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:30.056018    2528 generic.go:356] "Generic (PLEG): container finished" podID="89c5be30-58f0-4c86-a64f-181895616d1d" containerID="dbad898ca7e56c02b9a67c3acb9d77044350540f87e5f294dde42d603ade1532" exitCode=0
Jul 24 13:38:30.056510 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:30.056111    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" event={"ID":"89c5be30-58f0-4c86-a64f-181895616d1d","Type":"ContainerDied","Data":"dbad898ca7e56c02b9a67c3acb9d77044350540f87e5f294dde42d603ade1532"}
Jul 24 13:38:30.056510 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:30.056443    2528 scope.go:117] "RemoveContainer" containerID="dbad898ca7e56c02b9a67c3acb9d77044350540f87e5f294dde42d603ade1532"
Jul 24 13:38:30.057441 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:30.057415    2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 13:38:30.057526 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:30.057482    2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 13:38:30.057526 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:30.057512    2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 13:38:30.978730 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:30.978683    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:31.065159 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:31.065123    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" event={"ID":"89c5be30-58f0-4c86-a64f-181895616d1d","Type":"ContainerStarted","Data":"4a7b5d5d80f369b24925d3b87c43ba8de5470a766aba60387f8d1802c47cfc76"}
Jul 24 13:38:31.335659 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:31.335559    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:31.336463 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:31.336428    2528 patch_prober.go:28] interesting pod/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 24 13:38:31.336585 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:31.336500    2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 24 13:38:32.336266 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:32.336229    2528 patch_prober.go:28] interesting pod/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 24 13:38:32.336759 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:32.336295    2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 24 13:38:33.336032 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:33.335991    2528 patch_prober.go:28] interesting pod/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 24 13:38:33.336266 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:33.336072    2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 24 13:38:34.336428 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:34.336386    2528 patch_prober.go:28] interesting pod/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 24 13:38:34.337109 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:34.337058    2528 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 24 13:38:35.339649 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:35.339618    2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:35.340084 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:35.339922    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:35.340803 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:35.340787    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:38:38.627683 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:38.627658    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-nsl7k_d887a244-c888-4d7a-bb2e-3e00a06d5dea/payload-processing/0.log"
Jul 24 13:38:49.969425 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:38:49.969394    2528 scope.go:117] "RemoveContainer" containerID="c6430e9492d1ec7acb1df5d521eba9b8afe3f797492a21731a102231ef04feb6"
Jul 24 13:39:15.414155 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:15.414076    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-nsl7k_d887a244-c888-4d7a-bb2e-3e00a06d5dea/payload-processing/0.log"
Jul 24 13:39:21.097108 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.097065    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"]
Jul 24 13:39:21.101016 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.100996    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.106936 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.106909    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-45ac1f-serving-cert\""
Jul 24 13:39:21.115499 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.115472    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"]
Jul 24 13:39:21.142747 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.142718    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e40a9546-92c5-4b5f-b397-23291ef77c51-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.142855 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.142764    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wfc7\" (UniqueName: \"kubernetes.io/projected/e40a9546-92c5-4b5f-b397-23291ef77c51-kube-api-access-4wfc7\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.142904 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.142858    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e40a9546-92c5-4b5f-b397-23291ef77c51-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.243832 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.243794    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e40a9546-92c5-4b5f-b397-23291ef77c51-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.243996 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.243841    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wfc7\" (UniqueName: \"kubernetes.io/projected/e40a9546-92c5-4b5f-b397-23291ef77c51-kube-api-access-4wfc7\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.243996 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.243875    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e40a9546-92c5-4b5f-b397-23291ef77c51-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.244549 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.244490    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e40a9546-92c5-4b5f-b397-23291ef77c51-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.246452 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.246427    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e40a9546-92c5-4b5f-b397-23291ef77c51-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.256548 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.256526    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wfc7\" (UniqueName: \"kubernetes.io/projected/e40a9546-92c5-4b5f-b397-23291ef77c51-kube-api-access-4wfc7\") pod \"maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.411116 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.411069    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:21.566497 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:21.566468    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"]
Jul 24 13:39:21.568276 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:39:21.568246    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40a9546_92c5_4b5f_b397_23291ef77c51.slice/crio-057de4993a91139d7e98e5251e9a0129f18ece4d18aadf735211b85ec8394318 WatchSource:0}: Error finding container 057de4993a91139d7e98e5251e9a0129f18ece4d18aadf735211b85ec8394318: Status 404 returned error can't find the container with id 057de4993a91139d7e98e5251e9a0129f18ece4d18aadf735211b85ec8394318
Jul 24 13:39:22.342655 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:22.342574    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg" event={"ID":"e40a9546-92c5-4b5f-b397-23291ef77c51","Type":"ContainerStarted","Data":"acc4aab3d08431fbd75352205bb5a5b952a0cc34691d50b86eeaacf0493efd3e"}
Jul 24 13:39:22.343008 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:22.342723    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:22.343008 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:22.342763    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg" event={"ID":"e40a9546-92c5-4b5f-b397-23291ef77c51","Type":"ContainerStarted","Data":"057de4993a91139d7e98e5251e9a0129f18ece4d18aadf735211b85ec8394318"}
Jul 24 13:39:22.364666 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:22.364616    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg" podStartSLOduration=0.971106999 podStartE2EDuration="1.364599273s" totalImagesPullingTime="393.492274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:22.36386642 +0000 UTC m=+2793.231101466" watchObservedRunningTime="2026-07-24 13:39:22.364599273 +0000 UTC m=+2793.231834304"
Jul 24 13:39:28.355462 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:28.355430    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:35.096495 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.096461    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"]
Jul 24 13:39:35.100309 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.100288    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"
Jul 24 13:39:35.103151 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.103129    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:39:35.115720 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.115691    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"]
Jul 24 13:39:35.185318 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.185282    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e76590b-b4d9-49da-855c-ac513f916f1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5\" (UID: \"2e76590b-b4d9-49da-855c-ac513f916f1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"
Jul 24 13:39:35.286449 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.286408    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e76590b-b4d9-49da-855c-ac513f916f1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5\" (UID: \"2e76590b-b4d9-49da-855c-ac513f916f1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"
Jul 24 13:39:35.287162 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.287138    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e76590b-b4d9-49da-855c-ac513f916f1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5\" (UID: \"2e76590b-b4d9-49da-855c-ac513f916f1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"
Jul 24 13:39:35.410963 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.410933    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"
Jul 24 13:39:35.546147 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:35.546124    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"]
Jul 24 13:39:35.549144 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:39:35.549118    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e76590b_b4d9_49da_855c_ac513f916f1f.slice/crio-68143d82d1fc8745c85ef10d19f39104f67171406fb320f6a0dc5e1cd6e096df WatchSource:0}: Error finding container 68143d82d1fc8745c85ef10d19f39104f67171406fb320f6a0dc5e1cd6e096df: Status 404 returned error can't find the container with id 68143d82d1fc8745c85ef10d19f39104f67171406fb320f6a0dc5e1cd6e096df
Jul 24 13:39:36.421746 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:36.421713    2528 generic.go:356] "Generic (PLEG): container finished" podID="2e76590b-b4d9-49da-855c-ac513f916f1f" containerID="68545ea3ee9df12a6b5256ebec03eb9d3e5d91fc5c836dd6c55b139ca2453fba" exitCode=0
Jul 24 13:39:36.422139 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:36.421806    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5" event={"ID":"2e76590b-b4d9-49da-855c-ac513f916f1f","Type":"ContainerDied","Data":"68545ea3ee9df12a6b5256ebec03eb9d3e5d91fc5c836dd6c55b139ca2453fba"}
Jul 24 13:39:36.422139 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:36.421863    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5" event={"ID":"2e76590b-b4d9-49da-855c-ac513f916f1f","Type":"ContainerStarted","Data":"68143d82d1fc8745c85ef10d19f39104f67171406fb320f6a0dc5e1cd6e096df"}
Jul 24 13:39:37.570608 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:37.570585    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"
Jul 24 13:39:37.706077 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:37.706014    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e76590b-b4d9-49da-855c-ac513f916f1f-maas-api-service-ca\") pod \"2e76590b-b4d9-49da-855c-ac513f916f1f\" (UID: \"2e76590b-b4d9-49da-855c-ac513f916f1f\") "
Jul 24 13:39:37.706355 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:37.706335    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e76590b-b4d9-49da-855c-ac513f916f1f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2e76590b-b4d9-49da-855c-ac513f916f1f" (UID: "2e76590b-b4d9-49da-855c-ac513f916f1f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:39:37.806991 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:37.806968    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e76590b-b4d9-49da-855c-ac513f916f1f-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:39:38.434416 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:38.434381    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5" event={"ID":"2e76590b-b4d9-49da-855c-ac513f916f1f","Type":"ContainerDied","Data":"68143d82d1fc8745c85ef10d19f39104f67171406fb320f6a0dc5e1cd6e096df"}
Jul 24 13:39:38.434416 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:38.434413    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"
Jul 24 13:39:38.434615 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:38.434429    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68143d82d1fc8745c85ef10d19f39104f67171406fb320f6a0dc5e1cd6e096df"
Jul 24 13:39:45.347493 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.347457    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"]
Jul 24 13:39:45.347985 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.347708    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg" podUID="e40a9546-92c5-4b5f-b397-23291ef77c51" containerName="maas-api" containerID="cri-o://acc4aab3d08431fbd75352205bb5a5b952a0cc34691d50b86eeaacf0493efd3e" gracePeriod=30
Jul 24 13:39:45.473612 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.473582    2528 generic.go:356] "Generic (PLEG): container finished" podID="e40a9546-92c5-4b5f-b397-23291ef77c51" containerID="acc4aab3d08431fbd75352205bb5a5b952a0cc34691d50b86eeaacf0493efd3e" exitCode=0
Jul 24 13:39:45.473744 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.473660    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg" event={"ID":"e40a9546-92c5-4b5f-b397-23291ef77c51","Type":"ContainerDied","Data":"acc4aab3d08431fbd75352205bb5a5b952a0cc34691d50b86eeaacf0493efd3e"}
Jul 24 13:39:45.615718 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.615653    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:45.794087 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.794059    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e40a9546-92c5-4b5f-b397-23291ef77c51-openshift-service-ca\") pod \"e40a9546-92c5-4b5f-b397-23291ef77c51\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") "
Jul 24 13:39:45.794087 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.794119    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wfc7\" (UniqueName: \"kubernetes.io/projected/e40a9546-92c5-4b5f-b397-23291ef77c51-kube-api-access-4wfc7\") pod \"e40a9546-92c5-4b5f-b397-23291ef77c51\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") "
Jul 24 13:39:45.794308 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.794170    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e40a9546-92c5-4b5f-b397-23291ef77c51-maas-api-tls\") pod \"e40a9546-92c5-4b5f-b397-23291ef77c51\" (UID: \"e40a9546-92c5-4b5f-b397-23291ef77c51\") "
Jul 24 13:39:45.794399 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.794367    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40a9546-92c5-4b5f-b397-23291ef77c51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e40a9546-92c5-4b5f-b397-23291ef77c51" (UID: "e40a9546-92c5-4b5f-b397-23291ef77c51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:39:45.794539 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.794502    2528 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e40a9546-92c5-4b5f-b397-23291ef77c51-openshift-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:39:45.796420 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.796393    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40a9546-92c5-4b5f-b397-23291ef77c51-kube-api-access-4wfc7" (OuterVolumeSpecName: "kube-api-access-4wfc7") pod "e40a9546-92c5-4b5f-b397-23291ef77c51" (UID: "e40a9546-92c5-4b5f-b397-23291ef77c51"). InnerVolumeSpecName "kube-api-access-4wfc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:39:45.796498 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.796454    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a9546-92c5-4b5f-b397-23291ef77c51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e40a9546-92c5-4b5f-b397-23291ef77c51" (UID: "e40a9546-92c5-4b5f-b397-23291ef77c51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:39:45.895145 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.895058    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wfc7\" (UniqueName: \"kubernetes.io/projected/e40a9546-92c5-4b5f-b397-23291ef77c51-kube-api-access-4wfc7\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:39:45.895145 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:45.895082    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e40a9546-92c5-4b5f-b397-23291ef77c51-maas-api-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:39:46.481058 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:46.481029    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"
Jul 24 13:39:46.481513 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:46.481049    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg" event={"ID":"e40a9546-92c5-4b5f-b397-23291ef77c51","Type":"ContainerDied","Data":"057de4993a91139d7e98e5251e9a0129f18ece4d18aadf735211b85ec8394318"}
Jul 24 13:39:46.481513 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:46.481144    2528 scope.go:117] "RemoveContainer" containerID="acc4aab3d08431fbd75352205bb5a5b952a0cc34691d50b86eeaacf0493efd3e"
Jul 24 13:39:46.509336 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:46.509308    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"]
Jul 24 13:39:46.513758 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:46.513732    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-45ac1f-965f6d577-fxklg"]
Jul 24 13:39:47.633647 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:47.633611    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40a9546-92c5-4b5f-b397-23291ef77c51" path="/var/lib/kubelet/pods/e40a9546-92c5-4b5f-b397-23291ef77c51/volumes"
Jul 24 13:39:50.196176 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:50.196145    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"]
Jul 24 13:39:50.199823 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:50.199796    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-45ac1f-x6hd5"]
Jul 24 13:39:51.633854 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:39:51.633826    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e76590b-b4d9-49da-855c-ac513f916f1f" path="/var/lib/kubelet/pods/2e76590b-b4d9-49da-855c-ac513f916f1f/volumes"
Jul 24 13:40:01.342382 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.342346    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"]
Jul 24 13:40:01.342871 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.342775    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e76590b-b4d9-49da-855c-ac513f916f1f" containerName="revoke-keys"
Jul 24 13:40:01.342871 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.342787    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e76590b-b4d9-49da-855c-ac513f916f1f" containerName="revoke-keys"
Jul 24 13:40:01.342871 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.342798    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40a9546-92c5-4b5f-b397-23291ef77c51" containerName="maas-api"
Jul 24 13:40:01.342871 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.342804    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40a9546-92c5-4b5f-b397-23291ef77c51" containerName="maas-api"
Jul 24 13:40:01.343034 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.342899    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40a9546-92c5-4b5f-b397-23291ef77c51" containerName="maas-api"
Jul 24 13:40:01.343034 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.342910    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e76590b-b4d9-49da-855c-ac513f916f1f" containerName="revoke-keys"
Jul 24 13:40:01.346058 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.346038    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"
Jul 24 13:40:01.348133 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.348115    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:40:01.355008 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.354979    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"]
Jul 24 13:40:01.431474 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.431452    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b97bfb-74f7-44ea-90e7-661f6fa5af54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-49d475-qk445\" (UID: \"c4b97bfb-74f7-44ea-90e7-661f6fa5af54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"
Jul 24 13:40:01.532182 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.532152    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b97bfb-74f7-44ea-90e7-661f6fa5af54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-49d475-qk445\" (UID: \"c4b97bfb-74f7-44ea-90e7-661f6fa5af54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"
Jul 24 13:40:01.532726 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.532707    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b97bfb-74f7-44ea-90e7-661f6fa5af54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-49d475-qk445\" (UID: \"c4b97bfb-74f7-44ea-90e7-661f6fa5af54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"
Jul 24 13:40:01.658697 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:01.658637    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"
Jul 24 13:40:02.013828 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:02.013802    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"]
Jul 24 13:40:02.016537 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:40:02.016505    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b97bfb_74f7_44ea_90e7_661f6fa5af54.slice/crio-e124bda3bdc2449ed5f6337310941639b096985d50d67f7d6dc912791c513c38 WatchSource:0}: Error finding container e124bda3bdc2449ed5f6337310941639b096985d50d67f7d6dc912791c513c38: Status 404 returned error can't find the container with id e124bda3bdc2449ed5f6337310941639b096985d50d67f7d6dc912791c513c38
Jul 24 13:40:02.568475 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:02.568394    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445" event={"ID":"c4b97bfb-74f7-44ea-90e7-661f6fa5af54","Type":"ContainerStarted","Data":"d84aed90c9d57a522ec2ae7cc6606f48579a366d8b1ce7e2693395604587ee20"}
Jul 24 13:40:02.568475 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:02.568441    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445" event={"ID":"c4b97bfb-74f7-44ea-90e7-661f6fa5af54","Type":"ContainerStarted","Data":"e124bda3bdc2449ed5f6337310941639b096985d50d67f7d6dc912791c513c38"}
Jul 24 13:40:02.588780 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:02.588736    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445" podStartSLOduration=1.588721412 podStartE2EDuration="1.588721412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:40:02.586588246 +0000 UTC m=+2833.453823277" watchObservedRunningTime="2026-07-24 13:40:02.588721412 +0000 UTC m=+2833.455956467"
Jul 24 13:40:03.575343 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:03.575304    2528 generic.go:356] "Generic (PLEG): container finished" podID="c4b97bfb-74f7-44ea-90e7-661f6fa5af54" containerID="d84aed90c9d57a522ec2ae7cc6606f48579a366d8b1ce7e2693395604587ee20" exitCode=0
Jul 24 13:40:03.575698 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:03.575350    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445" event={"ID":"c4b97bfb-74f7-44ea-90e7-661f6fa5af54","Type":"ContainerDied","Data":"d84aed90c9d57a522ec2ae7cc6606f48579a366d8b1ce7e2693395604587ee20"}
Jul 24 13:40:04.737280 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:04.737253    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"
Jul 24 13:40:04.862371 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:04.862306    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b97bfb-74f7-44ea-90e7-661f6fa5af54-maas-api-service-ca\") pod \"c4b97bfb-74f7-44ea-90e7-661f6fa5af54\" (UID: \"c4b97bfb-74f7-44ea-90e7-661f6fa5af54\") "
Jul 24 13:40:04.862632 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:04.862609    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b97bfb-74f7-44ea-90e7-661f6fa5af54-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4b97bfb-74f7-44ea-90e7-661f6fa5af54" (UID: "c4b97bfb-74f7-44ea-90e7-661f6fa5af54"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:40:04.963441 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:04.963415    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b97bfb-74f7-44ea-90e7-661f6fa5af54-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:40:05.586912 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:05.586889    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"
Jul 24 13:40:05.587084 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:05.586918    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445" event={"ID":"c4b97bfb-74f7-44ea-90e7-661f6fa5af54","Type":"ContainerDied","Data":"e124bda3bdc2449ed5f6337310941639b096985d50d67f7d6dc912791c513c38"}
Jul 24 13:40:05.587084 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:05.586962    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e124bda3bdc2449ed5f6337310941639b096985d50d67f7d6dc912791c513c38"
Jul 24 13:40:21.483606 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:21.483573    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"]
Jul 24 13:40:21.488994 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:21.488966    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-49d475-qk445"]
Jul 24 13:40:21.633413 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:40:21.633386    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4b97bfb-74f7-44ea-90e7-661f6fa5af54" path="/var/lib/kubelet/pods/c4b97bfb-74f7-44ea-90e7-661f6fa5af54/volumes"
Jul 24 13:41:12.294138 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.294108    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"]
Jul 24 13:41:12.294609 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.294595    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b97bfb-74f7-44ea-90e7-661f6fa5af54" containerName="revoke-keys"
Jul 24 13:41:12.294652 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.294611    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b97bfb-74f7-44ea-90e7-661f6fa5af54" containerName="revoke-keys"
Jul 24 13:41:12.294708 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.294699    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b97bfb-74f7-44ea-90e7-661f6fa5af54" containerName="revoke-keys"
Jul 24 13:41:12.297856 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.297838    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"
Jul 24 13:41:12.300350 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.300327    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:41:12.308844 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.308826    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"]
Jul 24 13:41:12.467510 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.467484    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4c40571-1a1e-4b0b-b761-c79d5805abee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp\" (UID: \"e4c40571-1a1e-4b0b-b761-c79d5805abee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"
Jul 24 13:41:12.568467 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.568389    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4c40571-1a1e-4b0b-b761-c79d5805abee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp\" (UID: \"e4c40571-1a1e-4b0b-b761-c79d5805abee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"
Jul 24 13:41:12.568978 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.568959    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4c40571-1a1e-4b0b-b761-c79d5805abee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp\" (UID: \"e4c40571-1a1e-4b0b-b761-c79d5805abee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"
Jul 24 13:41:12.610455 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.610437    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"
Jul 24 13:41:12.749153 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.749122    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"]
Jul 24 13:41:12.750599 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:41:12.750574    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c40571_1a1e_4b0b_b761_c79d5805abee.slice/crio-dcfd2c7f5fceed4213874495ba20d57ae0aa4101d5ded0b5f377da6dd5961c50 WatchSource:0}: Error finding container dcfd2c7f5fceed4213874495ba20d57ae0aa4101d5ded0b5f377da6dd5961c50: Status 404 returned error can't find the container with id dcfd2c7f5fceed4213874495ba20d57ae0aa4101d5ded0b5f377da6dd5961c50
Jul 24 13:41:12.943982 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:12.943949    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp" event={"ID":"e4c40571-1a1e-4b0b-b761-c79d5805abee","Type":"ContainerStarted","Data":"dcfd2c7f5fceed4213874495ba20d57ae0aa4101d5ded0b5f377da6dd5961c50"}
Jul 24 13:41:13.950717 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:13.950684    2528 generic.go:356] "Generic (PLEG): container finished" podID="e4c40571-1a1e-4b0b-b761-c79d5805abee" containerID="476e3189d9021955309364cd37e192d37e3833614f572d3a266eb01daa9675ba" exitCode=0
Jul 24 13:41:13.951169 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:13.950735    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp" event={"ID":"e4c40571-1a1e-4b0b-b761-c79d5805abee","Type":"ContainerDied","Data":"476e3189d9021955309364cd37e192d37e3833614f572d3a266eb01daa9675ba"}
Jul 24 13:41:15.089340 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:15.089315    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"
Jul 24 13:41:15.189715 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:15.189689    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4c40571-1a1e-4b0b-b761-c79d5805abee-maas-api-service-ca\") pod \"e4c40571-1a1e-4b0b-b761-c79d5805abee\" (UID: \"e4c40571-1a1e-4b0b-b761-c79d5805abee\") "
Jul 24 13:41:15.190051 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:15.190029    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4c40571-1a1e-4b0b-b761-c79d5805abee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4c40571-1a1e-4b0b-b761-c79d5805abee" (UID: "e4c40571-1a1e-4b0b-b761-c79d5805abee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:15.291369 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:15.291304    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4c40571-1a1e-4b0b-b761-c79d5805abee-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:15.961835 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:15.961809    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"
Jul 24 13:41:15.961835 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:15.961817    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp" event={"ID":"e4c40571-1a1e-4b0b-b761-c79d5805abee","Type":"ContainerDied","Data":"dcfd2c7f5fceed4213874495ba20d57ae0aa4101d5ded0b5f377da6dd5961c50"}
Jul 24 13:41:15.962007 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:15.961860    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcfd2c7f5fceed4213874495ba20d57ae0aa4101d5ded0b5f377da6dd5961c50"
Jul 24 13:41:22.815334 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:22.815256    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"]
Jul 24 13:41:22.815751 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:22.815441    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz" podUID="bd0b0302-362a-4306-8966-1026bfb9750f" containerName="maas-api" containerID="cri-o://542900d45a5a9ff18e47dabf974505c1544add19691e686722a04fdf8cc91526" gracePeriod=30
Jul 24 13:41:23.004660 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.004627    2528 generic.go:356] "Generic (PLEG): container finished" podID="bd0b0302-362a-4306-8966-1026bfb9750f" containerID="542900d45a5a9ff18e47dabf974505c1544add19691e686722a04fdf8cc91526" exitCode=0
Jul 24 13:41:23.004798 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.004701    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz" event={"ID":"bd0b0302-362a-4306-8966-1026bfb9750f","Type":"ContainerDied","Data":"542900d45a5a9ff18e47dabf974505c1544add19691e686722a04fdf8cc91526"}
Jul 24 13:41:23.079382 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.079326    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:41:23.161852 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.161807    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9n2g\" (UniqueName: \"kubernetes.io/projected/bd0b0302-362a-4306-8966-1026bfb9750f-kube-api-access-m9n2g\") pod \"bd0b0302-362a-4306-8966-1026bfb9750f\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") "
Jul 24 13:41:23.162056 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.161994    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0b0302-362a-4306-8966-1026bfb9750f-openshift-service-ca\") pod \"bd0b0302-362a-4306-8966-1026bfb9750f\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") "
Jul 24 13:41:23.162153 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.162066    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls\") pod \"bd0b0302-362a-4306-8966-1026bfb9750f\" (UID: \"bd0b0302-362a-4306-8966-1026bfb9750f\") "
Jul 24 13:41:23.162491 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.162458    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd0b0302-362a-4306-8966-1026bfb9750f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd0b0302-362a-4306-8966-1026bfb9750f" (UID: "bd0b0302-362a-4306-8966-1026bfb9750f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:23.164314 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.164285    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd0b0302-362a-4306-8966-1026bfb9750f-kube-api-access-m9n2g" (OuterVolumeSpecName: "kube-api-access-m9n2g") pod "bd0b0302-362a-4306-8966-1026bfb9750f" (UID: "bd0b0302-362a-4306-8966-1026bfb9750f"). InnerVolumeSpecName "kube-api-access-m9n2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:41:23.164562 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.164458    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd0b0302-362a-4306-8966-1026bfb9750f" (UID: "bd0b0302-362a-4306-8966-1026bfb9750f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:23.263049 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.263014    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9n2g\" (UniqueName: \"kubernetes.io/projected/bd0b0302-362a-4306-8966-1026bfb9750f-kube-api-access-m9n2g\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:23.263049 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.263044    2528 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0b0302-362a-4306-8966-1026bfb9750f-openshift-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:23.263260 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:23.263059    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd0b0302-362a-4306-8966-1026bfb9750f-maas-api-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:24.011341 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:24.011312    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"
Jul 24 13:41:24.011341 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:24.011333    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz" event={"ID":"bd0b0302-362a-4306-8966-1026bfb9750f","Type":"ContainerDied","Data":"762dbd22f21cb5f6503325938f4905a6f1d441abaa11ccad5ae98495e3555dad"}
Jul 24 13:41:24.011825 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:24.011386    2528 scope.go:117] "RemoveContainer" containerID="542900d45a5a9ff18e47dabf974505c1544add19691e686722a04fdf8cc91526"
Jul 24 13:41:24.059790 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:24.059765    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"]
Jul 24 13:41:24.064850 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:24.064831    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-472106-546c5cbc89-4v2nz"]
Jul 24 13:41:25.640807 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:25.640771    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd0b0302-362a-4306-8966-1026bfb9750f" path="/var/lib/kubelet/pods/bd0b0302-362a-4306-8966-1026bfb9750f/volumes"
Jul 24 13:41:27.391034 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:27.390996    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"]
Jul 24 13:41:27.394213 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:27.394185    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-472106-zw4zp"]
Jul 24 13:41:27.636828 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:27.636795    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4c40571-1a1e-4b0b-b761-c79d5805abee" path="/var/lib/kubelet/pods/e4c40571-1a1e-4b0b-b761-c79d5805abee/volumes"
Jul 24 13:41:34.882160 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:34.882125    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"]
Jul 24 13:41:34.882613 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:34.882332    2528 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy" containerID="cri-o://4a7b5d5d80f369b24925d3b87c43ba8de5470a766aba60387f8d1802c47cfc76" gracePeriod=30
Jul 24 13:41:35.267747 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.267711    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"]
Jul 24 13:41:35.268189 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.268175    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd0b0302-362a-4306-8966-1026bfb9750f" containerName="maas-api"
Jul 24 13:41:35.268189 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.268191    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd0b0302-362a-4306-8966-1026bfb9750f" containerName="maas-api"
Jul 24 13:41:35.268291 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.268209    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c40571-1a1e-4b0b-b761-c79d5805abee" containerName="revoke-keys"
Jul 24 13:41:35.268291 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.268215    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c40571-1a1e-4b0b-b761-c79d5805abee" containerName="revoke-keys"
Jul 24 13:41:35.268291 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.268286    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4c40571-1a1e-4b0b-b761-c79d5805abee" containerName="revoke-keys"
Jul 24 13:41:35.268387 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.268297    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd0b0302-362a-4306-8966-1026bfb9750f" containerName="maas-api"
Jul 24 13:41:35.271598 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.271584    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"
Jul 24 13:41:35.274053 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.274024    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:41:35.279752 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.279649    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"]
Jul 24 13:41:35.341860 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.341830    2528 patch_prober.go:28] interesting pod/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 13:41:35.342012 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.341886    2528 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 13:41:35.379139 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.379081    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2747ae21-90c1-4f22-947f-c5a49143dcec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l\" (UID: \"2747ae21-90c1-4f22-947f-c5a49143dcec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"
Jul 24 13:41:35.480425 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.480385    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2747ae21-90c1-4f22-947f-c5a49143dcec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l\" (UID: \"2747ae21-90c1-4f22-947f-c5a49143dcec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"
Jul 24 13:41:35.481044 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.481019    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2747ae21-90c1-4f22-947f-c5a49143dcec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l\" (UID: \"2747ae21-90c1-4f22-947f-c5a49143dcec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"
Jul 24 13:41:35.584050 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.583955    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"
Jul 24 13:41:35.731811 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:35.731779    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"]
Jul 24 13:41:35.733510 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:41:35.733479    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2747ae21_90c1_4f22_947f_c5a49143dcec.slice/crio-b9b7bd6bc20e96e3c304c243d4275013bab4e3711d4e88f1d12c7ccd4ab9f06d WatchSource:0}: Error finding container b9b7bd6bc20e96e3c304c243d4275013bab4e3711d4e88f1d12c7ccd4ab9f06d: Status 404 returned error can't find the container with id b9b7bd6bc20e96e3c304c243d4275013bab4e3711d4e88f1d12c7ccd4ab9f06d
Jul 24 13:41:36.077414 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:36.077373    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l" event={"ID":"2747ae21-90c1-4f22-947f-c5a49143dcec","Type":"ContainerStarted","Data":"b089e0101f133683a973c6fd6737a188f7fb58f6226a423bfb783ea9403f7385"}
Jul 24 13:41:36.077802 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:36.077438    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l" event={"ID":"2747ae21-90c1-4f22-947f-c5a49143dcec","Type":"ContainerStarted","Data":"b9b7bd6bc20e96e3c304c243d4275013bab4e3711d4e88f1d12c7ccd4ab9f06d"}
Jul 24 13:41:36.096217 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:36.096166    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l" podStartSLOduration=1.096150886 podStartE2EDuration="1.096150886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:41:36.094049821 +0000 UTC m=+2926.961284852" watchObservedRunningTime="2026-07-24 13:41:36.096150886 +0000 UTC m=+2926.963385916"
Jul 24 13:41:37.084217 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:37.084183    2528 generic.go:356] "Generic (PLEG): container finished" podID="2747ae21-90c1-4f22-947f-c5a49143dcec" containerID="b089e0101f133683a973c6fd6737a188f7fb58f6226a423bfb783ea9403f7385" exitCode=0
Jul 24 13:41:37.084641 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:37.084272    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l" event={"ID":"2747ae21-90c1-4f22-947f-c5a49143dcec","Type":"ContainerDied","Data":"b089e0101f133683a973c6fd6737a188f7fb58f6226a423bfb783ea9403f7385"}
Jul 24 13:41:38.229807 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:38.229781    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"
Jul 24 13:41:38.311174 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:38.311150    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2747ae21-90c1-4f22-947f-c5a49143dcec-maas-api-service-ca\") pod \"2747ae21-90c1-4f22-947f-c5a49143dcec\" (UID: \"2747ae21-90c1-4f22-947f-c5a49143dcec\") "
Jul 24 13:41:38.311467 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:38.311447    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2747ae21-90c1-4f22-947f-c5a49143dcec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2747ae21-90c1-4f22-947f-c5a49143dcec" (UID: "2747ae21-90c1-4f22-947f-c5a49143dcec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:38.412675 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:38.412646    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2747ae21-90c1-4f22-947f-c5a49143dcec-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:39.095957 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:39.095929    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"
Jul 24 13:41:39.095957 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:39.095929    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l" event={"ID":"2747ae21-90c1-4f22-947f-c5a49143dcec","Type":"ContainerDied","Data":"b9b7bd6bc20e96e3c304c243d4275013bab4e3711d4e88f1d12c7ccd4ab9f06d"}
Jul 24 13:41:39.096177 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:39.095980    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9b7bd6bc20e96e3c304c243d4275013bab4e3711d4e88f1d12c7ccd4ab9f06d"
Jul 24 13:41:40.105164 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.105127    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" event={"ID":"89c5be30-58f0-4c86-a64f-181895616d1d","Type":"ContainerDied","Data":"4a7b5d5d80f369b24925d3b87c43ba8de5470a766aba60387f8d1802c47cfc76"}
Jul 24 13:41:40.105632 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.105201    2528 scope.go:117] "RemoveContainer" containerID="dbad898ca7e56c02b9a67c3acb9d77044350540f87e5f294dde42d603ade1532"
Jul 24 13:41:40.105632 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.105127    2528 generic.go:356] "Generic (PLEG): container finished" podID="89c5be30-58f0-4c86-a64f-181895616d1d" containerID="4a7b5d5d80f369b24925d3b87c43ba8de5470a766aba60387f8d1802c47cfc76" exitCode=0
Jul 24 13:41:40.140659 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.140635    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:41:40.230135 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230076    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c5be30-58f0-4c86-a64f-181895616d1d-istio-podinfo\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230324 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230140    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c5be30-58f0-4c86-a64f-181895616d1d-istiod-ca-cert\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230324 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230196    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-certs\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230324 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230224    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-istio-token\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230324 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230265    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-data\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230324 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230291    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncpx9\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-kube-api-access-ncpx9\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230725 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230329    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-credential-socket\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230725 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230359    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-envoy\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230725 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230397    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-socket\") pod \"89c5be30-58f0-4c86-a64f-181895616d1d\" (UID: \"89c5be30-58f0-4c86-a64f-181895616d1d\") "
Jul 24 13:41:40.230725 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230560    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:41:40.230725 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230642    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89c5be30-58f0-4c86-a64f-181895616d1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:40.230999 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.230773    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:41:40.231110 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.231070    2528 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:40.231182 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.231113    2528 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c5be30-58f0-4c86-a64f-181895616d1d-istiod-ca-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:40.231182 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.231129    2528 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-workload-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:40.231467 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.231448    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:41:40.231741 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.231718    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:41:40.233018 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.232994    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:41:40.233018 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.233017    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89c5be30-58f0-4c86-a64f-181895616d1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 13:41:40.233255 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.233225    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-kube-api-access-ncpx9" (OuterVolumeSpecName: "kube-api-access-ncpx9") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "kube-api-access-ncpx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:41:40.233493 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.233468    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89c5be30-58f0-4c86-a64f-181895616d1d" (UID: "89c5be30-58f0-4c86-a64f-181895616d1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:41:40.332010 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.331976    2528 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c5be30-58f0-4c86-a64f-181895616d1d-istio-podinfo\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:40.332010 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.332002    2528 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-istio-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:40.332010 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.332011    2528 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:40.332010 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.332019    2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncpx9\" (UniqueName: \"kubernetes.io/projected/89c5be30-58f0-4c86-a64f-181895616d1d-kube-api-access-ncpx9\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:40.332301 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.332029    2528 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-credential-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:40.332301 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:40.332037    2528 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c5be30-58f0-4c86-a64f-181895616d1d-istio-envoy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:41:41.112017 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:41.111987    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"
Jul 24 13:41:41.112017 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:41.112010    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7" event={"ID":"89c5be30-58f0-4c86-a64f-181895616d1d","Type":"ContainerDied","Data":"fe449bc909ea295f4f157d98596f01980768e2c5d651e86d1fb6c57f02b23902"}
Jul 24 13:41:41.112525 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:41.112068    2528 scope.go:117] "RemoveContainer" containerID="4a7b5d5d80f369b24925d3b87c43ba8de5470a766aba60387f8d1802c47cfc76"
Jul 24 13:41:41.135126 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:41.135085    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"]
Jul 24 13:41:41.139373 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:41.139350    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-472106-openshift-default-64798cc68d-gtqt7"]
Jul 24 13:41:41.633385 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:41.633353    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" path="/var/lib/kubelet/pods/89c5be30-58f0-4c86-a64f-181895616d1d/volumes"
Jul 24 13:41:50.370267 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:50.370184    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"]
Jul 24 13:41:50.373075 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:50.373051    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f3a913-vc86l"]
Jul 24 13:41:51.633265 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:51.633234    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2747ae21-90c1-4f22-947f-c5a49143dcec" path="/var/lib/kubelet/pods/2747ae21-90c1-4f22-947f-c5a49143dcec/volumes"
Jul 24 13:41:58.146671 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.146623    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"]
Jul 24 13:41:58.147236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.147078    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy"
Jul 24 13:41:58.147236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.147113    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy"
Jul 24 13:41:58.147236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.147123    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2747ae21-90c1-4f22-947f-c5a49143dcec" containerName="revoke-keys"
Jul 24 13:41:58.147236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.147129    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="2747ae21-90c1-4f22-947f-c5a49143dcec" containerName="revoke-keys"
Jul 24 13:41:58.147236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.147163    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy"
Jul 24 13:41:58.147236 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.147173    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy"
Jul 24 13:41:58.147481 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.147251    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy"
Jul 24 13:41:58.147481 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.147266    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="2747ae21-90c1-4f22-947f-c5a49143dcec" containerName="revoke-keys"
Jul 24 13:41:58.150542 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.150524    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"
Jul 24 13:41:58.152967 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.152947    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l7xjs\""
Jul 24 13:41:58.158779 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.158750    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"]
Jul 24 13:41:58.296102 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.296064    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4b1a00-7a2c-435d-8d70-c5b585c923cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68\" (UID: \"ff4b1a00-7a2c-435d-8d70-c5b585c923cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"
Jul 24 13:41:58.397813 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.397728    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4b1a00-7a2c-435d-8d70-c5b585c923cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68\" (UID: \"ff4b1a00-7a2c-435d-8d70-c5b585c923cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"
Jul 24 13:41:58.398361 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.398343    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4b1a00-7a2c-435d-8d70-c5b585c923cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68\" (UID: \"ff4b1a00-7a2c-435d-8d70-c5b585c923cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"
Jul 24 13:41:58.462770 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.462736    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"
Jul 24 13:41:58.606542 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:58.606519    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"]
Jul 24 13:41:58.608657 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:41:58.608631    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4b1a00_7a2c_435d_8d70_c5b585c923cc.slice/crio-f8192c178322a006af8eaff67844850e60a76541b74f8b5230ba23e5bc86e722 WatchSource:0}: Error finding container f8192c178322a006af8eaff67844850e60a76541b74f8b5230ba23e5bc86e722: Status 404 returned error can't find the container with id f8192c178322a006af8eaff67844850e60a76541b74f8b5230ba23e5bc86e722
Jul 24 13:41:59.214435 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:59.214400    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68" event={"ID":"ff4b1a00-7a2c-435d-8d70-c5b585c923cc","Type":"ContainerStarted","Data":"ca1cf6480a5b913fe71294e27ec22745888feaaefe17344dc1167f457ea5ff96"}
Jul 24 13:41:59.214846 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:59.214451    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68" event={"ID":"ff4b1a00-7a2c-435d-8d70-c5b585c923cc","Type":"ContainerStarted","Data":"f8192c178322a006af8eaff67844850e60a76541b74f8b5230ba23e5bc86e722"}
Jul 24 13:41:59.234584 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:41:59.234537    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68" podStartSLOduration=1.23452211 podStartE2EDuration="1.23452211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:41:59.233469059 +0000 UTC m=+2950.100704092" watchObservedRunningTime="2026-07-24 13:41:59.23452211 +0000 UTC m=+2950.101757140"
Jul 24 13:42:00.223893 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:00.223854    2528 generic.go:356] "Generic (PLEG): container finished" podID="ff4b1a00-7a2c-435d-8d70-c5b585c923cc" containerID="ca1cf6480a5b913fe71294e27ec22745888feaaefe17344dc1167f457ea5ff96" exitCode=0
Jul 24 13:42:00.224336 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:00.223944    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68" event={"ID":"ff4b1a00-7a2c-435d-8d70-c5b585c923cc","Type":"ContainerDied","Data":"ca1cf6480a5b913fe71294e27ec22745888feaaefe17344dc1167f457ea5ff96"}
Jul 24 13:42:01.364469 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:01.364445    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"
Jul 24 13:42:01.426441 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:01.426404    2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4b1a00-7a2c-435d-8d70-c5b585c923cc-maas-api-service-ca\") pod \"ff4b1a00-7a2c-435d-8d70-c5b585c923cc\" (UID: \"ff4b1a00-7a2c-435d-8d70-c5b585c923cc\") "
Jul 24 13:42:01.426764 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:01.426739    2528 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff4b1a00-7a2c-435d-8d70-c5b585c923cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ff4b1a00-7a2c-435d-8d70-c5b585c923cc" (UID: "ff4b1a00-7a2c-435d-8d70-c5b585c923cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:42:01.527673 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:01.527599    2528 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff4b1a00-7a2c-435d-8d70-c5b585c923cc-maas-api-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 24 13:42:02.235680 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:02.235648    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68" event={"ID":"ff4b1a00-7a2c-435d-8d70-c5b585c923cc","Type":"ContainerDied","Data":"f8192c178322a006af8eaff67844850e60a76541b74f8b5230ba23e5bc86e722"}
Jul 24 13:42:02.235856 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:02.235701    2528 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8192c178322a006af8eaff67844850e60a76541b74f8b5230ba23e5bc86e722"
Jul 24 13:42:02.235856 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:02.235657    2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"
Jul 24 13:42:13.265505 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:13.265423    2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"]
Jul 24 13:42:13.270614 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:13.270586    2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b1a3df-bmj68"]
Jul 24 13:42:13.634208 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:13.634138    2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff4b1a00-7a2c-435d-8d70-c5b585c923cc" path="/var/lib/kubelet/pods/ff4b1a00-7a2c-435d-8d70-c5b585c923cc/volumes"
Jul 24 13:42:28.037257 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:28.037226    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dwwb4_9174687c-e29e-4bf6-ac97-b4e4c9ab5cff/manager/0.log"
Jul 24 13:42:28.159778 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:28.159743    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9lt2p_7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2/manager/0.log"
Jul 24 13:42:28.404711 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:28.404633    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nnrzz_77dcfa9d-18fd-4e95-9d22-0f7baf275470/server/0.log"
Jul 24 13:42:28.765768 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:28.765737    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77bd76cdcf-sdjqn_63a2786d-a0a9-44bc-bd33-6f6600f9729c/copy-manifests/0.log"
Jul 24 13:42:28.774541 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:28.774515    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77bd76cdcf-sdjqn_63a2786d-a0a9-44bc-bd33-6f6600f9729c/manager/0.log"
Jul 24 13:42:29.273769 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:29.273738    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f5b677486-srfqc_a731ca4b-beb3-4ca8-936e-656c77bf4bfe/maas-api/0.log"
Jul 24 13:42:29.503852 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:29.503825    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748330-8rm65_4882d932-1635-4a2a-abd1-e08f04f86c85/cleanup/0.log"
Jul 24 13:42:29.618791 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:29.618709    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-22jhs_2f440687-f787-415f-8343-952004849928/postgres/0.log"
Jul 24 13:42:31.798635 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:31.794473    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ds8ln_f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96/manager/0.log"
Jul 24 13:42:32.287366 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:32.287333    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fjwlw_0158efa3-0191-4066-938c-85ed6a869bd2/discovery/0.log"
Jul 24 13:42:32.530424 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:32.530396    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6cb77c89-mdszj_f73a5cd2-2ab0-41ae-a39f-c4dd7b197951/kube-auth-proxy/0.log"
Jul 24 13:42:32.786333 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:32.786302    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ns69l_4884f871-f84c-4eea-9d61-04afaf71c072/payload-pre-processing/0.log"
Jul 24 13:42:32.911556 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:32.911523    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-nsl7k_d887a244-c888-4d7a-bb2e-3e00a06d5dea/payload-processing/0.log"
Jul 24 13:42:33.027037 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:33.027012    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bff7c44df-l6pz9_5719331e-0d15-4d71-ba61-f8203424fe14/router/0.log"
Jul 24 13:42:33.376296 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:33.376260    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pvjlj_583bbb93-3c8d-4edf-be59-9c2cf792eb97/main/0.log"
Jul 24 13:42:33.727613 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:33.727567    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhzcdl_a8593a7c-bbf4-4de9-a38f-4510c5117669/main/0.log"
Jul 24 13:42:33.843566 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:33.843540    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-t44kd_35812892-3ee2-4ae8-9f78-6aa50509294c/main/0.log"
Jul 24 13:42:42.509789 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:42.509727    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b28qt_b0a70d49-090c-4dc3-98f3-85619a05c775/global-pull-secret-syncer/0.log"
Jul 24 13:42:42.727761 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:42.727725    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-phqqp_6acfad45-c25e-49b1-8377-5c091d68f531/konnectivity-agent/0.log"
Jul 24 13:42:42.831760 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:42.831700    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-90.ec2.internal_bb76d54528df2ec80109e1b71d5a8ae3/haproxy/0.log"
Jul 24 13:42:48.086596 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:48.086565    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ds8ln_f3499ef0-5539-4b6a-bb1c-25bf7b0a9b96/manager/0.log"
Jul 24 13:42:49.901285 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:49.901254    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-j74fb_4c7a0e2e-be87-44c0-8e86-c0d305ef70f4/cluster-monitoring-operator/0.log"
Jul 24 13:42:49.909469 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:49.909447    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:42:49.919285 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:49.919260    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:42:49.939464 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:49.939440    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-khttx_8c91953d-d93a-41fa-993a-e7ed6b434918/kube-state-metrics/0.log"
Jul 24 13:42:49.963012 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:49.962987    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-khttx_8c91953d-d93a-41fa-993a-e7ed6b434918/kube-rbac-proxy-main/0.log"
Jul 24 13:42:49.992670 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:49.992640    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-khttx_8c91953d-d93a-41fa-993a-e7ed6b434918/kube-rbac-proxy-self/0.log"
Jul 24 13:42:50.027268 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.027249    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d75766b95-v5bfq_2edbf262-df42-4663-b0db-d84914dfede5/metrics-server/0.log"
Jul 24 13:42:50.109432 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.109409    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh5xb_90b58ab2-1c76-47b9-9bef-272dec6929ba/node-exporter/0.log"
Jul 24 13:42:50.142235 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.142216    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh5xb_90b58ab2-1c76-47b9-9bef-272dec6929ba/kube-rbac-proxy/0.log"
Jul 24 13:42:50.179959 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.179941    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh5xb_90b58ab2-1c76-47b9-9bef-272dec6929ba/init-textfile/0.log"
Jul 24 13:42:50.404447 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.404423    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-57gtd_7c2e9b57-e5a6-4810-80ca-2f980cf0d41a/kube-rbac-proxy-main/0.log"
Jul 24 13:42:50.435468 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.435408    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-57gtd_7c2e9b57-e5a6-4810-80ca-2f980cf0d41a/kube-rbac-proxy-self/0.log"
Jul 24 13:42:50.470971 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.470948    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-57gtd_7c2e9b57-e5a6-4810-80ca-2f980cf0d41a/openshift-state-metrics/0.log"
Jul 24 13:42:50.835884 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.835804    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd4499d78-jwjn9_bda193db-614f-4bdc-80de-25a081e84996/telemeter-client/0.log"
Jul 24 13:42:50.874683 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.874665    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd4499d78-jwjn9_bda193db-614f-4bdc-80de-25a081e84996/reload/0.log"
Jul 24 13:42:50.900668 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.900647    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bd4499d78-jwjn9_bda193db-614f-4bdc-80de-25a081e84996/kube-rbac-proxy/0.log"
Jul 24 13:42:50.933078 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.933056    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bf4698d4d-5lpbp_8b8ebb39-cfe7-4c42-8b84-46bb55a8f613/thanos-query/0.log"
Jul 24 13:42:50.960542 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.960524    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bf4698d4d-5lpbp_8b8ebb39-cfe7-4c42-8b84-46bb55a8f613/kube-rbac-proxy-web/0.log"
Jul 24 13:42:50.985774 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:50.985754    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bf4698d4d-5lpbp_8b8ebb39-cfe7-4c42-8b84-46bb55a8f613/kube-rbac-proxy/0.log"
Jul 24 13:42:51.010655 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:51.010637    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bf4698d4d-5lpbp_8b8ebb39-cfe7-4c42-8b84-46bb55a8f613/prom-label-proxy/0.log"
Jul 24 13:42:51.069933 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:51.069912    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bf4698d4d-5lpbp_8b8ebb39-cfe7-4c42-8b84-46bb55a8f613/kube-rbac-proxy-rules/0.log"
Jul 24 13:42:51.124741 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:51.124686    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bf4698d4d-5lpbp_8b8ebb39-cfe7-4c42-8b84-46bb55a8f613/kube-rbac-proxy-metrics/0.log"
Jul 24 13:42:52.085408 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.085376    2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"]
Jul 24 13:42:52.085796 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.085783    2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff4b1a00-7a2c-435d-8d70-c5b585c923cc" containerName="revoke-keys"
Jul 24 13:42:52.085796 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.085797    2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff4b1a00-7a2c-435d-8d70-c5b585c923cc" containerName="revoke-keys"
Jul 24 13:42:52.085886 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.085878    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff4b1a00-7a2c-435d-8d70-c5b585c923cc" containerName="revoke-keys"
Jul 24 13:42:52.085923 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.085890    2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="89c5be30-58f0-4c86-a64f-181895616d1d" containerName="istio-proxy"
Jul 24 13:42:52.090118 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.090081    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.092428 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.092400    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qx26j\"/\"openshift-service-ca.crt\""
Jul 24 13:42:52.092557 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.092453    2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qx26j\"/\"kube-root-ca.crt\""
Jul 24 13:42:52.092557 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.092521    2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qx26j\"/\"default-dockercfg-mg26v\""
Jul 24 13:42:52.100819 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.100794    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"]
Jul 24 13:42:52.165257 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.165230    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-podres\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.165399 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.165264    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bm2q\" (UniqueName: \"kubernetes.io/projected/a2ba0087-7ded-4db1-8aaf-a43a18191795-kube-api-access-4bm2q\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.165399 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.165300    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-proc\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.165399 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.165327    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-sys\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.165399 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.165348    2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-lib-modules\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266276 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266249    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-proc\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266395 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266288    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-sys\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266395 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266350    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-sys\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266395 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266356    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-proc\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266395 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266373    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-lib-modules\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266560 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266440    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-podres\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266560 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266447    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-lib-modules\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266560 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266461    2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bm2q\" (UniqueName: \"kubernetes.io/projected/a2ba0087-7ded-4db1-8aaf-a43a18191795-kube-api-access-4bm2q\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.266560 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.266500    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2ba0087-7ded-4db1-8aaf-a43a18191795-podres\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.276494 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.276467    2528 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bm2q\" (UniqueName: \"kubernetes.io/projected/a2ba0087-7ded-4db1-8aaf-a43a18191795-kube-api-access-4bm2q\") pod \"perf-node-gather-daemonset-k28f7\" (UID: \"a2ba0087-7ded-4db1-8aaf-a43a18191795\") " pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.401721 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.401660    2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:52.540350 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:52.540329    2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"]
Jul 24 13:42:52.544776 ip-10-0-134-90 kubenswrapper[2528]: W0724 13:42:52.544749    2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2ba0087_7ded_4db1_8aaf_a43a18191795.slice/crio-e39210d07f743afe74be6b8a833025cf751634c7e07479d8e9cfa0440317e38a WatchSource:0}: Error finding container e39210d07f743afe74be6b8a833025cf751634c7e07479d8e9cfa0440317e38a: Status 404 returned error can't find the container with id e39210d07f743afe74be6b8a833025cf751634c7e07479d8e9cfa0440317e38a
Jul 24 13:42:53.082579 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:53.082554    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/1.log"
Jul 24 13:42:53.089904 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:53.089867    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dl4wk_722a7257-aa02-4fa6-bfd3-eb82f8fcfdb8/console-operator/2.log"
Jul 24 13:42:53.516787 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:53.516759    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7" event={"ID":"a2ba0087-7ded-4db1-8aaf-a43a18191795","Type":"ContainerStarted","Data":"f56846151dabf6cf8bdd3d103b0c0b08fe1b4e0195c7767a2bf6e2d3a0500f8d"}
Jul 24 13:42:53.516959 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:53.516812    2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7" event={"ID":"a2ba0087-7ded-4db1-8aaf-a43a18191795","Type":"ContainerStarted","Data":"e39210d07f743afe74be6b8a833025cf751634c7e07479d8e9cfa0440317e38a"}
Jul 24 13:42:53.516959 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:53.516872    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:42:53.534829 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:53.534770    2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7" podStartSLOduration=1.53475658 podStartE2EDuration="1.53475658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:42:53.533873808 +0000 UTC m=+3004.401108840" watchObservedRunningTime="2026-07-24 13:42:53.53475658 +0000 UTC m=+3004.401991609"
Jul 24 13:42:54.251785 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:54.251756    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-gzl8q_b967ff7e-a6c1-4f96-8ea8-1fa08c1208dd/volume-data-source-validator/0.log"
Jul 24 13:42:55.403950 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:55.403919    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xmmx9_3c542e6f-6258-452c-a767-15d3f8b4db1d/dns/0.log"
Jul 24 13:42:55.427119 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:55.427070    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xmmx9_3c542e6f-6258-452c-a767-15d3f8b4db1d/kube-rbac-proxy/0.log"
Jul 24 13:42:55.507380 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:55.507349    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xtv6m_b83ced7e-49b7-4e77-8409-5cb62fa48bfd/dns-node-resolver/0.log"
Jul 24 13:42:56.142945 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:56.142918    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrnvm_6b5d92cd-a6d1-4203-b62f-19b8d8d313df/node-ca/0.log"
Jul 24 13:42:57.437285 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:57.437245    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fjwlw_0158efa3-0191-4066-938c-85ed6a869bd2/discovery/0.log"
Jul 24 13:42:57.488133 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:57.488084    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6cb77c89-mdszj_f73a5cd2-2ab0-41ae-a39f-c4dd7b197951/kube-auth-proxy/0.log"
Jul 24 13:42:57.596983 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:57.596943    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ns69l_4884f871-f84c-4eea-9d61-04afaf71c072/payload-pre-processing/0.log"
Jul 24 13:42:57.636003 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:57.635970    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-nsl7k_d887a244-c888-4d7a-bb2e-3e00a06d5dea/payload-processing/0.log"
Jul 24 13:42:57.663680 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:57.663654    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bff7c44df-l6pz9_5719331e-0d15-4d71-ba61-f8203424fe14/router/0.log"
Jul 24 13:42:58.513163 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:58.513124    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cm4kb_098474b9-bea8-400b-8b57-45594e62d0a5/serve-healthcheck-canary/0.log"
Jul 24 13:42:59.031170 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:59.031128    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-krmkk_a2bd0efd-2ad2-4ac9-999a-6755c799edfd/insights-operator/0.log"
Jul 24 13:42:59.032379 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:59.032359    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-krmkk_a2bd0efd-2ad2-4ac9-999a-6755c799edfd/insights-operator/1.log"
Jul 24 13:42:59.180209 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:59.180178    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dz76g_6b6a8507-1e6a-4296-ad33-6eab919f852a/kube-rbac-proxy/0.log"
Jul 24 13:42:59.207179 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:59.207153    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dz76g_6b6a8507-1e6a-4296-ad33-6eab919f852a/exporter/0.log"
Jul 24 13:42:59.237444 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:59.237413    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dz76g_6b6a8507-1e6a-4296-ad33-6eab919f852a/extractor/0.log"
Jul 24 13:42:59.532933 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:42:59.532909    2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qx26j/perf-node-gather-daemonset-k28f7"
Jul 24 13:43:01.672106 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:01.672070    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dwwb4_9174687c-e29e-4bf6-ac97-b4e4c9ab5cff/manager/0.log"
Jul 24 13:43:02.032640 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.032612    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9lt2p_7c5f1a61-bb61-4eda-89f5-cfd572ddc0e2/manager/0.log"
Jul 24 13:43:02.321863 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.321772    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nnrzz_77dcfa9d-18fd-4e95-9d22-0f7baf275470/server/0.log"
Jul 24 13:43:02.472145 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.472080    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fjwlw_0158efa3-0191-4066-938c-85ed6a869bd2/discovery/0.log"
Jul 24 13:43:02.499948 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.499927    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6cb77c89-mdszj_f73a5cd2-2ab0-41ae-a39f-c4dd7b197951/kube-auth-proxy/0.log"
Jul 24 13:43:02.524379 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.524356    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77bd76cdcf-sdjqn_63a2786d-a0a9-44bc-bd33-6f6600f9729c/manager/0.log"
Jul 24 13:43:02.553661 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.553644    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77bd76cdcf-sdjqn_63a2786d-a0a9-44bc-bd33-6f6600f9729c/copy-manifests/0.log"
Jul 24 13:43:02.585883 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.585790    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ns69l_4884f871-f84c-4eea-9d61-04afaf71c072/payload-pre-processing/0.log"
Jul 24 13:43:02.615335 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.615306    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-nsl7k_d887a244-c888-4d7a-bb2e-3e00a06d5dea/payload-processing/0.log"
Jul 24 13:43:02.635392 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:02.635358    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bff7c44df-l6pz9_5719331e-0d15-4d71-ba61-f8203424fe14/router/0.log"
Jul 24 13:43:04.356455 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:04.356430    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fjwlw_0158efa3-0191-4066-938c-85ed6a869bd2/discovery/0.log"
Jul 24 13:43:04.397751 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:04.397723    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6cb77c89-mdszj_f73a5cd2-2ab0-41ae-a39f-c4dd7b197951/kube-auth-proxy/0.log"
Jul 24 13:43:04.499796 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:04.499768    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ns69l_4884f871-f84c-4eea-9d61-04afaf71c072/payload-pre-processing/0.log"
Jul 24 13:43:04.532275 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:04.532255    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-nsl7k_d887a244-c888-4d7a-bb2e-3e00a06d5dea/payload-processing/0.log"
Jul 24 13:43:04.553437 ip-10-0-134-90 kubenswrapper[2528]: I0724 13:43:04.553391    2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bff7c44df-l6pz9_5719331e-0d15-4d71-ba61-f8203424fe14/router/0.log"