Jul 06 23:22:39.065291 ip-10-0-138-34 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 23:22:39.065303 ip-10-0-138-34 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 23:22:39.065313 ip-10-0-138-34 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 23:22:39.065692 ip-10-0-138-34 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 23:22:49.124311 ip-10-0-138-34 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 23:22:49.124328 ip-10-0-138-34 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c9ce34897d9743f8bfa085df3f7b0b70 --
Jul 06 23:24:43.519140 ip-10-0-138-34 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 23:24:43.920320 ip-10-0-138-34 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:24:43.920320 ip-10-0-138-34 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 23:24:43.920320 ip-10-0-138-34 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:24:43.920320 ip-10-0-138-34 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 23:24:43.920320 ip-10-0-138-34 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:24:43.923436 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.923322    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 23:24:43.931893 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931854    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:24:43.931893 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931890    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:24:43.931893 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931894    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:24:43.931893 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931898    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:24:43.931893 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931901    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931905    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931908    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931911    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931913    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931916    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931918    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931921    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931923    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931925    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931928    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931930    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931933    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931936    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931938    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931941    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931943    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931946    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931948    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931950    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:24:43.932094 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931953    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931956    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931958    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931961    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931963    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931966    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931968    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931976    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931979    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931981    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931984    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931986    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931989    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931992    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931995    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.931997    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932000    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932002    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932005    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:24:43.932561 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932007    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932010    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932012    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932014    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932017    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932019    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932022    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932024    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932027    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932030    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932033    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932035    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932038    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932040    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932042    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932045    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932047    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932050    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932052    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932056    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:24:43.933058 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932058    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932061    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932063    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932065    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932067    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932070    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932073    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932076    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932079    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932081    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932085    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932088    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932091    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932094    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932097    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932099    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932102    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932105    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932108    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:24:43.933532 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932112    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932116    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932119    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932122    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932124    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932127    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932129    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932132    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932134    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932137    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932139    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932142    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932144    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932147    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932149    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932152    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:24:43.934008 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.932154    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:24:43.934721 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934707    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:24:43.934721 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934721    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934724    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934727    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934730    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934733    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934736    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934739    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934741    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934744    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934746    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934749    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934752    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934755    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934758    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934760    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934763    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934766    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934769    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934771    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934774    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:24:43.934776 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934776    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934779    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934781    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934784    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934787    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934790    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934793    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934795    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934798    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934800    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934802    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934805    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934807    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934810    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934812    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934814    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934817    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934819    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934821    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:24:43.935293 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934825    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934827    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934830    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934832    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934835    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934837    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934839    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934842    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934844    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934847    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934850    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934852    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934854    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934876    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934880    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934883    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934886    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934888    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934891    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:24:43.935756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934894    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934898    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934901    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934904    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934907    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934910    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934912    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934915    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934917    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934922    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934925    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934928    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934931    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934934    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934936    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934939    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934941    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934944    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934946    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934948    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:24:43.936235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934951    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934953    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934956    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934958    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934961    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934963    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934965    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934968    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934972    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934974    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934977    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934979    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934981    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934985    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934988    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934991    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934993    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934996    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.934998    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935000    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:24:43.936715 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935414    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935420    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935423    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935426    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935429    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935432    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935435    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935438    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935440    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935444    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935448    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935450    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935453    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935456    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935459    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935461    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935464    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935467    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935470    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:24:43.937221 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935472    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935476    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935479    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935482    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935486    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935489    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935491    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935494    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935496    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935498    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935501    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935503    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935506    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935508    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935510    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935513    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935515    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935517    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935520    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:24:43.937667 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935522    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935524    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935527    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935529    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935531    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935534    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935536    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935538    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935540    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935543    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935545    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935548    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935550    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935552    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935556    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935559    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935561    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935564    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935566    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935570    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:24:43.938135 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935573    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935576    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935578    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935581    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935583    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935586    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935589    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935591    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935595    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935597    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935600    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935602    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935604    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935607    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935609    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935611    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935614    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935616    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935619    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935621    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:24:43.938626 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935623    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935626    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935628    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935631    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935634    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935636    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935640    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935642    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935645    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935647    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935649    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935652    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935655    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935658    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935660    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935663    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935665    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935668    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935670    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935673    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:24:43.939120 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.935676    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935757    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935767    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935777    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935783    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935789    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935792    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935796    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935800    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935803    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935806    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935809    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935812    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935815    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935818    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935821    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935824    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935828    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935831    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935835    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935837    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935840    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935843    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935846    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 23:24:43.939638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935850    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935852    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935855    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935875    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935878    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935881    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935884    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935887    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935890    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935894    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935897    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935899    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935902    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935905    2579 flags.go:64] FLAG: --enable-server="true"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935907    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935912    2579 flags.go:64] FLAG: --event-burst="100"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935914    2579 flags.go:64] FLAG: --event-qps="50"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935917    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935920    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935922    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935926    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935929    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935932    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935934    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935937    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 23:24:43.940219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935940    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935943    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935946    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935949    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935952    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935955    2579 flags.go:64] FLAG: --feature-gates=""
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935958    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935961    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935964    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935967    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935969    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935972    2579 flags.go:64] FLAG: --help="false"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935975    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-34.ec2.internal"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935978    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935980    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935983    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935986    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935989    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935992    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935995    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.935997    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936000    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936003    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936005    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 23:24:43.940824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936008    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936011    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936013    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936016    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936018    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936021    2579 flags.go:64] FLAG: --lock-file=""
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936023    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936028    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936031    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936037    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936040    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936043    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936045    2579 flags.go:64] FLAG: --logging-format="text"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936048    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936051    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936053    2579 flags.go:64] FLAG: --manifest-url=""
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936056    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936060    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936063    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936067    2579 flags.go:64] FLAG: --max-pods="110"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936070    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936072    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936075    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936078    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936080    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 23:24:43.941418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936083    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936086    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936092    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936095    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936098    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936101    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936103    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936109    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936112    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936114    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936117    2579 flags.go:64] FLAG: --port="10250"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936120    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936122    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0efb8e28fb9bf51aa"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936125    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936129    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936132    2579 flags.go:64] FLAG: --register-node="true"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936135    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936138    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936141    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936144    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936146    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936150    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936153    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936156    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936158    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 23:24:43.942053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936161    2579 flags.go:64] FLAG: --runonce="false"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936164    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936166    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936169    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936172    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936176    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936178    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936181    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936184    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936187    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936189    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936192    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936194    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936197    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936200    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936202    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936207    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936210    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936212    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936216    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936219    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936222    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936225    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936228    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936231    2579 flags.go:64] FLAG: --v="2"
Jul 06 23:24:43.942704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936234    2579 flags.go:64] FLAG: --version="false"
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936239    2579 flags.go:64] FLAG: --vmodule=""
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936242    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.936246    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936365    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936368    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936371    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936374    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936376    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936379    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936381    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936384    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936388    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936391    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936394    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936396    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936399    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936401    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936404    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936407    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:24:43.943359 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936409    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936411    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936414    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936416    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936419    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936421    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936424    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936426    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936430    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936432    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936435    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936437    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936440    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936442    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936447    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936450    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936453    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936455    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936458    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:24:43.943960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936460    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936463    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936465    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936467    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936470    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936474    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936476    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936479    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936481    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936484    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936488    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936491    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936494    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936497    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936499    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936502    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936505    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936508    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936510    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:24:43.944424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936513    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936516    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936520    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936522    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936525    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936527    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936530    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936532    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936535    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936538    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936540    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936543    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936545    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936547    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936550    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936553    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936555    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936558    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936563    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:24:43.944899 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936566    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936569    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936571    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936574    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936577    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936580    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936583    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936586    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936588    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936591    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936593    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936595    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936598    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936600    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936603    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936608    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936611    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936613    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936616    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936618    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:24:43.945361 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936621    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936623    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936626    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936629    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936632    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.936634    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.937103    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.943875    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.943890    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.943904    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.943910    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943964    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943971    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943975    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943978    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:24:43.945837 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943981    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943983    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943986    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943989    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943991    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943994    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943996    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.943999    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944001    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944004    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944006    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944008    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944011    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944013    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944016    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944018    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944021    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944024    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944026    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944029    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:24:43.946223 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944031    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944034    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944036    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944039    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944041    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944045    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944047    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944050    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944052    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944054    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944057    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944059    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944061    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944064    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944066    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944068    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944071    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944074    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944076    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944079    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:24:43.946701 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944081    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944084    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944087    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944089    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944091    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944094    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944096    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944098    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944101    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944103    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944105    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944108    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944111    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944113    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944116    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944118    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944121    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944124    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944127    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944129    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:24:43.947249 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944132    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944134    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944137    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944139    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944142    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944144    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944146    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944149    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944151    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944154    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944156    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944158    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944161    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944164    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944167    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944169    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944172    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944174    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944176    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944179    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:24:43.947735 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944181    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944184    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944186    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944189    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944191    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944194    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944196    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944200    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944204    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944207    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944211    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944215    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944218    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944221    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:24:43.948224 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944224    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.944229    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944339    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944343    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944346    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944348    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944351    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944354    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944356    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944359    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944361    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944364    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944366    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944369    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944371    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:24:43.948560 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944374    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944377    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944379    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944383    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944387    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944389    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944392    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944394    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944397    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944399    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944401    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944404    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944406    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944410    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944414    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944418    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944421    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944424    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944426    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:24:43.948942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944429    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944432    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944435    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944438    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944440    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944443    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944445    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944448    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944450    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944453    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944456    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944458    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944460    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944463    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944465    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944467    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944469    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944472    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944474    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944477    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:24:43.949397 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944479    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944481    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944484    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944486    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944488    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944491    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944493    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944496    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944498    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944501    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944504    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944506    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944508    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944511    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944513    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944516    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944518    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944520    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944523    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944525    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:24:43.950015 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944527    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944530    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944532    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944535    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944537    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944540    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944542    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944545    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944547    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944549    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944552    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944554    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944556    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944558    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944561    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944563    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944565    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944568    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944570    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:24:43.950487 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944573    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944575    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944577    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944580    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944583    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944585    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944588    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:43.944590    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.944595    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.944705    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.946579    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.949535    2579 server.go:1019] "Starting client certificate rotation"
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.949640    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:24:43.950960 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.949671    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:24:43.952418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.952404    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:24:43.956252 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.956230    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:24:43.965079 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.965062    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 06 23:24:43.967490 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.967475    2579 log.go:25] "Validated CRI v1 image API"
Jul 06 23:24:43.968324 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.968310    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 23:24:43.972288 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.972269    2579 fs.go:135] Filesystem UUIDs: map[51a788c5-8034-4897-b043-affba83c7d8f:/dev/nvme0n1p3 571077e1-27ef-4994-9642-3b6775cc18ea:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 06 23:24:43.972351 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.972287    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 23:24:43.978874 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.978751    2579 manager.go:216] Machine: {Timestamp:2026-07-06 23:24:43.977381013 +0000 UTC m=+0.341567598 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099616 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c5c39960baed606ac4e55010f8a54 SystemUUID:ec2c5c39-960b-aed6-06ac-4e55010f8a54 BootID:c9ce3489-7d97-43f8-bfa0-85df3f7b0b70 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:c4:bc:26:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:c4:bc:26:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:67:f5:27:7f:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 23:24:43.978874 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.978856    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 23:24:43.978993 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.978981    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 23:24:43.981659 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.981629    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 23:24:43.981808 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.981661    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-34.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 23:24:43.982348 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.982338    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 23:24:43.982384 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.982350    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 23:24:43.982384 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.982357    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:24:43.982954 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.982944    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:24:43.983279 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.983260    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:24:43.984554 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.984543    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 23:24:43.987697 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.987686    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:24:43.987805 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.987796    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 23:24:43.987844 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.987826    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 23:24:43.987844 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.987836    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 23:24:43.987950 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.987846    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 23:24:43.987950 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.987855    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 06 23:24:43.987950 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.987880    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 23:24:43.988273 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.988260    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:24:43.988305 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.988287    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:24:43.991203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.991185    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 23:24:43.992956 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.992942    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 23:24:43.992999 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.992979    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 23:24:43.994681 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994666    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 23:24:43.994734 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994692    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 23:24:43.994734 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994698    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 23:24:43.994734 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994704    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 23:24:43.994734 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994712    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 23:24:43.994734 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994718    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 23:24:43.994734 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994731    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 23:24:43.994734 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994737    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 23:24:43.995060 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994744    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 23:24:43.995060 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994749    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 23:24:43.995060 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994758    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 23:24:43.995060 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.994763    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 23:24:43.995514 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.995502    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 23:24:43.995514 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.995512    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 23:24:43.998683 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.998669    2579 server.go:1268] "Started kubelet"
Jul 06 23:24:43.998756 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.998734    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 23:24:43.998907 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.998824    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 23:24:43.999007 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.998933    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 23:24:43.999582 ip-10-0-138-34 systemd[1]: Started Kubernetes Kubelet.
Jul 06 23:24:43.999749 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:43.999730    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-34.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 23:24:44.000616 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.000542    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 23:24:44.000616 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.000598    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 23:24:44.000731 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.000658    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 23:24:44.000731 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.000658    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 23:24:44.005334 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.005310    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 23:24:44.006158 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.005283    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-34.ec2.internal.18bfd6eb672ca07d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-34.ec2.internal,UID:ip-10-0-138-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-34.ec2.internal,},FirstTimestamp:2026-07-06 23:24:43.998642301 +0000 UTC m=+0.362828943,LastTimestamp:2026-07-06 23:24:43.998642301 +0000 UTC m=+0.362828943,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-34.ec2.internal,}"
Jul 06 23:24:44.007289 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.007276    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 23:24:44.007341 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.007290    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 23:24:44.007387 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.007362    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:44.008662 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.008456    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 23:24:44.008662 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.008634    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 23:24:44.008826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.008678    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 23:24:44.008950 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.008937    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 23:24:44.008950 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.008948    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 23:24:44.010053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.010034    2579 factory.go:153] Registering CRI-O factory
Jul 06 23:24:44.010053 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.010056    2579 factory.go:223] Registration of the crio container factory successfully
Jul 06 23:24:44.010187 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.010103    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 23:24:44.010187 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.010117    2579 factory.go:55] Registering systemd factory
Jul 06 23:24:44.010187 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.010126    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 06 23:24:44.010187 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.010146    2579 factory.go:103] Registering Raw factory
Jul 06 23:24:44.010187 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.010160    2579 manager.go:1196] Started watching for new ooms in manager
Jul 06 23:24:44.011065 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.011049    2579 manager.go:349] Starting recovery of all containers
Jul 06 23:24:44.012771 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.012747    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 23:24:44.012973 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.012935    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 23:24:44.020014 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.019978    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 23:24:44.022124 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.022100    2579 manager.go:354] Recovery completed
Jul 06 23:24:44.025683 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.025664    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4n7f9"
Jul 06 23:24:44.026426 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.026413    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:24:44.028159 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.028136    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:24:44.028227 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.028169    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:24:44.028227 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.028183    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:24:44.028641 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.028628    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 23:24:44.028641 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.028639    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 23:24:44.028732 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.028654    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:24:44.028732 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.028676    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:24:44.029406 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.029392    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:24:44.029464 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.029418    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:24:44.029464 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.029427    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:24:44.030177 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.030166    2579 policy_none.go:49] "None policy: Start"
Jul 06 23:24:44.030210 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.030184    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 23:24:44.030210 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.030198    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 23:24:44.030538 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.030469    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-34.ec2.internal.18bfd6eb68eee94f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-34.ec2.internal,UID:ip-10-0-138-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-34.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-34.ec2.internal,},FirstTimestamp:2026-07-06 23:24:44.028152143 +0000 UTC m=+0.392338731,LastTimestamp:2026-07-06 23:24:44.028152143 +0000 UTC m=+0.392338731,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-34.ec2.internal,}"
Jul 06 23:24:44.031248 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.031237    2579 policy_none.go:47] "Start"
Jul 06 23:24:44.034656 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.034640    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4n7f9"
Jul 06 23:24:44.070463 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.070448    2579 manager.go:337] "Starting Device Plugin manager"
Jul 06 23:24:44.070551 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.070481    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 23:24:44.070551 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.070492    2579 server.go:87] "Starting device plugin registration server"
Jul 06 23:24:44.070784 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.070772    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 23:24:44.070837 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.070787    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 23:24:44.070916 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.070900    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 23:24:44.071001 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.070990    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 23:24:44.071048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.071002    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 23:24:44.072179 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.072162    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 23:24:44.072243 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.072203    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:44.143214 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.143187    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 23:24:44.144244 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.143232    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 23:24:44.144244 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.143260    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 23:24:44.144244 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.143305    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 23:24:44.146065 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.146041    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:24:44.170988 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.170920    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:24:44.171917 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.171900    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:24:44.172023 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.171934    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:24:44.172023 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.171947    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:24:44.172023 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.171975    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.180994 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.180970    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.181098 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.180997    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-34.ec2.internal\": node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:44.195246 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.195223    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:44.244204 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.244178    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal"]
Jul 06 23:24:44.244347 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.244246    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:24:44.245173 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.245160    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:24:44.245251 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.245187    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:24:44.245251 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.245198    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:24:44.246701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.246687    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:24:44.246838 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.246822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.246923 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.246912    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:24:44.247384 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.247362    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:24:44.247458 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.247396    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:24:44.247458 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.247407    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:24:44.247458 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.247363    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:24:44.247551 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.247465    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:24:44.247551 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.247483    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:24:44.248711 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.248694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.248777 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.248720    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:24:44.249353 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.249341    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:24:44.249412 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.249367    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:24:44.249412 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.249381    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:24:44.270425 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.270407    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-34.ec2.internal\" not found" node="ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.272606 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.272587    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-34.ec2.internal\" not found" node="ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.296143 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.296123    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:44.310389 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.310365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fe81b36c2cc08704a0f6d1ff5e404e0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-34.ec2.internal\" (UID: \"8fe81b36c2cc08704a0f6d1ff5e404e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.310455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.310394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9201c05b453eaa0427933b2b7ff155ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal\" (UID: \"9201c05b453eaa0427933b2b7ff155ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.310455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.310413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9201c05b453eaa0427933b2b7ff155ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal\" (UID: \"9201c05b453eaa0427933b2b7ff155ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.396952 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.396921    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:44.411337 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.411311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fe81b36c2cc08704a0f6d1ff5e404e0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-34.ec2.internal\" (UID: \"8fe81b36c2cc08704a0f6d1ff5e404e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.411398 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.411345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9201c05b453eaa0427933b2b7ff155ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal\" (UID: \"9201c05b453eaa0427933b2b7ff155ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.411398 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.411361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9201c05b453eaa0427933b2b7ff155ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal\" (UID: \"9201c05b453eaa0427933b2b7ff155ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.411398 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.411388    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fe81b36c2cc08704a0f6d1ff5e404e0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-34.ec2.internal\" (UID: \"8fe81b36c2cc08704a0f6d1ff5e404e0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.411487 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.411401    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9201c05b453eaa0427933b2b7ff155ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal\" (UID: \"9201c05b453eaa0427933b2b7ff155ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.411487 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.411403    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9201c05b453eaa0427933b2b7ff155ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal\" (UID: \"9201c05b453eaa0427933b2b7ff155ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.497735 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.497677    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:44.574246 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.574221    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.576283 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:44.576264    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:44.597961 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.597751    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:44.698488 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:44.698457    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:46.029222 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:46.029193    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:46.058459 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.058438    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:24:46.130086 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:46.130047    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:46.177559 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.177535    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 23:24:46.177939 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.177675    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:24:46.177939 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.177703    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:24:46.231014 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:46.230960    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:46.266743 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.266662    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:19:45 +0000 UTC" deadline="2028-01-25 19:31:43.706113416 +0000 UTC"
Jul 06 23:24:46.266743 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.266693    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13628h6m57.439423403s"
Jul 06 23:24:46.289344 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:46.289309    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9201c05b453eaa0427933b2b7ff155ca.slice/crio-6d7c18338de2e0e1ee02001f51821c06048e3b02381ea8a98416f01170565242 WatchSource:0}: Error finding container 6d7c18338de2e0e1ee02001f51821c06048e3b02381ea8a98416f01170565242: Status 404 returned error can't find the container with id 6d7c18338de2e0e1ee02001f51821c06048e3b02381ea8a98416f01170565242
Jul 06 23:24:46.292042 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:46.292020    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe81b36c2cc08704a0f6d1ff5e404e0.slice/crio-8e0d7394b9f8ca3f1250e5813915d49368a048086e3dda737868be728d75a856 WatchSource:0}: Error finding container 8e0d7394b9f8ca3f1250e5813915d49368a048086e3dda737868be728d75a856: Status 404 returned error can't find the container with id 8e0d7394b9f8ca3f1250e5813915d49368a048086e3dda737868be728d75a856
Jul 06 23:24:46.293255 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.293238    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:24:46.331626 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:46.331595    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-34.ec2.internal\" not found"
Jul 06 23:24:46.375234 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.375214    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:24:46.376379 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.376340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal" event={"ID":"8fe81b36c2cc08704a0f6d1ff5e404e0","Type":"ContainerStarted","Data":"8e0d7394b9f8ca3f1250e5813915d49368a048086e3dda737868be728d75a856"}
Jul 06 23:24:46.377429 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.377406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal" event={"ID":"9201c05b453eaa0427933b2b7ff155ca","Type":"ContainerStarted","Data":"6d7c18338de2e0e1ee02001f51821c06048e3b02381ea8a98416f01170565242"}
Jul 06 23:24:46.404625 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.404602    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:24:46.438465 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.438440    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:46.447577 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.447552    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:24:46.448535 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.448521    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal"
Jul 06 23:24:46.470824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:46.470803    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:24:47.135390 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.135351    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:24:47.219849 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.219820    2579 apiserver.go:52] "Watching apiserver"
Jul 06 23:24:47.229375 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.229349    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 23:24:47.230381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.230348    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal","openshift-image-registry/node-ca-xkjpp","openshift-multus/network-metrics-daemon-kqqs9","openshift-network-diagnostics/network-check-target-h85xb","openshift-network-operator/iptables-alerter-xzvjn","openshift-ovn-kubernetes/ovnkube-node-cblqt","kube-system/konnectivity-agent-g9wrh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8","openshift-cluster-node-tuning-operator/tuned-8mw9d","openshift-dns/node-resolver-c2zff","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal","openshift-multus/multus-additional-cni-plugins-9x9lb","openshift-multus/multus-f4p2l","kube-system/global-pull-secret-syncer-8rjl4"]
Jul 06 23:24:47.231891 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.231872    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:24:47.233084 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.233048    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.234130 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.234114    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 23:24:47.234223 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.234114    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 23:24:47.234283 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.234113    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vvbgh\""
Jul 06 23:24:47.234336 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.234280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:47.234384 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.234357    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:24:47.235284 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.235263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:47.235416 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.235332    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:24:47.235607 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.235592    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 23:24:47.236611 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.236174    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rnk28\""
Jul 06 23:24:47.236611 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.236310    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 23:24:47.236611 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.236413    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 23:24:47.237090 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.237072    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 23:24:47.238210 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.238192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.238295 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.238252    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.240966 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.238202    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 23:24:47.240966 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.240621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hgnhz\""
Jul 06 23:24:47.240966 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.240788    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c57r5\""
Jul 06 23:24:47.240966 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.240876    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:24:47.242610 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.242072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.242610 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.242269    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 23:24:47.242610 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.242402    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 23:24:47.242610 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.242505    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 23:24:47.242610 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.242508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 23:24:47.244143 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.244033    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 23:24:47.244354 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.244341    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 23:24:47.244489 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.244473    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 23:24:47.244633 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.244614    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 23:24:47.245037 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.244914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.245037 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.244930    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:24:47.245037 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.244987    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:24:47.245679 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.245662    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 23:24:47.246376 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.246107    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.246376 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.246144    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5crcw\""
Jul 06 23:24:47.247966 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.247946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.248409 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.248391    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 23:24:47.248491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.248449    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 23:24:47.248581 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.248562    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 23:24:47.248702 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.248574    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2brkp\""
Jul 06 23:24:47.249323 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249306    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.249754 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-os-release\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.249880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-multus-certs\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.249880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-etc-kubernetes\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.249880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.249880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249853    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-cni-bin\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.250092 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249875    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-kubernetes\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.250092 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs584\" (UniqueName: \"kubernetes.io/projected/f6fb8599-8562-439b-96bd-082b917bb6cd-kube-api-access-hs584\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.250092 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-slash\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.250092 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.249968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-etc-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e5327b4-02cc-453c-9ccf-73daba79548d-konnectivity-ca\") pod \"konnectivity-agent-g9wrh\" (UID: \"7e5327b4-02cc-453c-9ccf-73daba79548d\") " pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-iptables-alerter-script\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-env-overrides\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-conf-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-daemon-config\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysctl-d\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-systemd\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-host\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.250358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-socket-dir-parent\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-hostroot\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovnkube-config\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-k8s-cni-cncf-io\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-netns\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250524    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e5327b4-02cc-453c-9ccf-73daba79548d-agent-certs\") pod \"konnectivity-agent-g9wrh\" (UID: \"7e5327b4-02cc-453c-9ccf-73daba79548d\") " pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-kubelet\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-run-netns\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysctl-conf\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-var-lib-kubelet\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-cni-bin\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250734    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-modprobe-d\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250754    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-host-slash\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckrhj\" (UniqueName: \"kubernetes.io/projected/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-kube-api-access-ckrhj\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.250881 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-tuned\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.250953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-run\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-system-cni-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-cnibin\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251125    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-52jmk\""
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-cni-multus\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251154    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-systemd\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovn-node-metrics-cert\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-node-log\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b99ed870-3506-4f60-b58f-20ca6dcbe62c-tmp\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd5wf\" (UniqueName: \"kubernetes.io/projected/b99ed870-3506-4f60-b58f-20ca6dcbe62c-kube-api-access-cd5wf\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251316    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-sys\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251342    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-kubelet\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.252018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95hp\" (UniqueName: \"kubernetes.io/projected/bf625c0c-d1d0-49ec-8925-191df5cac5e1-kube-api-access-f95hp\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-cni-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251485    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251521    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-systemd-units\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-ovn\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-log-socket\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-lib-modules\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251632    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fmgq4\""
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6fb8599-8562-439b-96bd-082b917bb6cd-cni-binary-copy\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-var-lib-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-cni-netd\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251703    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovnkube-script-lib\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysconfig\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251826    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:47.252911 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.251853    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pskh\" (UniqueName: \"kubernetes.io/projected/48700b44-4c22-4932-bc22-aa11fec4c9cc-kube-api-access-7pskh\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:47.253608 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.253278    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 23:24:47.253608 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.253409    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bbhls\""
Jul 06 23:24:47.253608 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.253468    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 23:24:47.269966 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.269941    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thhl7"
Jul 06 23:24:47.278497 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.278474    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thhl7"
Jul 06 23:24:47.340516 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.340482    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 23:24:47.352242 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-conf-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.352242 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-daemon-config\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysctl-d\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-systemd\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-host\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352339    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-conf-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-host\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-socket-dir-parent\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352396    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-systemd\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-hostroot\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovnkube-config\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352450    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-host\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352454    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysctl-d\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.352468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qthqk\" (UniqueName: \"kubernetes.io/projected/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-kube-api-access-qthqk\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct7wk\" (UniqueName: \"kubernetes.io/projected/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-kube-api-access-ct7wk\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352506    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-hostroot\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-os-release\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-k8s-cni-cncf-io\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352574    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-socket-dir-parent\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-netns\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e5327b4-02cc-453c-9ccf-73daba79548d-agent-certs\") pod \"konnectivity-agent-g9wrh\" (UID: \"7e5327b4-02cc-453c-9ccf-73daba79548d\") " pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352618    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-k8s-cni-cncf-io\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352629    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-kubelet\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352640    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-netns\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-run-netns\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysctl-conf\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-var-lib-kubelet\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-cni-bin\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-modprobe-d\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.353029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-host-slash\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckrhj\" (UniqueName: \"kubernetes.io/projected/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-kube-api-access-ckrhj\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352867    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-daemon-config\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352896    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-tuned\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-run\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352963    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovnkube-config\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352969    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-modprobe-d\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-system-cni-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.352999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-cnibin\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353013    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-cni-bin\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-cni-multus\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353046    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-kubelet\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-systemd\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353089    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysctl-conf\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.353826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovn-node-metrics-cert\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353100    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-run-netns\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353122    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-var-lib-kubelet\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-node-log\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353145    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-host-slash\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353162    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-node-log\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b99ed870-3506-4f60-b58f-20ca6dcbe62c-tmp\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.353221    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353232    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-run\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.353282    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs podName:48700b44-4c22-4932-bc22-aa11fec4c9cc nodeName:}" failed. No retries permitted until 2026-07-06 23:24:47.853263041 +0000 UTC m=+2.987255215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs") pod "network-metrics-daemon-kqqs9" (UID: "48700b44-4c22-4932-bc22-aa11fec4c9cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353285    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-system-cni-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353334    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-cnibin\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353376    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-cni-multus\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353369    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd5wf\" (UniqueName: \"kubernetes.io/projected/b99ed870-3506-4f60-b58f-20ca6dcbe62c-kube-api-access-cd5wf\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-device-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.354669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-sys\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-kubelet\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f95hp\" (UniqueName: \"kubernetes.io/projected/bf625c0c-d1d0-49ec-8925-191df5cac5e1-kube-api-access-f95hp\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f37af222-6916-4949-a335-4f342064f030-hosts-file\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-cni-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-systemd-units\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-ovn\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-log-socket\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-lib-modules\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f37af222-6916-4949-a335-4f342064f030-tmp-dir\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-cnibin\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-socket-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6fb8599-8562-439b-96bd-082b917bb6cd-cni-binary-copy\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-var-lib-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.355482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-cni-netd\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovnkube-script-lib\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysconfig\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-serviceca\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nplzh\" (UniqueName: \"kubernetes.io/projected/f37af222-6916-4949-a335-4f342064f030-kube-api-access-nplzh\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-sys-fs\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353914    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-log-socket\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-system-cni-dir\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.353985    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pskh\" (UniqueName: \"kubernetes.io/projected/48700b44-4c22-4932-bc22-aa11fec4c9cc-kube-api-access-7pskh\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-os-release\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-multus-certs\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-etc-kubernetes\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-cni-bin\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-kubernetes\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.356191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354196    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-var-lib-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs584\" (UniqueName: \"kubernetes.io/projected/f6fb8599-8562-439b-96bd-082b917bb6cd-kube-api-access-hs584\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354271    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-slash\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-etc-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7371def-54bf-424c-8fe0-3f05a45aed2a-kubelet-config\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7371def-54bf-424c-8fe0-3f05a45aed2a-dbus\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354378    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-cni-netd\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-registration-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e5327b4-02cc-453c-9ccf-73daba79548d-konnectivity-ca\") pod \"konnectivity-agent-g9wrh\" (UID: \"7e5327b4-02cc-453c-9ccf-73daba79548d\") " pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-iptables-alerter-script\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-env-overrides\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp2l5\" (UniqueName: \"kubernetes.io/projected/8865ded9-58dd-4a10-88d4-dcca74604f2d-kube-api-access-zp2l5\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354672    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6fb8599-8562-439b-96bd-082b917bb6cd-cni-binary-copy\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354755    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-sys\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354771    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-lib-modules\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.356824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354819    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-var-lib-kubelet\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354852    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-cni-bin\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354868    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-kubernetes\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354868    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovnkube-script-lib\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.354920    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-sysconfig\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355092    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-host-slash\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355112    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-multus-cni-dir\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355147    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-etc-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355160    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-ovn\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355192    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-os-release\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355200    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-systemd-units\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355243    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-host-run-multus-certs\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355285    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6fb8599-8562-439b-96bd-082b917bb6cd-etc-kubernetes\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355324    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-openvswitch\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355709    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf625c0c-d1d0-49ec-8925-191df5cac5e1-env-overrides\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355737    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e5327b4-02cc-453c-9ccf-73daba79548d-konnectivity-ca\") pod \"konnectivity-agent-g9wrh\" (UID: \"7e5327b4-02cc-453c-9ccf-73daba79548d\") " pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355846    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf625c0c-d1d0-49ec-8925-191df5cac5e1-run-systemd\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.355858    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-iptables-alerter-script\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.357648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.356918    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf625c0c-d1d0-49ec-8925-191df5cac5e1-ovn-node-metrics-cert\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.358549 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.357093    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b99ed870-3506-4f60-b58f-20ca6dcbe62c-etc-tuned\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.358549 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.357141    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b99ed870-3506-4f60-b58f-20ca6dcbe62c-tmp\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.358549 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.357268    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e5327b4-02cc-453c-9ccf-73daba79548d-agent-certs\") pod \"konnectivity-agent-g9wrh\" (UID: \"7e5327b4-02cc-453c-9ccf-73daba79548d\") " pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:24:47.361199 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.361179    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:24:47.361332 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.361205    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:24:47.361332 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.361219    2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6qfb for pod openshift-network-diagnostics/network-check-target-h85xb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:47.361332 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.361289    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb podName:f66c8c10-7e40-481e-801e-de2a12692c4c nodeName:}" failed. No retries permitted until 2026-07-06 23:24:47.861270787 +0000 UTC m=+2.995262963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b6qfb" (UniqueName: "kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb") pod "network-check-target-h85xb" (UID: "f66c8c10-7e40-481e-801e-de2a12692c4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:47.363029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.362998    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckrhj\" (UniqueName: \"kubernetes.io/projected/e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8-kube-api-access-ckrhj\") pod \"iptables-alerter-xzvjn\" (UID: \"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8\") " pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.364644 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.364618    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd5wf\" (UniqueName: \"kubernetes.io/projected/b99ed870-3506-4f60-b58f-20ca6dcbe62c-kube-api-access-cd5wf\") pod \"tuned-8mw9d\" (UID: \"b99ed870-3506-4f60-b58f-20ca6dcbe62c\") " pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.364737 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.364693    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95hp\" (UniqueName: \"kubernetes.io/projected/bf625c0c-d1d0-49ec-8925-191df5cac5e1-kube-api-access-f95hp\") pod \"ovnkube-node-cblqt\" (UID: \"bf625c0c-d1d0-49ec-8925-191df5cac5e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.364794 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.364758    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pskh\" (UniqueName: \"kubernetes.io/projected/48700b44-4c22-4932-bc22-aa11fec4c9cc-kube-api-access-7pskh\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:47.365252 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.365230    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs584\" (UniqueName: \"kubernetes.io/projected/f6fb8599-8562-439b-96bd-082b917bb6cd-kube-api-access-hs584\") pod \"multus-f4p2l\" (UID: \"f6fb8599-8562-439b-96bd-082b917bb6cd\") " pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.455410 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7371def-54bf-424c-8fe0-3f05a45aed2a-kubelet-config\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.455410 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7371def-54bf-424c-8fe0-3f05a45aed2a-dbus\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.455410 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-registration-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.455483    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp2l5\" (UniqueName: \"kubernetes.io/projected/8865ded9-58dd-4a10-88d4-dcca74604f2d-kube-api-access-zp2l5\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455496    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7371def-54bf-424c-8fe0-3f05a45aed2a-kubelet-config\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-host\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.455532    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret podName:f7371def-54bf-424c-8fe0-3f05a45aed2a nodeName:}" failed. No retries permitted until 2026-07-06 23:24:47.955517786 +0000 UTC m=+3.089509956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret") pod "global-pull-secret-syncer-8rjl4" (UID: "f7371def-54bf-424c-8fe0-3f05a45aed2a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455548    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-registration-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455555    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7371def-54bf-424c-8fe0-3f05a45aed2a-dbus\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455553    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-host\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qthqk\" (UniqueName: \"kubernetes.io/projected/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-kube-api-access-qthqk\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct7wk\" (UniqueName: \"kubernetes.io/projected/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-kube-api-access-ct7wk\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-os-release\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.455701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455743    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-os-release\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-device-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f37af222-6916-4949-a335-4f342064f030-hosts-file\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f37af222-6916-4949-a335-4f342064f030-tmp-dir\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-cnibin\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-socket-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455868    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-device-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455892    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455945    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f37af222-6916-4949-a335-4f342064f030-hosts-file\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455979    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.455982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-serviceca\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456016    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-socket-dir\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.456411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456019    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456044    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-cnibin\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplzh\" (UniqueName: \"kubernetes.io/projected/f37af222-6916-4949-a335-4f342064f030-kube-api-access-nplzh\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-sys-fs\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456222    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456288    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-sys-fs\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-system-cni-dir\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456333    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f37af222-6916-4949-a335-4f342064f030-tmp-dir\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456354    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456396    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8865ded9-58dd-4a10-88d4-dcca74604f2d-system-cni-dir\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456476    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-serviceca\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.457116 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.456494    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8865ded9-58dd-4a10-88d4-dcca74604f2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.464928 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.464906    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp2l5\" (UniqueName: \"kubernetes.io/projected/8865ded9-58dd-4a10-88d4-dcca74604f2d-kube-api-access-zp2l5\") pod \"multus-additional-cni-plugins-9x9lb\" (UID: \"8865ded9-58dd-4a10-88d4-dcca74604f2d\") " pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.465110 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.464930    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qthqk\" (UniqueName: \"kubernetes.io/projected/86dd081b-d5f7-4eb5-b4f8-e5565742b5da-kube-api-access-qthqk\") pod \"node-ca-xkjpp\" (UID: \"86dd081b-d5f7-4eb5-b4f8-e5565742b5da\") " pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.465563 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.465545    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nplzh\" (UniqueName: \"kubernetes.io/projected/f37af222-6916-4949-a335-4f342064f030-kube-api-access-nplzh\") pod \"node-resolver-c2zff\" (UID: \"f37af222-6916-4949-a335-4f342064f030\") " pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.466331 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.466306    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct7wk\" (UniqueName: \"kubernetes.io/projected/dbc7e1cf-b72b-44fc-b828-4b6c172cc55e-kube-api-access-ct7wk\") pod \"aws-ebs-csi-driver-node-7wbn8\" (UID: \"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.544904 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.544857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:24:47.556844 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.556806    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4p2l"
Jul 06 23:24:47.565624 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.565598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:24:47.572150 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.572128    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzvjn"
Jul 06 23:24:47.580808 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.580784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mw9d"
Jul 06 23:24:47.588305 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.588287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xkjpp"
Jul 06 23:24:47.594361 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.594344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2zff"
Jul 06 23:24:47.600906 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.600885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8"
Jul 06 23:24:47.605644 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.605627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9x9lb"
Jul 06 23:24:47.859078 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.858978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:47.859222 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.859143    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:47.859222 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.859212    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs podName:48700b44-4c22-4932-bc22-aa11fec4c9cc nodeName:}" failed. No retries permitted until 2026-07-06 23:24:48.859192323 +0000 UTC m=+3.993184499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs") pod "network-metrics-daemon-kqqs9" (UID: "48700b44-4c22-4932-bc22-aa11fec4c9cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:47.959928 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.959895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:47.960095 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:47.959942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:47.960095 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.960071    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:47.960095 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.960089    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:24:47.960218 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.960109    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:24:47.960218 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.960122    2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6qfb for pod openshift-network-diagnostics/network-check-target-h85xb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:47.960218 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.960134    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret podName:f7371def-54bf-424c-8fe0-3f05a45aed2a nodeName:}" failed. No retries permitted until 2026-07-06 23:24:48.960116073 +0000 UTC m=+4.094108247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret") pod "global-pull-secret-syncer-8rjl4" (UID: "f7371def-54bf-424c-8fe0-3f05a45aed2a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:47.960218 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:47.960172    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb podName:f66c8c10-7e40-481e-801e-de2a12692c4c nodeName:}" failed. No retries permitted until 2026-07-06 23:24:48.960155325 +0000 UTC m=+4.094147496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6qfb" (UniqueName: "kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb") pod "network-check-target-h85xb" (UID: "f66c8c10-7e40-481e-801e-de2a12692c4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:48.123917 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.123253    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:24:48.249666 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:48.249635    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37af222_6916_4949_a335_4f342064f030.slice/crio-1fb01986df7b3dfe32eb2f9b717ca35de074aa405c2a8ca92d067bde361af761 WatchSource:0}: Error finding container 1fb01986df7b3dfe32eb2f9b717ca35de074aa405c2a8ca92d067bde361af761: Status 404 returned error can't find the container with id 1fb01986df7b3dfe32eb2f9b717ca35de074aa405c2a8ca92d067bde361af761
Jul 06 23:24:48.251508 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:48.251483    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04781bf_e0b3_4ed8_85b6_34a8f3c26ab8.slice/crio-c4dcc10cc5b66fb0e0e4da21909d710d60764fd9f4827d07843ed84acb706504 WatchSource:0}: Error finding container c4dcc10cc5b66fb0e0e4da21909d710d60764fd9f4827d07843ed84acb706504: Status 404 returned error can't find the container with id c4dcc10cc5b66fb0e0e4da21909d710d60764fd9f4827d07843ed84acb706504
Jul 06 23:24:48.266766 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:24:48.266745    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99ed870_3506_4f60_b58f_20ca6dcbe62c.slice/crio-bb2dca0b361b9127949675a9489b5a75761c55edad2fde3506c6fe4591638c0f WatchSource:0}: Error finding container bb2dca0b361b9127949675a9489b5a75761c55edad2fde3506c6fe4591638c0f: Status 404 returned error can't find the container with id bb2dca0b361b9127949675a9489b5a75761c55edad2fde3506c6fe4591638c0f
Jul 06 23:24:48.280467 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.280412    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:19:47 +0000 UTC" deadline="2028-03-01 02:53:13.541508228 +0000 UTC"
Jul 06 23:24:48.280467 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.280467    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14475h28m25.261044695s"
Jul 06 23:24:48.382175 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.382083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzvjn" event={"ID":"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8","Type":"ContainerStarted","Data":"c4dcc10cc5b66fb0e0e4da21909d710d60764fd9f4827d07843ed84acb706504"}
Jul 06 23:24:48.384229 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.384193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal" event={"ID":"8fe81b36c2cc08704a0f6d1ff5e404e0","Type":"ContainerStarted","Data":"0b638aa0107e0bbf19d2f7a2932a75369c790c644e5449eda09c0dbf0e51654d"}
Jul 06 23:24:48.386047 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.386022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xkjpp" event={"ID":"86dd081b-d5f7-4eb5-b4f8-e5565742b5da","Type":"ContainerStarted","Data":"cfdca9f0bc1fccd55bc97475c135cbc20cb66767de7fbb63349b37debdaaaf10"}
Jul 06 23:24:48.387144 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.387121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g9wrh" event={"ID":"7e5327b4-02cc-453c-9ccf-73daba79548d","Type":"ContainerStarted","Data":"2ee8c07cfd7a60f87ca38862052d814d549f54c6ce85080d68744facd5e3ac3a"}
Jul 06 23:24:48.388154 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.388130    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2zff" event={"ID":"f37af222-6916-4949-a335-4f342064f030","Type":"ContainerStarted","Data":"1fb01986df7b3dfe32eb2f9b717ca35de074aa405c2a8ca92d067bde361af761"}
Jul 06 23:24:48.389535 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.389515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mw9d" event={"ID":"b99ed870-3506-4f60-b58f-20ca6dcbe62c","Type":"ContainerStarted","Data":"bb2dca0b361b9127949675a9489b5a75761c55edad2fde3506c6fe4591638c0f"}
Jul 06 23:24:48.390521 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.390502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8" event={"ID":"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e","Type":"ContainerStarted","Data":"99fd720be2793b38bc0d07a0fb32dc47f34f8821800c4cbc0c5a24ce63569c08"}
Jul 06 23:24:48.391555 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.391532    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"6206b89c6112337cfa0d0270a8f584426eb1b6595304ec6ae737d2c0af76b852"}
Jul 06 23:24:48.392813 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.392787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4p2l" event={"ID":"f6fb8599-8562-439b-96bd-082b917bb6cd","Type":"ContainerStarted","Data":"68ffe325dddf5c4a81c9ed854b8b74ddf48ad0e78e1b6a7d33db024844cbac69"}
Jul 06 23:24:48.393823 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.393796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerStarted","Data":"6e46c891a7a0ad98b7507afd0bfe386dbe3603e9e6a19177264b9e45330cc60c"}
Jul 06 23:24:48.399571 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.399509    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-34.ec2.internal" podStartSLOduration=2.399494069 podStartE2EDuration="2.399494069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:24:48.399222422 +0000 UTC m=+3.533214613" watchObservedRunningTime="2026-07-06 23:24:48.399494069 +0000 UTC m=+3.533486259"
Jul 06 23:24:48.867288 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.866908    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:48.876402 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:48.876281    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:48.876402 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:48.876371    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs podName:48700b44-4c22-4932-bc22-aa11fec4c9cc nodeName:}" failed. No retries permitted until 2026-07-06 23:24:50.876348217 +0000 UTC m=+6.010340394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs") pod "network-metrics-daemon-kqqs9" (UID: "48700b44-4c22-4932-bc22-aa11fec4c9cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:48.969103 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.968322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:48.969103 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:48.968385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:48.969103 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:48.968546    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:48.969103 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:48.968608    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret podName:f7371def-54bf-424c-8fe0-3f05a45aed2a nodeName:}" failed. No retries permitted until 2026-07-06 23:24:50.968590119 +0000 UTC m=+6.102582290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret") pod "global-pull-secret-syncer-8rjl4" (UID: "f7371def-54bf-424c-8fe0-3f05a45aed2a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:48.969103 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:48.969005    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:24:48.969103 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:48.969026    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:24:48.969103 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:48.969039    2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6qfb for pod openshift-network-diagnostics/network-check-target-h85xb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:48.969103 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:48.969100    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb podName:f66c8c10-7e40-481e-801e-de2a12692c4c nodeName:}" failed. No retries permitted until 2026-07-06 23:24:50.969085008 +0000 UTC m=+6.103077192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6qfb" (UniqueName: "kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb") pod "network-check-target-h85xb" (UID: "f66c8c10-7e40-481e-801e-de2a12692c4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:49.280980 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:49.280865    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:19:47 +0000 UTC" deadline="2028-01-13 20:59:26.570525224 +0000 UTC"
Jul 06 23:24:49.280980 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:49.280929    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13341h34m37.289599576s"
Jul 06 23:24:49.374735 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:49.374639    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:49.374735 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:49.374683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:49.374949 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:49.374814    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:24:49.375365 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:49.375110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:49.375365 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:49.375222    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:24:49.375365 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:49.375305    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:24:49.400826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:49.400643    2579 generic.go:356] "Generic (PLEG): container finished" podID="9201c05b453eaa0427933b2b7ff155ca" containerID="f58ad9018aa94e2c44693d98b377476034e27a43eebac461e62b34ce8992aa2c" exitCode=0
Jul 06 23:24:49.400826 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:49.400765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal" event={"ID":"9201c05b453eaa0427933b2b7ff155ca","Type":"ContainerDied","Data":"f58ad9018aa94e2c44693d98b377476034e27a43eebac461e62b34ce8992aa2c"}
Jul 06 23:24:50.426597 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:50.426554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal" event={"ID":"9201c05b453eaa0427933b2b7ff155ca","Type":"ContainerStarted","Data":"dda9d9570fe2bdef53a34717c5b535fcfd2769f698029150d16a5f86ab3f2d37"}
Jul 06 23:24:50.886508 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:50.886427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:50.886669 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:50.886578    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:50.886669 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:50.886641    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs podName:48700b44-4c22-4932-bc22-aa11fec4c9cc nodeName:}" failed. No retries permitted until 2026-07-06 23:24:54.886623622 +0000 UTC m=+10.020615794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs") pod "network-metrics-daemon-kqqs9" (UID: "48700b44-4c22-4932-bc22-aa11fec4c9cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:50.987718 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:50.987682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:50.987902 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:50.987740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:50.987902 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:50.987879    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:50.988096 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:50.987938    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret podName:f7371def-54bf-424c-8fe0-3f05a45aed2a nodeName:}" failed. No retries permitted until 2026-07-06 23:24:54.987920368 +0000 UTC m=+10.121912541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret") pod "global-pull-secret-syncer-8rjl4" (UID: "f7371def-54bf-424c-8fe0-3f05a45aed2a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:50.988376 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:50.988357    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:24:50.988459 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:50.988384    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:24:50.988459 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:50.988398    2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6qfb for pod openshift-network-diagnostics/network-check-target-h85xb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:50.988459 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:50.988445    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb podName:f66c8c10-7e40-481e-801e-de2a12692c4c nodeName:}" failed. No retries permitted until 2026-07-06 23:24:54.988429588 +0000 UTC m=+10.122421775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6qfb" (UniqueName: "kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb") pod "network-check-target-h85xb" (UID: "f66c8c10-7e40-481e-801e-de2a12692c4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:51.374438 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:51.374352    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:51.374585 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:51.374465    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:24:51.374809 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:51.374788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:51.374901 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:51.374879    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:24:51.375018 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:51.375001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:51.375109 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:51.375077    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:24:53.376633 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:53.376593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:53.377078 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:53.376751    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:24:53.377201 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:53.377181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:53.377309 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:53.377263    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:24:53.377356 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:53.377315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:53.377394 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:53.377383    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:24:54.921514 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:54.920808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:54.921514 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:54.921005    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:54.921514 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:54.921090    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs podName:48700b44-4c22-4932-bc22-aa11fec4c9cc nodeName:}" failed. No retries permitted until 2026-07-06 23:25:02.921068688 +0000 UTC m=+18.055060876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs") pod "network-metrics-daemon-kqqs9" (UID: "48700b44-4c22-4932-bc22-aa11fec4c9cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:24:55.022208 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:55.022166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:55.022409 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:55.022229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:55.022409 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.022352    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:55.022529 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.022413    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret podName:f7371def-54bf-424c-8fe0-3f05a45aed2a nodeName:}" failed. No retries permitted until 2026-07-06 23:25:03.022394525 +0000 UTC m=+18.156386711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret") pod "global-pull-secret-syncer-8rjl4" (UID: "f7371def-54bf-424c-8fe0-3f05a45aed2a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:24:55.022732 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.022706    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:24:55.022732 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.022733    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:24:55.022867 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.022746    2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6qfb for pod openshift-network-diagnostics/network-check-target-h85xb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:55.022867 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.022797    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb podName:f66c8c10-7e40-481e-801e-de2a12692c4c nodeName:}" failed. No retries permitted until 2026-07-06 23:25:03.022780118 +0000 UTC m=+18.156772310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6qfb" (UniqueName: "kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb") pod "network-check-target-h85xb" (UID: "f66c8c10-7e40-481e-801e-de2a12692c4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:24:55.374914 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:55.374828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:55.375103 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.374944    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:24:55.375460 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:55.375216    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:55.375460 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.375328    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:24:55.375460 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:55.375381    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:55.375460 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:55.375433    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:24:57.376968 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:57.376102    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:57.376968 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:57.376250    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:24:57.376968 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:57.376630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:57.376968 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:57.376719    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:24:57.376968 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:57.376830    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:57.376968 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:57.376905    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:24:59.374239 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:59.374148    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:24:59.374623 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:59.374286    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:24:59.374623 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:59.374299    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:24:59.374623 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:24:59.374152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:24:59.374623 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:59.374437    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:24:59.374623 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:24:59.374509    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:01.374696 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:01.374653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:01.374696 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:01.374702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:01.375248 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:01.374658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:01.375248 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:01.374800    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:01.375248 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:01.374948    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:01.375248 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:01.375009    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:02.982587 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:02.982556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:02.982955 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:02.982673    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:25:02.982955 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:02.982720    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs podName:48700b44-4c22-4932-bc22-aa11fec4c9cc nodeName:}" failed. No retries permitted until 2026-07-06 23:25:18.982706557 +0000 UTC m=+34.116698726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs") pod "network-metrics-daemon-kqqs9" (UID: "48700b44-4c22-4932-bc22-aa11fec4c9cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:25:03.083596 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:03.083566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:03.083739 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:03.083677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:03.083739 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.083723    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:25:03.083826 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.083786    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret podName:f7371def-54bf-424c-8fe0-3f05a45aed2a nodeName:}" failed. No retries permitted until 2026-07-06 23:25:19.083768117 +0000 UTC m=+34.217760298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret") pod "global-pull-secret-syncer-8rjl4" (UID: "f7371def-54bf-424c-8fe0-3f05a45aed2a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:25:03.083826 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.083784    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:25:03.083826 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.083808    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:25:03.083826 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.083819    2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6qfb for pod openshift-network-diagnostics/network-check-target-h85xb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:25:03.084013 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.083861    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb podName:f66c8c10-7e40-481e-801e-de2a12692c4c nodeName:}" failed. No retries permitted until 2026-07-06 23:25:19.083846207 +0000 UTC m=+34.217838394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6qfb" (UniqueName: "kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb") pod "network-check-target-h85xb" (UID: "f66c8c10-7e40-481e-801e-de2a12692c4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:25:03.377764 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:03.377734    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:03.377961 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:03.377868    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:03.377961 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.377876    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:03.378085 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:03.377971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:03.378085 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.377974    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:03.378085 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:03.378048    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:05.374738 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:05.374693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:05.375252 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:05.374784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:05.375252 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:05.374804    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:05.375252 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:05.374910    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:05.375252 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:05.374959    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:05.375252 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:05.375019    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:07.373726 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:07.373703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:07.374090 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:07.373844    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:07.374349 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:07.374168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:07.374349 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:07.374188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:07.374349 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:07.374265    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:07.374349 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:07.374328    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:07.470892 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:07.470864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2zff" event={"ID":"f37af222-6916-4949-a335-4f342064f030","Type":"ContainerStarted","Data":"d8751f484beb5ce89bdaaa14f55f8a8663c652978f17145de5d214bd1b60292c"}
Jul 06 23:25:07.472645 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:07.472626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mw9d" event={"ID":"b99ed870-3506-4f60-b58f-20ca6dcbe62c","Type":"ContainerStarted","Data":"d866757e718d58155f85561f8d63993b731c91b4fb3cb8996247a0633943dd21"}
Jul 06 23:25:07.497019 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:07.496929    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8mw9d" podStartSLOduration=3.434426631 podStartE2EDuration="22.496911636s" totalImagesPullingTime="19.062485005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:07.496890892 +0000 UTC m=+22.630883078" watchObservedRunningTime="2026-07-06 23:25:07.496911636 +0000 UTC m=+22.630903826"
Jul 06 23:25:07.497196 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:07.497167    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-34.ec2.internal" podStartSLOduration=21.497157167 podStartE2EDuration="21.497157167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:24:50.445150131 +0000 UTC m=+5.579142323" watchObservedRunningTime="2026-07-06 23:25:07.497157167 +0000 UTC m=+22.631149357"
Jul 06 23:25:08.477184 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.476759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xkjpp" event={"ID":"86dd081b-d5f7-4eb5-b4f8-e5565742b5da","Type":"ContainerStarted","Data":"ca79fee0f942f60f810440b1cdba56596aac244ff2a76972318df422c814295c"}
Jul 06 23:25:08.478609 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.478581    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g9wrh" event={"ID":"7e5327b4-02cc-453c-9ccf-73daba79548d","Type":"ContainerStarted","Data":"c12d7a5af4ebbb8919000ebe4f0ef0029207c6dbf07e6be4ca5ed07710efc5b9"}
Jul 06 23:25:08.480067 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.480034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8" event={"ID":"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e","Type":"ContainerStarted","Data":"cb041d154a299dc65b7c0379324283b81905ef1a79786f863cfc279d085f3dc5"}
Jul 06 23:25:08.483037 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.483018    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:25:08.483477 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.483456    2579 generic.go:356] "Generic (PLEG): container finished" podID="bf625c0c-d1d0-49ec-8925-191df5cac5e1" containerID="ac6f3c87f2ea82bd3ff5ecaba7a9957e4b7d8c0df02798e23e7c7a0df1accce1" exitCode=1
Jul 06 23:25:08.483562 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.483504    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"c052a878d4500b5e148e15bbd38ea7abdbfa3192b49398b76d63ea9c1d66f678"}
Jul 06 23:25:08.483618 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.483572    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"03e4d7a3cb100d56a593815cedcbb8888ef9e153afed79f7489b1ce1b8670603"}
Jul 06 23:25:08.483667 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.483623    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"50a1a35ce8aeaebfd0c6306aaf982d1cceff258856639e0cf9a2d295f53050f6"}
Jul 06 23:25:08.483712 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.483669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"ac2b3f37251afa56ba7f740eea8f7625d2043eb7a6d9164aae580d5187e3d400"}
Jul 06 23:25:08.483761 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.483748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerDied","Data":"ac6f3c87f2ea82bd3ff5ecaba7a9957e4b7d8c0df02798e23e7c7a0df1accce1"}
Jul 06 23:25:08.483854 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.483788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"f9833c5050b085a208568100f1ca5c07e134a023068cb76feb58ab00cd776165"}
Jul 06 23:25:08.485164 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.485137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4p2l" event={"ID":"f6fb8599-8562-439b-96bd-082b917bb6cd","Type":"ContainerStarted","Data":"b121898699f6218cf89fd2f0fcc58928d0e577023fd493b1703d0b739b55ce39"}
Jul 06 23:25:08.486840 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.486814    2579 generic.go:356] "Generic (PLEG): container finished" podID="8865ded9-58dd-4a10-88d4-dcca74604f2d" containerID="36e34e5ef8987cc14047ac619515175310deee881e53dd9add14c61a9244df8a" exitCode=0
Jul 06 23:25:08.486935 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.486891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerDied","Data":"36e34e5ef8987cc14047ac619515175310deee881e53dd9add14c61a9244df8a"}
Jul 06 23:25:08.528408 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.528358    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xkjpp" podStartSLOduration=4.468107527 podStartE2EDuration="23.528343016s" totalImagesPullingTime="19.060235489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:08.497465587 +0000 UTC m=+23.631457778" watchObservedRunningTime="2026-07-06 23:25:08.528343016 +0000 UTC m=+23.662335270"
Jul 06 23:25:08.583501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.583142    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c2zff" podStartSLOduration=4.505350645 podStartE2EDuration="23.583118392s" totalImagesPullingTime="19.077767747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:08.528585002 +0000 UTC m=+23.662577194" watchObservedRunningTime="2026-07-06 23:25:08.583118392 +0000 UTC m=+23.717110631"
Jul 06 23:25:08.601938 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.601887    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g9wrh" podStartSLOduration=4.54084831 podStartE2EDuration="23.60187279s" totalImagesPullingTime="19.06102448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:08.601655834 +0000 UTC m=+23.735648021" watchObservedRunningTime="2026-07-06 23:25:08.60187279 +0000 UTC m=+23.735864981"
Jul 06 23:25:08.620958 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.620911    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f4p2l" podStartSLOduration=4.519546674 podStartE2EDuration="23.620897695s" totalImagesPullingTime="19.101351021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:08.620797272 +0000 UTC m=+23.754789464" watchObservedRunningTime="2026-07-06 23:25:08.620897695 +0000 UTC m=+23.754889888"
Jul 06 23:25:08.909205 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:08.909185    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 23:25:09.311376 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.311269    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:25:08.909202152Z","UUID":"b2ace033-49d3-43a6-b2c5-9acb032c1cf4","Handler":null,"Name":"","Endpoint":""}
Jul 06 23:25:09.312733 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.312704    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 23:25:09.312848 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.312750    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 23:25:09.374351 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.374320    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:09.374543 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.374323    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:09.374543 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:09.374448    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:09.374543 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.374500    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:09.374687 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:09.374598    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:09.374723 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:09.374679    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:09.490935 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.490711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzvjn" event={"ID":"e04781bf-e0b3-4ed8-85b6-34a8f3c26ab8","Type":"ContainerStarted","Data":"21f8b1fab9fd3f4962c1ead24c57175cfdcd452599bb0413ac9c060c20ca4be0"}
Jul 06 23:25:09.493003 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.492970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8" event={"ID":"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e","Type":"ContainerStarted","Data":"84971c75574522e5b977b3daef4d9fcdcdda887664d5d2b64fcd01f6782aee9b"}
Jul 06 23:25:09.507459 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:09.507404    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzvjn" podStartSLOduration=5.417626418 podStartE2EDuration="24.507389759s" totalImagesPullingTime="19.089763341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:09.507331868 +0000 UTC m=+24.641324059" watchObservedRunningTime="2026-07-06 23:25:09.507389759 +0000 UTC m=+24.641381950"
Jul 06 23:25:10.497626 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:10.497591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8" event={"ID":"dbc7e1cf-b72b-44fc-b828-4b6c172cc55e","Type":"ContainerStarted","Data":"1f3441e39d5f7d85477987664ee465e7a953c1559ee4bf6d3abf0c4cf6a1ae8a"}
Jul 06 23:25:10.518136 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:10.518082    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wbn8" podStartSLOduration=4.071397543 podStartE2EDuration="25.518044463s" totalImagesPullingTime="21.44664692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:10.517702347 +0000 UTC m=+25.651694539" watchObservedRunningTime="2026-07-06 23:25:10.518044463 +0000 UTC m=+25.652036655"
Jul 06 23:25:11.373718 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:11.373682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:11.373974 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:11.373808    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:11.373974 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:11.373682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:11.373974 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:11.373894    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:11.373974 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:11.373682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:11.374176 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:11.373983    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:11.503194 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:11.503164    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:25:11.503974 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:11.503940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"d1a1493f976a85c78bf5d242e7fa48db55ec92613a5679627daf91e96c17cd86"}
Jul 06 23:25:13.114440 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.114214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:25:13.114902 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.114792    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:25:13.374337 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.373962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:13.374337 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.373962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:13.374337 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:13.374154    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:13.374337 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.374199    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:13.374337 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:13.374192    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:13.374337 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:13.374294    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:13.511898 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.511877    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:25:13.512287 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.512262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"66ead681f6e83515f6f0c95707103100c77194fe6a32390269c9449020773fee"}
Jul 06 23:25:13.518392 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.518087    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:25:13.518392 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.518317    2579 scope.go:117] "RemoveContainer" containerID="ac6f3c87f2ea82bd3ff5ecaba7a9957e4b7d8c0df02798e23e7c7a0df1accce1"
Jul 06 23:25:13.518523 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:13.518487    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g9wrh"
Jul 06 23:25:14.521384 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.521195    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:25:14.522192 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.521765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" event={"ID":"bf625c0c-d1d0-49ec-8925-191df5cac5e1","Type":"ContainerStarted","Data":"00a9ddd67c40dd96333d897e0e95958032a866969322c8a8e898daba6e58539e"}
Jul 06 23:25:14.522499 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.522479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:25:14.522634 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.522574    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:25:14.522703 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.522644    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:25:14.524111 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.524084    2579 generic.go:356] "Generic (PLEG): container finished" podID="8865ded9-58dd-4a10-88d4-dcca74604f2d" containerID="de40160672a01437d8cded4ed20f7522c6131ced251f6a770e03d4ead9daeeb7" exitCode=0
Jul 06 23:25:14.524588 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.524539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerDied","Data":"de40160672a01437d8cded4ed20f7522c6131ced251f6a770e03d4ead9daeeb7"}
Jul 06 23:25:14.542536 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.542335    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:25:14.546828 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.546798    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:25:14.572014 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:14.571954    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt" podStartSLOduration=10.080612895 podStartE2EDuration="29.571934602s" totalImagesPullingTime="19.491321707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:14.548143875 +0000 UTC m=+29.682136068" watchObservedRunningTime="2026-07-06 23:25:14.571934602 +0000 UTC m=+29.705926797"
Jul 06 23:25:15.374951 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.374919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:15.375136 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.375010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:15.375136 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.375038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:15.375136 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:15.375084    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:15.375305 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:15.375146    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:15.375305 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:15.375226    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:15.538144 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.538114    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8rjl4"]
Jul 06 23:25:15.538504 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.538199    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:15.538504 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:15.538281    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:15.542231 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.542199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h85xb"]
Jul 06 23:25:15.542643 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.542542    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:15.542698 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:15.542646    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:15.542975 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.542911    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kqqs9"]
Jul 06 23:25:15.543083 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:15.543003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:15.543190 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:15.543124    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:16.529965 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:16.529930    2579 generic.go:356] "Generic (PLEG): container finished" podID="8865ded9-58dd-4a10-88d4-dcca74604f2d" containerID="81d5f0e98415bdede3cbfd1b78f4363c7288d3c46459d64262b4ff37fc5a8d0f" exitCode=0
Jul 06 23:25:16.530139 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:16.530006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerDied","Data":"81d5f0e98415bdede3cbfd1b78f4363c7288d3c46459d64262b4ff37fc5a8d0f"}
Jul 06 23:25:17.373938 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:17.373686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:17.374259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:17.373693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:17.374259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:17.373768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:17.374259 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:17.374120    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:17.374259 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:17.374234    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:17.374400 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:17.374345    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:17.534770 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:17.534744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerStarted","Data":"9fe7d8c4543282ec811fa35f500642ad0c7e18fc43dc29de997c8eaffb5a2dd1"}
Jul 06 23:25:18.538876 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:18.538841    2579 generic.go:356] "Generic (PLEG): container finished" podID="8865ded9-58dd-4a10-88d4-dcca74604f2d" containerID="9fe7d8c4543282ec811fa35f500642ad0c7e18fc43dc29de997c8eaffb5a2dd1" exitCode=0
Jul 06 23:25:18.539385 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:18.538891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerDied","Data":"9fe7d8c4543282ec811fa35f500642ad0c7e18fc43dc29de997c8eaffb5a2dd1"}
Jul 06 23:25:18.994227 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:18.994186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:18.994374 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:18.994298    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:25:18.994374 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:18.994351    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs podName:48700b44-4c22-4932-bc22-aa11fec4c9cc nodeName:}" failed. No retries permitted until 2026-07-06 23:25:50.994336383 +0000 UTC m=+66.128328552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs") pod "network-metrics-daemon-kqqs9" (UID: "48700b44-4c22-4932-bc22-aa11fec4c9cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:25:19.095353 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:19.095322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:19.095517 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:19.095369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:19.095517 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.095479    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:25:19.095517 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.095509    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:25:19.095690 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.095533    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:25:19.095690 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.095546    2579 projected.go:196] Error preparing data for projected volume kube-api-access-b6qfb for pod openshift-network-diagnostics/network-check-target-h85xb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:25:19.095690 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.095547    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret podName:f7371def-54bf-424c-8fe0-3f05a45aed2a nodeName:}" failed. No retries permitted until 2026-07-06 23:25:51.095528453 +0000 UTC m=+66.229520636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret") pod "global-pull-secret-syncer-8rjl4" (UID: "f7371def-54bf-424c-8fe0-3f05a45aed2a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:25:19.095690 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.095607    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb podName:f66c8c10-7e40-481e-801e-de2a12692c4c nodeName:}" failed. No retries permitted until 2026-07-06 23:25:51.095590027 +0000 UTC m=+66.229582201 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6qfb" (UniqueName: "kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb") pod "network-check-target-h85xb" (UID: "f66c8c10-7e40-481e-801e-de2a12692c4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:25:19.374264 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:19.374235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:19.374432 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:19.374235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:19.374432 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:19.374244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:19.374432 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.374390    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqqs9" podUID="48700b44-4c22-4932-bc22-aa11fec4c9cc"
Jul 06 23:25:19.374571 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.374451    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h85xb" podUID="f66c8c10-7e40-481e-801e-de2a12692c4c"
Jul 06 23:25:19.374571 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:19.374535    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8rjl4" podUID="f7371def-54bf-424c-8fe0-3f05a45aed2a"
Jul 06 23:25:20.139048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.139013    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-34.ec2.internal" event="NodeReady"
Jul 06 23:25:20.139582 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.139199    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 23:25:20.204501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.204467    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gt4hl"]
Jul 06 23:25:20.206754 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.206728    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ll5q4"]
Jul 06 23:25:20.206882 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.206863    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.208620 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.208601    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"]
Jul 06 23:25:20.208746 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.208729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ll5q4"
Jul 06 23:25:20.209322 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.209297    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8bk56\""
Jul 06 23:25:20.209887 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.209866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 23:25:20.210400 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.210380    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 23:25:20.210505 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.210430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.211664 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.211113    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wfrjk\""
Jul 06 23:25:20.211664 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.211141    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 23:25:20.211664 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.211357    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 23:25:20.211664 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.211546    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 23:25:20.213248 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.213206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 23:25:20.213248 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.213240    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8jct7\""
Jul 06 23:25:20.213616 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.213259    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 23:25:20.213616 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.213211    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 23:25:20.218464 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.218440    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ll5q4"]
Jul 06 23:25:20.220538 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.220513    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 23:25:20.220699 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.220557    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gt4hl"]
Jul 06 23:25:20.225029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.221196    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"]
Jul 06 23:25:20.303693 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz2f8\" (UniqueName: \"kubernetes.io/projected/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-kube-api-access-fz2f8\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.303693 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26tlr\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-kube-api-access-26tlr\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.303893 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.303893 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f3d36b-09d8-411b-9775-624efb03a0d5-cert\") pod \"ingress-canary-ll5q4\" (UID: \"33f3d36b-09d8-411b-9775-624efb03a0d5\") " pod="openshift-ingress-canary/ingress-canary-ll5q4"
Jul 06 23:25:20.303893 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.304048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whgpm\" (UniqueName: \"kubernetes.io/projected/33f3d36b-09d8-411b-9775-624efb03a0d5-kube-api-access-whgpm\") pod \"ingress-canary-ll5q4\" (UID: \"33f3d36b-09d8-411b-9775-624efb03a0d5\") " pod="openshift-ingress-canary/ingress-canary-ll5q4"
Jul 06 23:25:20.304048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-image-registry-private-configuration\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.304048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-trusted-ca\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.304048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.303990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-config-volume\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.304048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.304020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-bound-sa-token\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.304048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.304042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-certificates\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.304352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.304093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-tmp-dir\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.304352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.304126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-ca-trust-extracted\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.304352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.304156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-installation-pull-secrets\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.404773 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.404742    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.404773 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.404786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f3d36b-09d8-411b-9775-624efb03a0d5-cert\") pod \"ingress-canary-ll5q4\" (UID: \"33f3d36b-09d8-411b-9775-624efb03a0d5\") " pod="openshift-ingress-canary/ingress-canary-ll5q4"
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.404817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.404843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whgpm\" (UniqueName: \"kubernetes.io/projected/33f3d36b-09d8-411b-9775-624efb03a0d5-kube-api-access-whgpm\") pod \"ingress-canary-ll5q4\" (UID: \"33f3d36b-09d8-411b-9775-624efb03a0d5\") " pod="openshift-ingress-canary/ingress-canary-ll5q4"
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.404865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-image-registry-private-configuration\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.404891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-trusted-ca\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.404900    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.404923    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb79cd5b6-rbrvh: secret "image-registry-tls" not found
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.404980    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.404988    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls podName:f6a1b21e-8a7e-409c-aad9-d7b0abae01e9 nodeName:}" failed. No retries permitted until 2026-07-06 23:25:20.90496533 +0000 UTC m=+36.038957520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls") pod "image-registry-7bb79cd5b6-rbrvh" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9") : secret "image-registry-tls" not found
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.405020    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls podName:d30d0e7e-b72c-455c-9e03-bf6df9d1260b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:20.90500577 +0000 UTC m=+36.038997942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls") pod "dns-default-gt4hl" (UID: "d30d0e7e-b72c-455c-9e03-bf6df9d1260b") : secret "dns-default-metrics-tls" not found
Jul 06 23:25:20.405022 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-config-volume\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.405564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-bound-sa-token\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.405564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-certificates\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.405564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-tmp-dir\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.405564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-ca-trust-extracted\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.405564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-installation-pull-secrets\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.405564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405472    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-tmp-dir\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.405564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz2f8\" (UniqueName: \"kubernetes.io/projected/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-kube-api-access-fz2f8\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.405564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26tlr\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-kube-api-access-26tlr\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.405944 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405653    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-config-volume\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.405944 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.405653    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-ca-trust-extracted\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.406044 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.406032    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-certificates\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.406272 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.406251    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-trusted-ca\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.409278 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.409250    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-image-registry-private-configuration\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.409371 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.409250    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-installation-pull-secrets\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.409371 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.409285    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f3d36b-09d8-411b-9775-624efb03a0d5-cert\") pod \"ingress-canary-ll5q4\" (UID: \"33f3d36b-09d8-411b-9775-624efb03a0d5\") " pod="openshift-ingress-canary/ingress-canary-ll5q4"
Jul 06 23:25:20.414968 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.414940    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz2f8\" (UniqueName: \"kubernetes.io/projected/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-kube-api-access-fz2f8\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.415106 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.414968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26tlr\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-kube-api-access-26tlr\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.416571 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.416521    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-bound-sa-token\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.417228 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.417208    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whgpm\" (UniqueName: \"kubernetes.io/projected/33f3d36b-09d8-411b-9775-624efb03a0d5-kube-api-access-whgpm\") pod \"ingress-canary-ll5q4\" (UID: \"33f3d36b-09d8-411b-9775-624efb03a0d5\") " pod="openshift-ingress-canary/ingress-canary-ll5q4"
Jul 06 23:25:20.551950 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.551877    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ll5q4"
Jul 06 23:25:20.701110 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.701081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ll5q4"]
Jul 06 23:25:20.706424 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:20.706261    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f3d36b_09d8_411b_9775_624efb03a0d5.slice/crio-0f9f2f2dfecb3db8a0d4ae67388c36ca6da4b92a9bb162c5e9a0d04c8ee60c27 WatchSource:0}: Error finding container 0f9f2f2dfecb3db8a0d4ae67388c36ca6da4b92a9bb162c5e9a0d04c8ee60c27: Status 404 returned error can't find the container with id 0f9f2f2dfecb3db8a0d4ae67388c36ca6da4b92a9bb162c5e9a0d04c8ee60c27
Jul 06 23:25:20.909994 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.909906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:20.909994 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:20.909956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:20.910236 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.910099    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:25:20.910236 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.910134    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb79cd5b6-rbrvh: secret "image-registry-tls" not found
Jul 06 23:25:20.910236 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.910197    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls podName:f6a1b21e-8a7e-409c-aad9-d7b0abae01e9 nodeName:}" failed. No retries permitted until 2026-07-06 23:25:21.910176217 +0000 UTC m=+37.044168400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls") pod "image-registry-7bb79cd5b6-rbrvh" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9") : secret "image-registry-tls" not found
Jul 06 23:25:20.910236 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.910106    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:25:20.910422 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:20.910271    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls podName:d30d0e7e-b72c-455c-9e03-bf6df9d1260b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:21.91025323 +0000 UTC m=+37.044245404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls") pod "dns-default-gt4hl" (UID: "d30d0e7e-b72c-455c-9e03-bf6df9d1260b") : secret "dns-default-metrics-tls" not found
Jul 06 23:25:21.375050 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.374464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:21.375050 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.374465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:21.375050 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.374464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:21.377137 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.377112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:25:21.378539 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.377977    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:25:21.378539 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.378046    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsplq\""
Jul 06 23:25:21.378539 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.378219    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:25:21.378539 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.378267    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9hjn2\""
Jul 06 23:25:21.378539 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.378444    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:25:21.547725 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.547653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ll5q4" event={"ID":"33f3d36b-09d8-411b-9775-624efb03a0d5","Type":"ContainerStarted","Data":"0f9f2f2dfecb3db8a0d4ae67388c36ca6da4b92a9bb162c5e9a0d04c8ee60c27"}
Jul 06 23:25:21.918789 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.918491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:21.918789 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:21.918545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:21.918789 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:21.918661    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:25:21.918789 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:21.918682    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb79cd5b6-rbrvh: secret "image-registry-tls" not found
Jul 06 23:25:21.918789 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:21.918686    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:25:21.918789 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:21.918747    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls podName:d30d0e7e-b72c-455c-9e03-bf6df9d1260b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:23.91873264 +0000 UTC m=+39.052724809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls") pod "dns-default-gt4hl" (UID: "d30d0e7e-b72c-455c-9e03-bf6df9d1260b") : secret "dns-default-metrics-tls" not found
Jul 06 23:25:21.918789 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:21.918762    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls podName:f6a1b21e-8a7e-409c-aad9-d7b0abae01e9 nodeName:}" failed. No retries permitted until 2026-07-06 23:25:23.91875627 +0000 UTC m=+39.052748452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls") pod "image-registry-7bb79cd5b6-rbrvh" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9") : secret "image-registry-tls" not found
Jul 06 23:25:23.936171 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:23.936148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:23.936490 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:23.936272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:23.936490 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:23.936292    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:25:23.936490 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:23.936341    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls podName:d30d0e7e-b72c-455c-9e03-bf6df9d1260b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:27.936322222 +0000 UTC m=+43.070314391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls") pod "dns-default-gt4hl" (UID: "d30d0e7e-b72c-455c-9e03-bf6df9d1260b") : secret "dns-default-metrics-tls" not found
Jul 06 23:25:23.936490 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:23.936376    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:25:23.936490 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:23.936388    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb79cd5b6-rbrvh: secret "image-registry-tls" not found
Jul 06 23:25:23.936490 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:23.936426    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls podName:f6a1b21e-8a7e-409c-aad9-d7b0abae01e9 nodeName:}" failed. No retries permitted until 2026-07-06 23:25:27.936415014 +0000 UTC m=+43.070407204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls") pod "image-registry-7bb79cd5b6-rbrvh" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9") : secret "image-registry-tls" not found
Jul 06 23:25:24.557598 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:24.557559    2579 generic.go:356] "Generic (PLEG): container finished" podID="8865ded9-58dd-4a10-88d4-dcca74604f2d" containerID="93e8e8ac4c56acc25e9bade1cb017085c769cea6e35c599b4984d07ff6c48ab2" exitCode=0
Jul 06 23:25:24.557772 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:24.557638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerDied","Data":"93e8e8ac4c56acc25e9bade1cb017085c769cea6e35c599b4984d07ff6c48ab2"}
Jul 06 23:25:24.559075 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:24.559031    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ll5q4" event={"ID":"33f3d36b-09d8-411b-9775-624efb03a0d5","Type":"ContainerStarted","Data":"41cbe45b19daf0192e4182a8584e8c8ebfa42ef0a0398a0b9df319eb62d05c91"}
Jul 06 23:25:24.597780 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:24.597728    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ll5q4" podStartSLOduration=1.443500277 podStartE2EDuration="4.597709051s" totalImagesPullingTime="3.154208774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:24.597191775 +0000 UTC m=+39.731183966" watchObservedRunningTime="2026-07-06 23:25:24.597709051 +0000 UTC m=+39.731701257"
Jul 06 23:25:25.563945 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:25.563907    2579 generic.go:356] "Generic (PLEG): container finished" podID="8865ded9-58dd-4a10-88d4-dcca74604f2d" containerID="d01be78d61dfa87c9278cc262e4c786cb0e13b45c7d51d449c595ff50f90dea5" exitCode=0
Jul 06 23:25:25.564521 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:25.564000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerDied","Data":"d01be78d61dfa87c9278cc262e4c786cb0e13b45c7d51d449c595ff50f90dea5"}
Jul 06 23:25:26.570077 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:26.570022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" event={"ID":"8865ded9-58dd-4a10-88d4-dcca74604f2d","Type":"ContainerStarted","Data":"2ad9e55a51186e5b0e26b3bdc7dd23eb7a79086519aa676b916c335f1e0babac"}
Jul 06 23:25:26.592803 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:26.592741    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9x9lb" podStartSLOduration=10.45326159 podStartE2EDuration="41.592722483s" totalImagesPullingTime="31.139460893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:26.59128037 +0000 UTC m=+41.725272589" watchObservedRunningTime="2026-07-06 23:25:26.592722483 +0000 UTC m=+41.726714674"
Jul 06 23:25:27.966318 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:27.966280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:27.966318 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:27.966320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:27.966807 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:27.966435    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:25:27.966807 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:27.966446    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:25:27.966807 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:27.966468    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb79cd5b6-rbrvh: secret "image-registry-tls" not found
Jul 06 23:25:27.966807 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:27.966489    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls podName:d30d0e7e-b72c-455c-9e03-bf6df9d1260b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:35.966473387 +0000 UTC m=+51.100465558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls") pod "dns-default-gt4hl" (UID: "d30d0e7e-b72c-455c-9e03-bf6df9d1260b") : secret "dns-default-metrics-tls" not found
Jul 06 23:25:27.966807 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:27.966524    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls podName:f6a1b21e-8a7e-409c-aad9-d7b0abae01e9 nodeName:}" failed. No retries permitted until 2026-07-06 23:25:35.96650668 +0000 UTC m=+51.100498866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls") pod "image-registry-7bb79cd5b6-rbrvh" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9") : secret "image-registry-tls" not found
Jul 06 23:25:31.920633 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:31.920600    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ts8ft"]
Jul 06 23:25:31.957439 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:31.957407    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ts8ft"]
Jul 06 23:25:31.957591 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:31.957528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:31.959818 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:31.959788    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 23:25:31.959953 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:31.959847    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 23:25:31.959953 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:31.959868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 23:25:31.960723 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:31.960707    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 23:25:31.960768 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:31.960725    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d7jfq\""
Jul 06 23:25:32.096162 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.096122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.096352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.096209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6fff33a-c889-405b-997b-9223296fc04b-crio-socket\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.096352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.096263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6fff33a-c889-405b-997b-9223296fc04b-data-volume\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.096352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.096323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7w4j\" (UniqueName: \"kubernetes.io/projected/d6fff33a-c889-405b-997b-9223296fc04b-kube-api-access-b7w4j\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.096487 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.096408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.197098 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.197050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.197259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.197112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.197259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.197147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6fff33a-c889-405b-997b-9223296fc04b-crio-socket\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.197259 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:32.197157    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:32.197259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.197180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6fff33a-c889-405b-997b-9223296fc04b-data-volume\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.197259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.197206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7w4j\" (UniqueName: \"kubernetes.io/projected/d6fff33a-c889-405b-997b-9223296fc04b-kube-api-access-b7w4j\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.197259 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:32.197227    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:32.697207448 +0000 UTC m=+47.831199634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:32.197259 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:32.197232    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:25:32.197602 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:32.197297    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:32.697277239 +0000 UTC m=+47.831269425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : configmap "kube-rbac-proxy" not found
Jul 06 23:25:32.197602 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.197366    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6fff33a-c889-405b-997b-9223296fc04b-crio-socket\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.197602 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.197544    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6fff33a-c889-405b-997b-9223296fc04b-data-volume\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.219210 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.219185    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7w4j\" (UniqueName: \"kubernetes.io/projected/d6fff33a-c889-405b-997b-9223296fc04b-kube-api-access-b7w4j\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.701067 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.701023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.701246 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:32.701151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:32.701246 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:32.701174    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:25:32.701246 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:32.701237    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:32.701396 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:32.701257    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:33.701236397 +0000 UTC m=+48.835228589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : configmap "kube-rbac-proxy" not found
Jul 06 23:25:32.701396 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:32.701277    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:33.701266152 +0000 UTC m=+48.835258321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:33.705454 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:33.705424    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2zff_f37af222-6916-4949-a335-4f342064f030/dns-node-resolver/0.log"
Jul 06 23:25:33.709715 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:33.709689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:33.709861 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:33.709735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:33.709861 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:33.709813    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:25:33.709950 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:33.709856    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:33.709950 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:33.709863    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:35.70984527 +0000 UTC m=+50.843837454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : configmap "kube-rbac-proxy" not found
Jul 06 23:25:33.710032 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:33.710007    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:35.70998948 +0000 UTC m=+50.843981653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:35.102853 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:35.102825    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkjpp_86dd081b-d5f7-4eb5-b4f8-e5565742b5da/node-ca/0.log"
Jul 06 23:25:35.727044 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:35.727006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:35.727044 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:35.727046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:35.727323 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:35.727141    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:25:35.727323 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:35.727183    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:35.727323 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:35.727200    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:39.72718487 +0000 UTC m=+54.861177040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : configmap "kube-rbac-proxy" not found
Jul 06 23:25:35.727323 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:35.727259    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:39.727241483 +0000 UTC m=+54.861233674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:35.903343 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:35.903315    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ll5q4_33f3d36b-09d8-411b-9775-624efb03a0d5/serve-healthcheck-canary/0.log"
Jul 06 23:25:36.030531 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:36.030453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:36.030673 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:36.030553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:36.030673 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:36.030603    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:25:36.030673 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:36.030635    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:25:36.030673 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:36.030645    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bb79cd5b6-rbrvh: secret "image-registry-tls" not found
Jul 06 23:25:36.030673 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:36.030669    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls podName:d30d0e7e-b72c-455c-9e03-bf6df9d1260b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:52.030653023 +0000 UTC m=+67.164645215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls") pod "dns-default-gt4hl" (UID: "d30d0e7e-b72c-455c-9e03-bf6df9d1260b") : secret "dns-default-metrics-tls" not found
Jul 06 23:25:36.030851 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:36.030686    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls podName:f6a1b21e-8a7e-409c-aad9-d7b0abae01e9 nodeName:}" failed. No retries permitted until 2026-07-06 23:25:52.030676084 +0000 UTC m=+67.164668252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls") pod "image-registry-7bb79cd5b6-rbrvh" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9") : secret "image-registry-tls" not found
Jul 06 23:25:39.757488 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:39.757456    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:39.757925 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:39.757500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:39.757925 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:39.757619    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:39.757925 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:25:39.757686    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls podName:d6fff33a-c889-405b-997b-9223296fc04b nodeName:}" failed. No retries permitted until 2026-07-06 23:25:47.757671928 +0000 UTC m=+62.891664097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts8ft" (UID: "d6fff33a-c889-405b-997b-9223296fc04b") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:25:39.758032 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:39.758003    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6fff33a-c889-405b-997b-9223296fc04b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:46.540816 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:46.540780    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cblqt"
Jul 06 23:25:47.820263 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:47.820230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:47.822669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:47.822644    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6fff33a-c889-405b-997b-9223296fc04b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts8ft\" (UID: \"d6fff33a-c889-405b-997b-9223296fc04b\") " pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:47.868356 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:47.868329    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d7jfq\""
Jul 06 23:25:47.876432 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:47.876415    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ts8ft"
Jul 06 23:25:48.005366 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:48.005336    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ts8ft"]
Jul 06 23:25:48.009756 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:48.009732    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6fff33a_c889_405b_997b_9223296fc04b.slice/crio-f1161dbfc620ec31a26a2762176ba04fb546a4b0d59834ddab1334b296109fe9 WatchSource:0}: Error finding container f1161dbfc620ec31a26a2762176ba04fb546a4b0d59834ddab1334b296109fe9: Status 404 returned error can't find the container with id f1161dbfc620ec31a26a2762176ba04fb546a4b0d59834ddab1334b296109fe9
Jul 06 23:25:48.623740 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:48.623646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ts8ft" event={"ID":"d6fff33a-c889-405b-997b-9223296fc04b","Type":"ContainerStarted","Data":"f1161dbfc620ec31a26a2762176ba04fb546a4b0d59834ddab1334b296109fe9"}
Jul 06 23:25:51.053718 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.053669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:51.056281 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.056262    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:25:51.066702 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.066675    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48700b44-4c22-4932-bc22-aa11fec4c9cc-metrics-certs\") pod \"network-metrics-daemon-kqqs9\" (UID: \"48700b44-4c22-4932-bc22-aa11fec4c9cc\") " pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:51.107934 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.107897    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsplq\""
Jul 06 23:25:51.115733 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.115697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqqs9"
Jul 06 23:25:51.154787 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.154751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:51.154957 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.154795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:51.157319 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.157296    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:25:51.157437 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.157296    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:25:51.167966 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.167940    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:25:51.168415 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.168395    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7371def-54bf-424c-8fe0-3f05a45aed2a-original-pull-secret\") pod \"global-pull-secret-syncer-8rjl4\" (UID: \"f7371def-54bf-424c-8fe0-3f05a45aed2a\") " pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:51.179544 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.179519    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6qfb\" (UniqueName: \"kubernetes.io/projected/f66c8c10-7e40-481e-801e-de2a12692c4c-kube-api-access-b6qfb\") pod \"network-check-target-h85xb\" (UID: \"f66c8c10-7e40-481e-801e-de2a12692c4c\") " pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:51.392413 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.392329    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9hjn2\""
Jul 06 23:25:51.398572 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.398550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rjl4"
Jul 06 23:25:51.400295 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.400264    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:51.688459 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.688432    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h85xb"]
Jul 06 23:25:51.691843 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:51.691809    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66c8c10_7e40_481e_801e_de2a12692c4c.slice/crio-99fc0d5678bf93b5748118a9b52cde21e21afcd8e5f8746255cd893fec0e46f5 WatchSource:0}: Error finding container 99fc0d5678bf93b5748118a9b52cde21e21afcd8e5f8746255cd893fec0e46f5: Status 404 returned error can't find the container with id 99fc0d5678bf93b5748118a9b52cde21e21afcd8e5f8746255cd893fec0e46f5
Jul 06 23:25:51.705280 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.705248    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8rjl4"]
Jul 06 23:25:51.708472 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:51.708442    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7371def_54bf_424c_8fe0_3f05a45aed2a.slice/crio-8247cd8305929f3a64654222549d9f0216b9118e1c8257417159e2cc30efcb68 WatchSource:0}: Error finding container 8247cd8305929f3a64654222549d9f0216b9118e1c8257417159e2cc30efcb68: Status 404 returned error can't find the container with id 8247cd8305929f3a64654222549d9f0216b9118e1c8257417159e2cc30efcb68
Jul 06 23:25:51.725656 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:51.725631    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kqqs9"]
Jul 06 23:25:51.728546 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:51.728514    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48700b44_4c22_4932_bc22_aa11fec4c9cc.slice/crio-41f53546c5b8b62b1e0909934fcc36d686bc5a022d708435b99524ea022a4b13 WatchSource:0}: Error finding container 41f53546c5b8b62b1e0909934fcc36d686bc5a022d708435b99524ea022a4b13: Status 404 returned error can't find the container with id 41f53546c5b8b62b1e0909934fcc36d686bc5a022d708435b99524ea022a4b13
Jul 06 23:25:52.063242 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.063211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:52.063685 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.063258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:52.065547 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.065523    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30d0e7e-b72c-455c-9e03-bf6df9d1260b-metrics-tls\") pod \"dns-default-gt4hl\" (UID: \"d30d0e7e-b72c-455c-9e03-bf6df9d1260b\") " pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:52.065547 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.065537    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"image-registry-7bb79cd5b6-rbrvh\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") " pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:52.321770 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.321693    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8bk56\""
Jul 06 23:25:52.329506 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.329476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:52.362135 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.362020    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8jct7\""
Jul 06 23:25:52.370776 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.370486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:52.504606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.504519    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gt4hl"]
Jul 06 23:25:52.557467 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.557405    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"]
Jul 06 23:25:52.640862 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.640766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqqs9" event={"ID":"48700b44-4c22-4932-bc22-aa11fec4c9cc","Type":"ContainerStarted","Data":"41f53546c5b8b62b1e0909934fcc36d686bc5a022d708435b99524ea022a4b13"}
Jul 06 23:25:52.645989 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.645956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ts8ft" event={"ID":"d6fff33a-c889-405b-997b-9223296fc04b","Type":"ContainerStarted","Data":"49b64c746eed7e98d49c41acda576664efc00db7267adf761e349c47487f524d"}
Jul 06 23:25:52.646168 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.646029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ts8ft" event={"ID":"d6fff33a-c889-405b-997b-9223296fc04b","Type":"ContainerStarted","Data":"8abce06b8e60f98e123a597fe318cb0fe4a2bc93b94472114295e1204d58b32d"}
Jul 06 23:25:52.648862 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.648753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gt4hl" event={"ID":"d30d0e7e-b72c-455c-9e03-bf6df9d1260b","Type":"ContainerStarted","Data":"4f2e3580911e47c757e5b8578d68e9a70af4cbe744a45d19bfdf15b83df01e17"}
Jul 06 23:25:52.650249 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.650147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8rjl4" event={"ID":"f7371def-54bf-424c-8fe0-3f05a45aed2a","Type":"ContainerStarted","Data":"8247cd8305929f3a64654222549d9f0216b9118e1c8257417159e2cc30efcb68"}
Jul 06 23:25:52.651531 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:52.651439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h85xb" event={"ID":"f66c8c10-7e40-481e-801e-de2a12692c4c","Type":"ContainerStarted","Data":"99fc0d5678bf93b5748118a9b52cde21e21afcd8e5f8746255cd893fec0e46f5"}
Jul 06 23:25:52.881282 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:52.881237    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a1b21e_8a7e_409c_aad9_d7b0abae01e9.slice/crio-e4300ca37bcb876cecc57724571e10bc29354c7992902f49f61e08b65a5f59a3 WatchSource:0}: Error finding container e4300ca37bcb876cecc57724571e10bc29354c7992902f49f61e08b65a5f59a3: Status 404 returned error can't find the container with id e4300ca37bcb876cecc57724571e10bc29354c7992902f49f61e08b65a5f59a3
Jul 06 23:25:53.659627 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:53.659587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqqs9" event={"ID":"48700b44-4c22-4932-bc22-aa11fec4c9cc","Type":"ContainerStarted","Data":"bec2a671293deb408e4107ef5c7349ccc6f8be13a7a633b1c4138052be8f3411"}
Jul 06 23:25:53.660121 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:53.659689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqqs9" event={"ID":"48700b44-4c22-4932-bc22-aa11fec4c9cc","Type":"ContainerStarted","Data":"2e423b944a3f64e5383836c3ffc9163d3c41f0dd28f37692e261ed4c942c7467"}
Jul 06 23:25:53.662396 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:53.662352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh" event={"ID":"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9","Type":"ContainerStarted","Data":"5b08d430dec3ee42592531abda9ce24891cf1e11b882b11aa218c71c8f7af900"}
Jul 06 23:25:53.662396 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:53.662399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh" event={"ID":"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9","Type":"ContainerStarted","Data":"e4300ca37bcb876cecc57724571e10bc29354c7992902f49f61e08b65a5f59a3"}
Jul 06 23:25:53.662877 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:53.662853    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:25:53.680491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:53.680094    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kqqs9" podStartSLOduration=67.496431752 podStartE2EDuration="1m8.680075731s" totalImagesPullingTime="1.183643979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:53.679402975 +0000 UTC m=+68.813395166" watchObservedRunningTime="2026-07-06 23:25:53.680075731 +0000 UTC m=+68.814067923"
Jul 06 23:25:53.706074 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:53.706002    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh" podStartSLOduration=67.705979459 podStartE2EDuration="1m7.705979459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:53.705423099 +0000 UTC m=+68.839415290" watchObservedRunningTime="2026-07-06 23:25:53.705979459 +0000 UTC m=+68.839971649"
Jul 06 23:25:55.959520 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.959217    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"]
Jul 06 23:25:55.963091 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.963067    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"]
Jul 06 23:25:55.963220 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.963167    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:55.964927 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.964905    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"
Jul 06 23:25:55.965595 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.965576    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 23:25:55.965728 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.965582    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 23:25:55.966533 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.966516    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 23:25:55.966641 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.966586    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 23:25:55.966899 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.966881    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 23:25:55.966962 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.966936    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-z9ntz\""
Jul 06 23:25:55.978328 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.978301    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"]
Jul 06 23:25:55.979247 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.979224    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"]
Jul 06 23:25:55.980105 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:55.980082    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"]
Jul 06 23:25:56.000436 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.000408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a07361-5bfb-42b9-8568-9ba0b9b993ee-tmp\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.000546 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.000460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23a07361-5bfb-42b9-8568-9ba0b9b993ee-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.000593 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.000564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86bd2f0c-de17-432d-b571-db84a82737ac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8fdc48f4-6v46n\" (UID: \"86bd2f0c-de17-432d-b571-db84a82737ac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"
Jul 06 23:25:56.000593 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.000587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvgs5\" (UniqueName: \"kubernetes.io/projected/86bd2f0c-de17-432d-b571-db84a82737ac-kube-api-access-tvgs5\") pod \"managed-serviceaccount-addon-agent-c8fdc48f4-6v46n\" (UID: \"86bd2f0c-de17-432d-b571-db84a82737ac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"
Jul 06 23:25:56.000669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.000607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvclh\" (UniqueName: \"kubernetes.io/projected/23a07361-5bfb-42b9-8568-9ba0b9b993ee-kube-api-access-hvclh\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.065008 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.064973    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-745d88dd69-wncmt"]
Jul 06 23:25:56.066994 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.066975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.084368 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.084343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-745d88dd69-wncmt"]
Jul 06 23:25:56.101163 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c38b0b7f-f123-45db-86b0-885051984241-installation-pull-secrets\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.101310 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c38b0b7f-f123-45db-86b0-885051984241-registry-certificates\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.101310 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86bd2f0c-de17-432d-b571-db84a82737ac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8fdc48f4-6v46n\" (UID: \"86bd2f0c-de17-432d-b571-db84a82737ac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"
Jul 06 23:25:56.101310 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-registry-tls\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.101310 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c38b0b7f-f123-45db-86b0-885051984241-ca-trust-extracted\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.101491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c38b0b7f-f123-45db-86b0-885051984241-image-registry-private-configuration\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.101491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8chsr\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-kube-api-access-8chsr\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.101491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a07361-5bfb-42b9-8568-9ba0b9b993ee-tmp\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.101491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23a07361-5bfb-42b9-8568-9ba0b9b993ee-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.101491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-bound-sa-token\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.101708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvgs5\" (UniqueName: \"kubernetes.io/projected/86bd2f0c-de17-432d-b571-db84a82737ac-kube-api-access-tvgs5\") pod \"managed-serviceaccount-addon-agent-c8fdc48f4-6v46n\" (UID: \"86bd2f0c-de17-432d-b571-db84a82737ac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"
Jul 06 23:25:56.101708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvclh\" (UniqueName: \"kubernetes.io/projected/23a07361-5bfb-42b9-8568-9ba0b9b993ee-kube-api-access-hvclh\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.101708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c38b0b7f-f123-45db-86b0-885051984241-trusted-ca\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.101842 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.101824    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a07361-5bfb-42b9-8568-9ba0b9b993ee-tmp\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.104352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.104332    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86bd2f0c-de17-432d-b571-db84a82737ac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8fdc48f4-6v46n\" (UID: \"86bd2f0c-de17-432d-b571-db84a82737ac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"
Jul 06 23:25:56.104352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.104347    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23a07361-5bfb-42b9-8568-9ba0b9b993ee-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.123952 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.123930    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvclh\" (UniqueName: \"kubernetes.io/projected/23a07361-5bfb-42b9-8568-9ba0b9b993ee-kube-api-access-hvclh\") pod \"klusterlet-addon-workmgr-5b8996b79b-2w5dw\" (UID: \"23a07361-5bfb-42b9-8568-9ba0b9b993ee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.124048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.123998    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvgs5\" (UniqueName: \"kubernetes.io/projected/86bd2f0c-de17-432d-b571-db84a82737ac-kube-api-access-tvgs5\") pod \"managed-serviceaccount-addon-agent-c8fdc48f4-6v46n\" (UID: \"86bd2f0c-de17-432d-b571-db84a82737ac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"
Jul 06 23:25:56.202259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c38b0b7f-f123-45db-86b0-885051984241-image-registry-private-configuration\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.202425 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202271    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8chsr\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-kube-api-access-8chsr\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.202425 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-bound-sa-token\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.202425 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c38b0b7f-f123-45db-86b0-885051984241-trusted-ca\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.202580 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c38b0b7f-f123-45db-86b0-885051984241-installation-pull-secrets\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.202580 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c38b0b7f-f123-45db-86b0-885051984241-registry-certificates\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.202580 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-registry-tls\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.202580 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c38b0b7f-f123-45db-86b0-885051984241-ca-trust-extracted\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.202950 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.202894    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c38b0b7f-f123-45db-86b0-885051984241-ca-trust-extracted\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.203347 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.203328    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c38b0b7f-f123-45db-86b0-885051984241-registry-certificates\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.203598 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.203576    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c38b0b7f-f123-45db-86b0-885051984241-trusted-ca\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.205200 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.205173    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c38b0b7f-f123-45db-86b0-885051984241-installation-pull-secrets\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.205310 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.205208    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c38b0b7f-f123-45db-86b0-885051984241-image-registry-private-configuration\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.205499 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.205480    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-registry-tls\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.220243 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.220178    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-bound-sa-token\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.222297 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.222278    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8chsr\" (UniqueName: \"kubernetes.io/projected/c38b0b7f-f123-45db-86b0-885051984241-kube-api-access-8chsr\") pod \"image-registry-745d88dd69-wncmt\" (UID: \"c38b0b7f-f123-45db-86b0-885051984241\") " pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:56.275710 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.275673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:25:56.285879 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.285849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"
Jul 06 23:25:56.377678 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:56.377644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:58.970327 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:58.970260    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n"]
Jul 06 23:25:58.975023 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:58.974541    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86bd2f0c_de17_432d_b571_db84a82737ac.slice/crio-daee3a18ce5125933ccc2c45afc279c63c572ddc1ab497f97c7aef5a94b61856 WatchSource:0}: Error finding container daee3a18ce5125933ccc2c45afc279c63c572ddc1ab497f97c7aef5a94b61856: Status 404 returned error can't find the container with id daee3a18ce5125933ccc2c45afc279c63c572ddc1ab497f97c7aef5a94b61856
Jul 06 23:25:58.994183 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:58.991997    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"]
Jul 06 23:25:58.998860 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:58.998829    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a07361_5bfb_42b9_8568_9ba0b9b993ee.slice/crio-4f8cb57c6da4e0e1d27ff0bddbaac3ae55a570662acc32d5174de0c24800ce9a WatchSource:0}: Error finding container 4f8cb57c6da4e0e1d27ff0bddbaac3ae55a570662acc32d5174de0c24800ce9a: Status 404 returned error can't find the container with id 4f8cb57c6da4e0e1d27ff0bddbaac3ae55a570662acc32d5174de0c24800ce9a
Jul 06 23:25:59.195690 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.195568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-745d88dd69-wncmt"]
Jul 06 23:25:59.198415 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:25:59.198392    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38b0b7f_f123_45db_86b0_885051984241.slice/crio-05a419302666eddcfa31f8b1105c10beebf3f37ede887b95bbc2804096ac1740 WatchSource:0}: Error finding container 05a419302666eddcfa31f8b1105c10beebf3f37ede887b95bbc2804096ac1740: Status 404 returned error can't find the container with id 05a419302666eddcfa31f8b1105c10beebf3f37ede887b95bbc2804096ac1740
Jul 06 23:25:59.693275 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.692252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gt4hl" event={"ID":"d30d0e7e-b72c-455c-9e03-bf6df9d1260b","Type":"ContainerStarted","Data":"4d7f6ca36f0d9d410e0b8d46219ee53dc5326b4fc063dbe85ff5611bc42b7528"}
Jul 06 23:25:59.693275 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.692323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gt4hl" event={"ID":"d30d0e7e-b72c-455c-9e03-bf6df9d1260b","Type":"ContainerStarted","Data":"79b72a603951333d79e2621e08dec481482d23bb1bc3e167e03d00e8ecfff29b"}
Jul 06 23:25:59.693275 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.693151    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:25:59.698513 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.697986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8rjl4" event={"ID":"f7371def-54bf-424c-8fe0-3f05a45aed2a","Type":"ContainerStarted","Data":"8e7bf609e4c41f9c81673674deab620094e81905a88f752b28b3f0ae3f70f5a1"}
Jul 06 23:25:59.701419 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.701153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h85xb" event={"ID":"f66c8c10-7e40-481e-801e-de2a12692c4c","Type":"ContainerStarted","Data":"0f30cbe2a65bced0545fce0c1d908936b0d15e97edfcd7efefd3828c419dc280"}
Jul 06 23:25:59.701612 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.701591    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:25:59.703947 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.703916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-745d88dd69-wncmt" event={"ID":"c38b0b7f-f123-45db-86b0-885051984241","Type":"ContainerStarted","Data":"eddfdf79e8b04741b12b6f15af2397e20006f1162cbb51a72f6cdc8bcfb10010"}
Jul 06 23:25:59.704048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.703966    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-745d88dd69-wncmt" event={"ID":"c38b0b7f-f123-45db-86b0-885051984241","Type":"ContainerStarted","Data":"05a419302666eddcfa31f8b1105c10beebf3f37ede887b95bbc2804096ac1740"}
Jul 06 23:25:59.704512 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.704430    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:25:59.707047 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.707019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw" event={"ID":"23a07361-5bfb-42b9-8568-9ba0b9b993ee","Type":"ContainerStarted","Data":"4f8cb57c6da4e0e1d27ff0bddbaac3ae55a570662acc32d5174de0c24800ce9a"}
Jul 06 23:25:59.710357 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.709695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ts8ft" event={"ID":"d6fff33a-c889-405b-997b-9223296fc04b","Type":"ContainerStarted","Data":"09443034c0b5bac8a1369f37e20fe8c145104c3738a543a1f93b21c8de32fca0"}
Jul 06 23:25:59.712447 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.712403    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n" event={"ID":"86bd2f0c-de17-432d-b571-db84a82737ac","Type":"ContainerStarted","Data":"daee3a18ce5125933ccc2c45afc279c63c572ddc1ab497f97c7aef5a94b61856"}
Jul 06 23:25:59.738895 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.737766    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h85xb" podStartSLOduration=67.634353533 podStartE2EDuration="1m14.737747802s" totalImagesPullingTime="7.103394269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:59.73656151 +0000 UTC m=+74.870553702" watchObservedRunningTime="2026-07-06 23:25:59.737747802 +0000 UTC m=+74.871739995"
Jul 06 23:25:59.738895 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.738135    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gt4hl" podStartSLOduration=33.459636918 podStartE2EDuration="39.738123066s" totalImagesPullingTime="6.278486148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:59.715088457 +0000 UTC m=+74.849080649" watchObservedRunningTime="2026-07-06 23:25:59.738123066 +0000 UTC m=+74.872115261"
Jul 06 23:25:59.755518 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.755313    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8rjl4" podStartSLOduration=67.657623588 podStartE2EDuration="1m14.755291055s" totalImagesPullingTime="7.097667467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:59.754752247 +0000 UTC m=+74.888744438" watchObservedRunningTime="2026-07-06 23:25:59.755291055 +0000 UTC m=+74.889283246"
Jul 06 23:25:59.782955 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.781897    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ts8ft" podStartSLOduration=18.141145601 podStartE2EDuration="28.781874109s" totalImagesPullingTime="10.640728508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:25:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:59.780972764 +0000 UTC m=+74.914964956" watchObservedRunningTime="2026-07-06 23:25:59.781874109 +0000 UTC m=+74.915866302"
Jul 06 23:25:59.803241 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:25:59.802369    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-745d88dd69-wncmt" podStartSLOduration=3.80234918 podStartE2EDuration="3.80234918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:25:59.800926371 +0000 UTC m=+74.934918563" watchObservedRunningTime="2026-07-06 23:25:59.80234918 +0000 UTC m=+74.936341372"
Jul 06 23:26:02.401025 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.400979    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"]
Jul 06 23:26:02.403322 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.403294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.406830 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.406583    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 23:26:02.406830 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.406617    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 23:26:02.406830 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.406655    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 23:26:02.406830 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.406671    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 23:26:02.406830 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.406619    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 23:26:02.406830 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.406742    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-26cs5\""
Jul 06 23:26:02.414502 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.414433    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"]
Jul 06 23:26:02.454723 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.454687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7c7p\" (UniqueName: \"kubernetes.io/projected/5e74e837-7021-4871-a9a5-3844d18e7685-kube-api-access-s7c7p\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.454889 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.454741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.454889 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.454839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e74e837-7021-4871-a9a5-3844d18e7685-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.454992 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.454928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.556177 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.556133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7c7p\" (UniqueName: \"kubernetes.io/projected/5e74e837-7021-4871-a9a5-3844d18e7685-kube-api-access-s7c7p\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.556381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.556205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.556381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.556247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e74e837-7021-4871-a9a5-3844d18e7685-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.556381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.556309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.556529 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:26:02.556406    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 23:26:02.556529 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:26:02.556462    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-tls podName:5e74e837-7021-4871-a9a5-3844d18e7685 nodeName:}" failed. No retries permitted until 2026-07-06 23:26:03.056444158 +0000 UTC m=+78.190436342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-brrw4" (UID: "5e74e837-7021-4871-a9a5-3844d18e7685") : secret "prometheus-operator-tls" not found
Jul 06 23:26:02.557012 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.556962    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e74e837-7021-4871-a9a5-3844d18e7685-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.559110 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.559082    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:02.565321 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:02.565287    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7c7p\" (UniqueName: \"kubernetes.io/projected/5e74e837-7021-4871-a9a5-3844d18e7685-kube-api-access-s7c7p\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:03.060346 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.060307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:03.062890 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.062866    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e74e837-7021-4871-a9a5-3844d18e7685-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-brrw4\" (UID: \"5e74e837-7021-4871-a9a5-3844d18e7685\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:03.315876 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.315842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"
Jul 06 23:26:03.449570 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.449539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4"]
Jul 06 23:26:03.452763 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:26:03.452739    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e74e837_7021_4871_a9a5_3844d18e7685.slice/crio-da0155e718b33fd7a42b6a1cc4d3d325df15c60d9d0d071eb288df83c293c053 WatchSource:0}: Error finding container da0155e718b33fd7a42b6a1cc4d3d325df15c60d9d0d071eb288df83c293c053: Status 404 returned error can't find the container with id da0155e718b33fd7a42b6a1cc4d3d325df15c60d9d0d071eb288df83c293c053
Jul 06 23:26:03.729847 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.729811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw" event={"ID":"23a07361-5bfb-42b9-8568-9ba0b9b993ee","Type":"ContainerStarted","Data":"f11cbf9b1cea47341b822e2df33a60cb0b2405cc3565a466b5cee74883ff8e32"}
Jul 06 23:26:03.730079 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.729997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:26:03.731406 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.731379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n" event={"ID":"86bd2f0c-de17-432d-b571-db84a82737ac","Type":"ContainerStarted","Data":"e862cdf05b6b53f080057d070f6803a067e50b4baadc93014087692adf24876c"}
Jul 06 23:26:03.731988 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.731968    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw"
Jul 06 23:26:03.732642 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.732621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4" event={"ID":"5e74e837-7021-4871-a9a5-3844d18e7685","Type":"ContainerStarted","Data":"da0155e718b33fd7a42b6a1cc4d3d325df15c60d9d0d071eb288df83c293c053"}
Jul 06 23:26:03.745184 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.745145    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8996b79b-2w5dw" podStartSLOduration=4.879701947 podStartE2EDuration="8.745131912s" totalImagesPullingTime="3.865429965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:26:03.744384671 +0000 UTC m=+78.878376863" watchObservedRunningTime="2026-07-06 23:26:03.745131912 +0000 UTC m=+78.879124102"
Jul 06 23:26:03.765176 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.765134    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8fdc48f4-6v46n" podStartSLOduration=4.885726659 podStartE2EDuration="8.765118623s" totalImagesPullingTime="3.879391964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:26:03.764376006 +0000 UTC m=+78.898368198" watchObservedRunningTime="2026-07-06 23:26:03.765118623 +0000 UTC m=+78.899110813"
Jul 06 23:26:03.907405 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.907368    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554cf97698-m2gfn"]
Jul 06 23:26:03.911270 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.911245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:03.913702 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.913565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 23:26:03.914480 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.914030    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 23:26:03.914480 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.914114    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 23:26:03.914480 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.914170    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n5sh9\""
Jul 06 23:26:03.914480 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.914289    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 23:26:03.914480 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.914311    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 23:26:03.914480 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.914355    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 23:26:03.914480 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.914372    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 23:26:03.922047 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.922024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554cf97698-m2gfn"]
Jul 06 23:26:03.966854 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.966817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-oauth-config\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:03.967006 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.966867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78mz\" (UniqueName: \"kubernetes.io/projected/c65170bc-5db0-4d69-a275-c53ab7b377d5-kube-api-access-t78mz\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:03.967006 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.966901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-config\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:03.967006 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.966941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-serving-cert\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:03.967006 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.966970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-service-ca\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:03.967199 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:03.967016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-oauth-serving-cert\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.068186 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.068106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-oauth-serving-cert\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.068186 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.068169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-oauth-config\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.068402 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.068193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t78mz\" (UniqueName: \"kubernetes.io/projected/c65170bc-5db0-4d69-a275-c53ab7b377d5-kube-api-access-t78mz\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.068402 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.068309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-config\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.068402 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.068373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-serving-cert\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.068553 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.068403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-service-ca\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.068992 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.068963    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-oauth-serving-cert\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.068992 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.068987    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-config\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.069597 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.069573    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-service-ca\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.071131 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.071102    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-serving-cert\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.071326 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.071305    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-oauth-config\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.078020 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.078000    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78mz\" (UniqueName: \"kubernetes.io/projected/c65170bc-5db0-4d69-a275-c53ab7b377d5-kube-api-access-t78mz\") pod \"console-554cf97698-m2gfn\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") " pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.224040 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.223999    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:04.371111 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.371002    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554cf97698-m2gfn"]
Jul 06 23:26:04.585689 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:26:04.585643    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65170bc_5db0_4d69_a275_c53ab7b377d5.slice/crio-23bb3170d0cfcabaad3933f1239005980493902c33c751213570e7f1aa049057 WatchSource:0}: Error finding container 23bb3170d0cfcabaad3933f1239005980493902c33c751213570e7f1aa049057: Status 404 returned error can't find the container with id 23bb3170d0cfcabaad3933f1239005980493902c33c751213570e7f1aa049057
Jul 06 23:26:04.739369 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.739330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cf97698-m2gfn" event={"ID":"c65170bc-5db0-4d69-a275-c53ab7b377d5","Type":"ContainerStarted","Data":"23bb3170d0cfcabaad3933f1239005980493902c33c751213570e7f1aa049057"}
Jul 06 23:26:04.741316 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:04.741290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4" event={"ID":"5e74e837-7021-4871-a9a5-3844d18e7685","Type":"ContainerStarted","Data":"378d1c97a2d398349a6954734d06d04633862583cc287bcf46716964a418dec3"}
Jul 06 23:26:05.747154 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:05.746984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4" event={"ID":"5e74e837-7021-4871-a9a5-3844d18e7685","Type":"ContainerStarted","Data":"82664860127b994bfc289c0166ea9fa49a0209d1b662526540f81c936c8dffe0"}
Jul 06 23:26:05.766585 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:05.766526    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-brrw4" podStartSLOduration=2.590423883 podStartE2EDuration="3.766505632s" totalImagesPullingTime="1.176081749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:26:05.764396005 +0000 UTC m=+80.898388195" watchObservedRunningTime="2026-07-06 23:26:05.766505632 +0000 UTC m=+80.900497805"
Jul 06 23:26:07.756005 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.755966    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cf97698-m2gfn" event={"ID":"c65170bc-5db0-4d69-a275-c53ab7b377d5","Type":"ContainerStarted","Data":"aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7"}
Jul 06 23:26:07.776816 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.776764    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554cf97698-m2gfn" podStartSLOduration=1.9713513900000001 podStartE2EDuration="4.776748126s" totalImagesPullingTime="2.805396736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:26:07.776696312 +0000 UTC m=+82.910688504" watchObservedRunningTime="2026-07-06 23:26:07.776748126 +0000 UTC m=+82.910740316"
Jul 06 23:26:07.851166 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.851138    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"]
Jul 06 23:26:07.854460 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.854445    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:07.857183 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.857162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 23:26:07.857183 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.857180    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tzv7f\""
Jul 06 23:26:07.858551 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.858535    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 23:26:07.869197 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.869178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"]
Jul 06 23:26:07.894201 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.894158    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4hczc"]
Jul 06 23:26:07.897769 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.897740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:07.901786 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.901763    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 23:26:07.902190 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.902168    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 23:26:07.902503 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.902479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d69jr\""
Jul 06 23:26:07.902829 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:07.902811    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 23:26:08.001141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvsrk\" (UniqueName: \"kubernetes.io/projected/30691658-60ec-4029-a38e-8352b2bd1991-kube-api-access-xvsrk\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.001268 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp2fl\" (UniqueName: \"kubernetes.io/projected/e16db94d-2dd5-43de-8c7a-253aaf9460a2-kube-api-access-cp2fl\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.001268 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-root\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.001268 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-wtmp\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.001376 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-tls\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.001376 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-sys\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.001376 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16db94d-2dd5-43de-8c7a-253aaf9460a2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.001468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.001468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001418    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.001468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.001553 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-textfile\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.001553 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30691658-60ec-4029-a38e-8352b2bd1991-metrics-client-ca\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.001553 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.001537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.101893 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.101817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-sys\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.101893 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.101850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16db94d-2dd5-43de-8c7a-253aaf9460a2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.101893 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.101869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.101912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.102141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.101952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.102141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.101980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-textfile\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30691658-60ec-4029-a38e-8352b2bd1991-metrics-client-ca\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102141 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:26:08.102025    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 23:26:08.102141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvsrk\" (UniqueName: \"kubernetes.io/projected/30691658-60ec-4029-a38e-8352b2bd1991-kube-api-access-xvsrk\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102141 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:26:08.102124    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-tls podName:e16db94d-2dd5-43de-8c7a-253aaf9460a2 nodeName:}" failed. No retries permitted until 2026-07-06 23:26:08.602087207 +0000 UTC m=+83.736079398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-t5hlc" (UID: "e16db94d-2dd5-43de-8c7a-253aaf9460a2") : secret "openshift-state-metrics-tls" not found
Jul 06 23:26:08.102491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp2fl\" (UniqueName: \"kubernetes.io/projected/e16db94d-2dd5-43de-8c7a-253aaf9460a2-kube-api-access-cp2fl\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.102491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-root\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-wtmp\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-tls\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102323    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-root\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102361    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-textfile\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102414    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-sys\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102491 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102474    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-wtmp\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102842 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102668    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16db94d-2dd5-43de-8c7a-253aaf9460a2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.102923 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102900    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.102969 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.102926    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30691658-60ec-4029-a38e-8352b2bd1991-metrics-client-ca\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.104924 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.104899    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.105122 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.105106    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.105295 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.105276    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30691658-60ec-4029-a38e-8352b2bd1991-node-exporter-tls\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.122917 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.122896    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp2fl\" (UniqueName: \"kubernetes.io/projected/e16db94d-2dd5-43de-8c7a-253aaf9460a2-kube-api-access-cp2fl\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.139629 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.139601    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvsrk\" (UniqueName: \"kubernetes.io/projected/30691658-60ec-4029-a38e-8352b2bd1991-kube-api-access-xvsrk\") pod \"node-exporter-4hczc\" (UID: \"30691658-60ec-4029-a38e-8352b2bd1991\") " pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.207110 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.207073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4hczc"
Jul 06 23:26:08.219073 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:26:08.219026    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30691658_60ec_4029_a38e_8352b2bd1991.slice/crio-b9d5576241b6d1a00851575aeda944652916c4f9dc3b4753905ee5fc928e850e WatchSource:0}: Error finding container b9d5576241b6d1a00851575aeda944652916c4f9dc3b4753905ee5fc928e850e: Status 404 returned error can't find the container with id b9d5576241b6d1a00851575aeda944652916c4f9dc3b4753905ee5fc928e850e
Jul 06 23:26:08.606278 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.606247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.608790 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.608754    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16db94d-2dd5-43de-8c7a-253aaf9460a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-t5hlc\" (UID: \"e16db94d-2dd5-43de-8c7a-253aaf9460a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.761217 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.761173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hczc" event={"ID":"30691658-60ec-4029-a38e-8352b2bd1991","Type":"ContainerStarted","Data":"b9d5576241b6d1a00851575aeda944652916c4f9dc3b4753905ee5fc928e850e"}
Jul 06 23:26:08.763668 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.763635    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"
Jul 06 23:26:08.934333 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:08.934309    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc"]
Jul 06 23:26:09.100818 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:26:09.100775    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16db94d_2dd5_43de_8c7a_253aaf9460a2.slice/crio-94eec0ea8b1b474ee58deb28181fb68388be1f47bfdd2f4c34be1ca2a7fafea7 WatchSource:0}: Error finding container 94eec0ea8b1b474ee58deb28181fb68388be1f47bfdd2f4c34be1ca2a7fafea7: Status 404 returned error can't find the container with id 94eec0ea8b1b474ee58deb28181fb68388be1f47bfdd2f4c34be1ca2a7fafea7
Jul 06 23:26:09.767373 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:09.767332    2579 generic.go:356] "Generic (PLEG): container finished" podID="30691658-60ec-4029-a38e-8352b2bd1991" containerID="a6ed8a6ac17d8ff73ba74cb23e5db5c79c7b08fea4889c4bf4a7f800e8ae04b0" exitCode=0
Jul 06 23:26:09.767846 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:09.767419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hczc" event={"ID":"30691658-60ec-4029-a38e-8352b2bd1991","Type":"ContainerDied","Data":"a6ed8a6ac17d8ff73ba74cb23e5db5c79c7b08fea4889c4bf4a7f800e8ae04b0"}
Jul 06 23:26:09.770049 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:09.770024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc" event={"ID":"e16db94d-2dd5-43de-8c7a-253aaf9460a2","Type":"ContainerStarted","Data":"1602cdae0e6db57d1963d3c3d939705644bd5dc39207a4bf9ad81510968071a2"}
Jul 06 23:26:09.770151 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:09.770103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc" event={"ID":"e16db94d-2dd5-43de-8c7a-253aaf9460a2","Type":"ContainerStarted","Data":"fa2ae3ac8dfd28973cae1935ca40193aacdaa46c92a4d2c9605c2f2952308971"}
Jul 06 23:26:09.770151 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:09.770123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc" event={"ID":"e16db94d-2dd5-43de-8c7a-253aaf9460a2","Type":"ContainerStarted","Data":"94eec0ea8b1b474ee58deb28181fb68388be1f47bfdd2f4c34be1ca2a7fafea7"}
Jul 06 23:26:10.724190 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:10.724157    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gt4hl"
Jul 06 23:26:10.777013 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:10.776977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hczc" event={"ID":"30691658-60ec-4029-a38e-8352b2bd1991","Type":"ContainerStarted","Data":"8e3b29167649d915f79c88e8b9dce10e7d2f2006c354ae5d18fe62e8ac5adf12"}
Jul 06 23:26:10.777656 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:10.777077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hczc" event={"ID":"30691658-60ec-4029-a38e-8352b2bd1991","Type":"ContainerStarted","Data":"3d51736b7e9dc538e2cd42817d16dafb5b3d43b284f9da0d8de79d533d4f5590"}
Jul 06 23:26:10.779249 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:10.779211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc" event={"ID":"e16db94d-2dd5-43de-8c7a-253aaf9460a2","Type":"ContainerStarted","Data":"2b936e3ee1af869e3b8c227cd2fe911466030f8f64ce9618b24fc72f3ec30205"}
Jul 06 23:26:10.797534 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:10.797492    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4hczc" podStartSLOduration=2.7942787730000003 podStartE2EDuration="3.797478557s" totalImagesPullingTime="929.032018ms" totalInitContainerRuntime="74.167766ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:26:10.795935264 +0000 UTC m=+85.929927459" watchObservedRunningTime="2026-07-06 23:26:10.797478557 +0000 UTC m=+85.931470748"
Jul 06 23:26:10.814606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:10.814566    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-t5hlc" podStartSLOduration=2.869406188 podStartE2EDuration="3.814552278s" totalImagesPullingTime="945.14609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:26:10.813414796 +0000 UTC m=+85.947406986" watchObservedRunningTime="2026-07-06 23:26:10.814552278 +0000 UTC m=+85.948544469"
Jul 06 23:26:12.524879 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.524839    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64b4d64bc9-7272s"]
Jul 06 23:26:12.528945 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.528921    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.532663 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.532629    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 23:26:12.532663 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.532646    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-85n8kin8r4v9b\""
Jul 06 23:26:12.532663 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.532631    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 23:26:12.532890 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.532695    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 23:26:12.532890 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.532630    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-btq2z\""
Jul 06 23:26:12.532890 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.532629    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 23:26:12.538721 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.538702    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64b4d64bc9-7272s"]
Jul 06 23:26:12.640367 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.640330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-secret-metrics-server-client-certs\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.640367 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.640369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-secret-metrics-server-tls\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.640574 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.640391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d43d698-d72a-4e86-a212-00dba0560db5-audit-log\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.640574 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.640420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-client-ca-bundle\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.640574 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.640504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-844kd\" (UniqueName: \"kubernetes.io/projected/8d43d698-d72a-4e86-a212-00dba0560db5-kube-api-access-844kd\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.640574 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.640571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d43d698-d72a-4e86-a212-00dba0560db5-metrics-server-audit-profiles\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.640724 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.640593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d43d698-d72a-4e86-a212-00dba0560db5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.741325 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.741290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d43d698-d72a-4e86-a212-00dba0560db5-metrics-server-audit-profiles\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.741325 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.741328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d43d698-d72a-4e86-a212-00dba0560db5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.741526 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.741451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-secret-metrics-server-client-certs\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.741526 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.741488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-secret-metrics-server-tls\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.741526 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.741510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d43d698-d72a-4e86-a212-00dba0560db5-audit-log\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.741671 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.741544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-client-ca-bundle\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.741671 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.741578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-844kd\" (UniqueName: \"kubernetes.io/projected/8d43d698-d72a-4e86-a212-00dba0560db5-kube-api-access-844kd\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.741992 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.741953    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d43d698-d72a-4e86-a212-00dba0560db5-audit-log\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.742174 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.742146    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d43d698-d72a-4e86-a212-00dba0560db5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.742386 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.742353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d43d698-d72a-4e86-a212-00dba0560db5-metrics-server-audit-profiles\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.744113 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.744089    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-client-ca-bundle\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.744193 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.744124    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-secret-metrics-server-tls\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.744193 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.744146    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d43d698-d72a-4e86-a212-00dba0560db5-secret-metrics-server-client-certs\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.749539 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.749522    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-844kd\" (UniqueName: \"kubernetes.io/projected/8d43d698-d72a-4e86-a212-00dba0560db5-kube-api-access-844kd\") pod \"metrics-server-64b4d64bc9-7272s\" (UID: \"8d43d698-d72a-4e86-a212-00dba0560db5\") " pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.838651 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.838578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:12.966983 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:12.966954    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64b4d64bc9-7272s"]
Jul 06 23:26:12.969588 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:26:12.969559    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d43d698_d72a_4e86_a212_00dba0560db5.slice/crio-ce3ac48eec565ab0d9ca213d3f7056fbac2fa6915df1df6581dc7842cccdedc5 WatchSource:0}: Error finding container ce3ac48eec565ab0d9ca213d3f7056fbac2fa6915df1df6581dc7842cccdedc5: Status 404 returned error can't find the container with id ce3ac48eec565ab0d9ca213d3f7056fbac2fa6915df1df6581dc7842cccdedc5
Jul 06 23:26:13.792533 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:13.792451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s" event={"ID":"8d43d698-d72a-4e86-a212-00dba0560db5","Type":"ContainerStarted","Data":"ce3ac48eec565ab0d9ca213d3f7056fbac2fa6915df1df6581dc7842cccdedc5"}
Jul 06 23:26:14.224258 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:14.224220    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:14.224431 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:14.224313    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:14.229804 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:14.229781    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:14.799034 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:14.798995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s" event={"ID":"8d43d698-d72a-4e86-a212-00dba0560db5","Type":"ContainerStarted","Data":"d459838c15bac2926ff3b3286f23b42e18afb15455d456024d45c27c18b05cf8"}
Jul 06 23:26:14.803275 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:14.803252    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:14.820525 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:14.820481    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s" podStartSLOduration=1.461100955 podStartE2EDuration="2.820465707s" totalImagesPullingTime="1.359364752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:26:14.819217504 +0000 UTC m=+89.953209696" watchObservedRunningTime="2026-07-06 23:26:14.820465707 +0000 UTC m=+89.954457898"
Jul 06 23:26:16.681212 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:16.681176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:26:17.548111 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.548076    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d444d6f4d-v8lln"]
Jul 06 23:26:17.551372 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.551355    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.558729 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.558705    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 23:26:17.561309 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.561283    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d444d6f4d-v8lln"]
Jul 06 23:26:17.683263 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.683215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-trusted-ca-bundle\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.683263 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.683278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-config\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.683708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.683301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-oauth-config\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.683708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.683360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-oauth-serving-cert\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.683708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.683451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-service-ca\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.683708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.683486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk5pq\" (UniqueName: \"kubernetes.io/projected/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-kube-api-access-mk5pq\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.683708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.683511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-serving-cert\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.784692 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.784639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-config\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.784692 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.784698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-oauth-config\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.784922 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.784731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-oauth-serving-cert\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.784922 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.784779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-service-ca\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.784922 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.784802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk5pq\" (UniqueName: \"kubernetes.io/projected/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-kube-api-access-mk5pq\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.784922 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.784835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-serving-cert\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.784922 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.784868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-trusted-ca-bundle\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.785535 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.785507    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-config\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.785633 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.785507    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-oauth-serving-cert\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.785633 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.785519    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-service-ca\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.785725 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.785650    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-trusted-ca-bundle\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.787822 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.787801    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-serving-cert\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.787930 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.787910    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-oauth-config\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.793166 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.793144    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk5pq\" (UniqueName: \"kubernetes.io/projected/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-kube-api-access-mk5pq\") pod \"console-5d444d6f4d-v8lln\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") " pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:17.860807 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:17.860740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:18.019108 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:18.019072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d444d6f4d-v8lln"]
Jul 06 23:26:18.022046 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:26:18.022017    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e75cf6c_67be_49ae_bc64_c50f47fe0db9.slice/crio-24732ae626ce184cb36932a53c923f8b6d6212b2fe383a49a1ece5e5b66a8b2a WatchSource:0}: Error finding container 24732ae626ce184cb36932a53c923f8b6d6212b2fe383a49a1ece5e5b66a8b2a: Status 404 returned error can't find the container with id 24732ae626ce184cb36932a53c923f8b6d6212b2fe383a49a1ece5e5b66a8b2a
Jul 06 23:26:18.813335 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:18.813298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d444d6f4d-v8lln" event={"ID":"4e75cf6c-67be-49ae-bc64-c50f47fe0db9","Type":"ContainerStarted","Data":"e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b"}
Jul 06 23:26:18.813793 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:18.813346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d444d6f4d-v8lln" event={"ID":"4e75cf6c-67be-49ae-bc64-c50f47fe0db9","Type":"ContainerStarted","Data":"24732ae626ce184cb36932a53c923f8b6d6212b2fe383a49a1ece5e5b66a8b2a"}
Jul 06 23:26:18.832959 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:18.832912    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d444d6f4d-v8lln" podStartSLOduration=1.832897861 podStartE2EDuration="1.832897861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:26:18.830987723 +0000 UTC m=+93.964979916" watchObservedRunningTime="2026-07-06 23:26:18.832897861 +0000 UTC m=+93.966890052"
Jul 06 23:26:21.696798 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:21.696754    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh" podUID="f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" containerName="registry" containerID="cri-o://5b08d430dec3ee42592531abda9ce24891cf1e11b882b11aa218c71c8f7af900" gracePeriod=30
Jul 06 23:26:21.726851 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:21.726832    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-745d88dd69-wncmt"
Jul 06 23:26:21.826126 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:21.826099    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" containerID="5b08d430dec3ee42592531abda9ce24891cf1e11b882b11aa218c71c8f7af900" exitCode=0
Jul 06 23:26:21.826275 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:21.826163    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh" event={"ID":"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9","Type":"ContainerDied","Data":"5b08d430dec3ee42592531abda9ce24891cf1e11b882b11aa218c71c8f7af900"}
Jul 06 23:26:21.941822 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:21.941799    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:26:22.019335 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019255    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-installation-pull-secrets\") pod \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") "
Jul 06 23:26:22.019335 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019301    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-trusted-ca\") pod \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") "
Jul 06 23:26:22.019335 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019330    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-image-registry-private-configuration\") pod \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") "
Jul 06 23:26:22.019579 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019347    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-bound-sa-token\") pod \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") "
Jul 06 23:26:22.019579 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019377    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-ca-trust-extracted\") pod \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") "
Jul 06 23:26:22.019579 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019413    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26tlr\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-kube-api-access-26tlr\") pod \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") "
Jul 06 23:26:22.019579 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019447    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") pod \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") "
Jul 06 23:26:22.019579 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019471    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-certificates\") pod \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\" (UID: \"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9\") "
Jul 06 23:26:22.019949 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019890    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:26:22.020259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.019965    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:26:22.022088 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.022024    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:26:22.022263 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.022233    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:26:22.022385 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.022328    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:26:22.022534 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.022497    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:26:22.022604 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.022588    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-kube-api-access-26tlr" (OuterVolumeSpecName: "kube-api-access-26tlr") pod "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9"). InnerVolumeSpecName "kube-api-access-26tlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:26:22.027875 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.027850    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" (UID: "f6a1b21e-8a7e-409c-aad9-d7b0abae01e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:26:22.120869 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.120839    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-installation-pull-secrets\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:22.120869 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.120865    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-trusted-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:22.121009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.120876    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-image-registry-private-configuration\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:22.121009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.120886    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-bound-sa-token\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:22.121009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.120895    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-ca-trust-extracted\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:22.121009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.120902    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26tlr\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-kube-api-access-26tlr\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:22.121009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.120910    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:22.121009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.120918    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9-registry-certificates\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:22.831604 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.831582    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"
Jul 06 23:26:22.831962 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.831577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb79cd5b6-rbrvh" event={"ID":"f6a1b21e-8a7e-409c-aad9-d7b0abae01e9","Type":"ContainerDied","Data":"e4300ca37bcb876cecc57724571e10bc29354c7992902f49f61e08b65a5f59a3"}
Jul 06 23:26:22.831962 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.831706    2579 scope.go:117] "RemoveContainer" containerID="5b08d430dec3ee42592531abda9ce24891cf1e11b882b11aa218c71c8f7af900"
Jul 06 23:26:22.854578 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.854555    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"]
Jul 06 23:26:22.859123 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:22.859094    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bb79cd5b6-rbrvh"]
Jul 06 23:26:23.378507 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:23.378448    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" path="/var/lib/kubelet/pods/f6a1b21e-8a7e-409c-aad9-d7b0abae01e9/volumes"
Jul 06 23:26:27.861563 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:27.861531    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:27.861961 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:27.861587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:27.866454 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:27.866431    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:28.857713 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:28.857683    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:26:28.903545 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:28.903514    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554cf97698-m2gfn"]
Jul 06 23:26:31.724319 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:31.724291    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h85xb"
Jul 06 23:26:32.838890 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:32.838856    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:32.839276 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:32.838944    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:52.844531 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:52.844501    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:52.848261 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:52.848241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64b4d64bc9-7272s"
Jul 06 23:26:53.931170 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:53.931102    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-554cf97698-m2gfn" podUID="c65170bc-5db0-4d69-a275-c53ab7b377d5" containerName="console" containerID="cri-o://aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7" gracePeriod=15
Jul 06 23:26:54.167725 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.167698    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:54.264672 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.264637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-config\") pod \"c65170bc-5db0-4d69-a275-c53ab7b377d5\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") "
Jul 06 23:26:54.264867 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.264695    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-serving-cert\") pod \"c65170bc-5db0-4d69-a275-c53ab7b377d5\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") "
Jul 06 23:26:54.264867 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.264732    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-service-ca\") pod \"c65170bc-5db0-4d69-a275-c53ab7b377d5\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") "
Jul 06 23:26:54.264867 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.264761    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-oauth-serving-cert\") pod \"c65170bc-5db0-4d69-a275-c53ab7b377d5\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") "
Jul 06 23:26:54.264867 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.264789    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t78mz\" (UniqueName: \"kubernetes.io/projected/c65170bc-5db0-4d69-a275-c53ab7b377d5-kube-api-access-t78mz\") pod \"c65170bc-5db0-4d69-a275-c53ab7b377d5\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") "
Jul 06 23:26:54.264867 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.264827    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-oauth-config\") pod \"c65170bc-5db0-4d69-a275-c53ab7b377d5\" (UID: \"c65170bc-5db0-4d69-a275-c53ab7b377d5\") "
Jul 06 23:26:54.265156 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.265106    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-config" (OuterVolumeSpecName: "console-config") pod "c65170bc-5db0-4d69-a275-c53ab7b377d5" (UID: "c65170bc-5db0-4d69-a275-c53ab7b377d5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:26:54.265249 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.265225    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c65170bc-5db0-4d69-a275-c53ab7b377d5" (UID: "c65170bc-5db0-4d69-a275-c53ab7b377d5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:26:54.265249 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.265234    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-service-ca" (OuterVolumeSpecName: "service-ca") pod "c65170bc-5db0-4d69-a275-c53ab7b377d5" (UID: "c65170bc-5db0-4d69-a275-c53ab7b377d5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:26:54.267100 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.267046    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c65170bc-5db0-4d69-a275-c53ab7b377d5" (UID: "c65170bc-5db0-4d69-a275-c53ab7b377d5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:26:54.267206 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.267118    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c65170bc-5db0-4d69-a275-c53ab7b377d5" (UID: "c65170bc-5db0-4d69-a275-c53ab7b377d5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:26:54.267258 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.267238    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65170bc-5db0-4d69-a275-c53ab7b377d5-kube-api-access-t78mz" (OuterVolumeSpecName: "kube-api-access-t78mz") pod "c65170bc-5db0-4d69-a275-c53ab7b377d5" (UID: "c65170bc-5db0-4d69-a275-c53ab7b377d5"). InnerVolumeSpecName "kube-api-access-t78mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:26:54.365856 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.365819    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-config\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:54.365856 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.365848    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-serving-cert\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:54.365856 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.365859    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:54.365856 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.365867    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65170bc-5db0-4d69-a275-c53ab7b377d5-oauth-serving-cert\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:54.366142 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.365875    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t78mz\" (UniqueName: \"kubernetes.io/projected/c65170bc-5db0-4d69-a275-c53ab7b377d5-kube-api-access-t78mz\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:54.366142 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.365884    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65170bc-5db0-4d69-a275-c53ab7b377d5-console-oauth-config\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:26:54.947484 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.947449    2579 generic.go:356] "Generic (PLEG): container finished" podID="c65170bc-5db0-4d69-a275-c53ab7b377d5" containerID="aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7" exitCode=0
Jul 06 23:26:54.947936 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.947497    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cf97698-m2gfn"
Jul 06 23:26:54.947936 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.947536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cf97698-m2gfn" event={"ID":"c65170bc-5db0-4d69-a275-c53ab7b377d5","Type":"ContainerDied","Data":"aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7"}
Jul 06 23:26:54.947936 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.947598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cf97698-m2gfn" event={"ID":"c65170bc-5db0-4d69-a275-c53ab7b377d5","Type":"ContainerDied","Data":"23bb3170d0cfcabaad3933f1239005980493902c33c751213570e7f1aa049057"}
Jul 06 23:26:54.947936 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.947630    2579 scope.go:117] "RemoveContainer" containerID="aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7"
Jul 06 23:26:54.956588 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.956574    2579 scope.go:117] "RemoveContainer" containerID="aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7"
Jul 06 23:26:54.956853 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:26:54.956833    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7\": container with ID starting with aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7 not found: ID does not exist" containerID="aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7"
Jul 06 23:26:54.956902 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.956862    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7"} err="failed to get container status \"aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7\": rpc error: code = NotFound desc = could not find container \"aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7\": container with ID starting with aa5fabbec3a3c72bab0ccb65d3b43cb2c957c6cc9830b7e967974af021ecd5e7 not found: ID does not exist"
Jul 06 23:26:54.968179 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.968157    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554cf97698-m2gfn"]
Jul 06 23:26:54.971336 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:54.971318    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-554cf97698-m2gfn"]
Jul 06 23:26:55.383387 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:26:55.383310    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65170bc-5db0-4d69-a275-c53ab7b377d5" path="/var/lib/kubelet/pods/c65170bc-5db0-4d69-a275-c53ab7b377d5/volumes"
Jul 06 23:27:36.429810 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.429713    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74c95476dd-swbmg"]
Jul 06 23:27:36.430261 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.430027    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65170bc-5db0-4d69-a275-c53ab7b377d5" containerName="console"
Jul 06 23:27:36.430261 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.430043    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65170bc-5db0-4d69-a275-c53ab7b377d5" containerName="console"
Jul 06 23:27:36.430261 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.430082    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" containerName="registry"
Jul 06 23:27:36.430261 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.430089    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" containerName="registry"
Jul 06 23:27:36.430261 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.430134    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c65170bc-5db0-4d69-a275-c53ab7b377d5" containerName="console"
Jul 06 23:27:36.430261 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.430142    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a1b21e-8a7e-409c-aad9-d7b0abae01e9" containerName="registry"
Jul 06 23:27:36.432924 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.432895    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.444320 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.444291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c95476dd-swbmg"]
Jul 06 23:27:36.597509 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.597460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-oauth-config\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.597701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.597528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbmq\" (UniqueName: \"kubernetes.io/projected/8d0e853d-99eb-46f9-b27a-ba724131f0de-kube-api-access-bzbmq\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.597701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.597565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-oauth-serving-cert\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.597701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.597598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-serving-cert\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.597701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.597639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-trusted-ca-bundle\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.597701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.597694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-config\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.597965 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.597718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-service-ca\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.698706 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.698546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-config\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.698969 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.698937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-service-ca\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.699141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.699016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-oauth-config\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.699141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.699086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbmq\" (UniqueName: \"kubernetes.io/projected/8d0e853d-99eb-46f9-b27a-ba724131f0de-kube-api-access-bzbmq\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.699141 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.699129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-oauth-serving-cert\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.699287 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.699168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-serving-cert\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.699287 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.699218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-trusted-ca-bundle\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.699394 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.699380    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-config\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.699933 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.699868    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-oauth-serving-cert\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.699933 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.699990    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-service-ca\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.700248 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.700036    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-trusted-ca-bundle\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.701700 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.701680    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-oauth-config\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.701964 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.701941    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-serving-cert\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.707408 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.707385    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbmq\" (UniqueName: \"kubernetes.io/projected/8d0e853d-99eb-46f9-b27a-ba724131f0de-kube-api-access-bzbmq\") pod \"console-74c95476dd-swbmg\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") " pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.743829 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.743800    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:36.872098 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:36.872050    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c95476dd-swbmg"]
Jul 06 23:27:36.875539 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:27:36.875514    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0e853d_99eb_46f9_b27a_ba724131f0de.slice/crio-9a5b33132fe738f8211fb8dac0e2ce26d8511909620b639a7ebc961c2405f8e6 WatchSource:0}: Error finding container 9a5b33132fe738f8211fb8dac0e2ce26d8511909620b639a7ebc961c2405f8e6: Status 404 returned error can't find the container with id 9a5b33132fe738f8211fb8dac0e2ce26d8511909620b639a7ebc961c2405f8e6
Jul 06 23:27:37.089001 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:37.088916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c95476dd-swbmg" event={"ID":"8d0e853d-99eb-46f9-b27a-ba724131f0de","Type":"ContainerStarted","Data":"ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a"}
Jul 06 23:27:37.089001 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:37.088970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c95476dd-swbmg" event={"ID":"8d0e853d-99eb-46f9-b27a-ba724131f0de","Type":"ContainerStarted","Data":"9a5b33132fe738f8211fb8dac0e2ce26d8511909620b639a7ebc961c2405f8e6"}
Jul 06 23:27:37.111500 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:37.111452    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74c95476dd-swbmg" podStartSLOduration=1.111437361 podStartE2EDuration="1.111437361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:27:37.108846267 +0000 UTC m=+172.242838457" watchObservedRunningTime="2026-07-06 23:27:37.111437361 +0000 UTC m=+172.245429552"
Jul 06 23:27:46.744176 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:46.744135    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:46.744563 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:46.744214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:46.748817 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:46.748793    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:47.128717 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:47.128643    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:27:47.175020 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:27:47.174985    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d444d6f4d-v8lln"]
Jul 06 23:28:12.201718 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.201667    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d444d6f4d-v8lln" podUID="4e75cf6c-67be-49ae-bc64-c50f47fe0db9" containerName="console" containerID="cri-o://e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b" gracePeriod=15
Jul 06 23:28:12.444700 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.444676    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:28:12.578206 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-serving-cert\") pod \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") "
Jul 06 23:28:12.578206 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578159    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk5pq\" (UniqueName: \"kubernetes.io/projected/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-kube-api-access-mk5pq\") pod \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") "
Jul 06 23:28:12.578455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578219    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-oauth-serving-cert\") pod \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") "
Jul 06 23:28:12.578455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578244    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-service-ca\") pod \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") "
Jul 06 23:28:12.578455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578280    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-oauth-config\") pod \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") "
Jul 06 23:28:12.578455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578304    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-trusted-ca-bundle\") pod \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") "
Jul 06 23:28:12.578455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578343    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-config\") pod \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\" (UID: \"4e75cf6c-67be-49ae-bc64-c50f47fe0db9\") "
Jul 06 23:28:12.578760 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578730    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e75cf6c-67be-49ae-bc64-c50f47fe0db9" (UID: "4e75cf6c-67be-49ae-bc64-c50f47fe0db9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:28:12.578810 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578749    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e75cf6c-67be-49ae-bc64-c50f47fe0db9" (UID: "4e75cf6c-67be-49ae-bc64-c50f47fe0db9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:28:12.578810 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578767    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e75cf6c-67be-49ae-bc64-c50f47fe0db9" (UID: "4e75cf6c-67be-49ae-bc64-c50f47fe0db9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:28:12.578810 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.578796    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-config" (OuterVolumeSpecName: "console-config") pod "4e75cf6c-67be-49ae-bc64-c50f47fe0db9" (UID: "4e75cf6c-67be-49ae-bc64-c50f47fe0db9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:28:12.580758 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.580737    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-kube-api-access-mk5pq" (OuterVolumeSpecName: "kube-api-access-mk5pq") pod "4e75cf6c-67be-49ae-bc64-c50f47fe0db9" (UID: "4e75cf6c-67be-49ae-bc64-c50f47fe0db9"). InnerVolumeSpecName "kube-api-access-mk5pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:28:12.580994 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.580961    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e75cf6c-67be-49ae-bc64-c50f47fe0db9" (UID: "4e75cf6c-67be-49ae-bc64-c50f47fe0db9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:28:12.580994 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.580980    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e75cf6c-67be-49ae-bc64-c50f47fe0db9" (UID: "4e75cf6c-67be-49ae-bc64-c50f47fe0db9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:28:12.679796 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.679759    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-trusted-ca-bundle\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:28:12.679796 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.679790    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-config\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:28:12.679796 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.679799    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-serving-cert\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:28:12.680017 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.679809    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk5pq\" (UniqueName: \"kubernetes.io/projected/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-kube-api-access-mk5pq\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:28:12.680017 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.679818    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-oauth-serving-cert\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:28:12.680017 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.679826    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:28:12.680017 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:12.679833    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e75cf6c-67be-49ae-bc64-c50f47fe0db9-console-oauth-config\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:28:13.217475 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.217434    2579 generic.go:356] "Generic (PLEG): container finished" podID="4e75cf6c-67be-49ae-bc64-c50f47fe0db9" containerID="e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b" exitCode=0
Jul 06 23:28:13.217851 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.217486    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d444d6f4d-v8lln"
Jul 06 23:28:13.217851 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.217513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d444d6f4d-v8lln" event={"ID":"4e75cf6c-67be-49ae-bc64-c50f47fe0db9","Type":"ContainerDied","Data":"e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b"}
Jul 06 23:28:13.217851 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.217562    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d444d6f4d-v8lln" event={"ID":"4e75cf6c-67be-49ae-bc64-c50f47fe0db9","Type":"ContainerDied","Data":"24732ae626ce184cb36932a53c923f8b6d6212b2fe383a49a1ece5e5b66a8b2a"}
Jul 06 23:28:13.217851 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.217590    2579 scope.go:117] "RemoveContainer" containerID="e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b"
Jul 06 23:28:13.225609 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.225587    2579 scope.go:117] "RemoveContainer" containerID="e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b"
Jul 06 23:28:13.225897 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:28:13.225877    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b\": container with ID starting with e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b not found: ID does not exist" containerID="e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b"
Jul 06 23:28:13.225958 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.225906    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b"} err="failed to get container status \"e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b\": rpc error: code = NotFound desc = could not find container \"e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b\": container with ID starting with e99bfa430099093a9f049b84b923239a7d9633a0c54769dec3ba3d8c1155b84b not found: ID does not exist"
Jul 06 23:28:13.237990 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.237964    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d444d6f4d-v8lln"]
Jul 06 23:28:13.243705 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.243680    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d444d6f4d-v8lln"]
Jul 06 23:28:13.378686 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:13.378654    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e75cf6c-67be-49ae-bc64-c50f47fe0db9" path="/var/lib/kubelet/pods/4e75cf6c-67be-49ae-bc64-c50f47fe0db9/volumes"
Jul 06 23:28:50.286632 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.286597    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77d4c7977-c8mlq"]
Jul 06 23:28:50.287046 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.286888    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e75cf6c-67be-49ae-bc64-c50f47fe0db9" containerName="console"
Jul 06 23:28:50.287046 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.286901    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e75cf6c-67be-49ae-bc64-c50f47fe0db9" containerName="console"
Jul 06 23:28:50.287046 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.286960    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e75cf6c-67be-49ae-bc64-c50f47fe0db9" containerName="console"
Jul 06 23:28:50.290977 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.290960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.313123 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.313095    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d4c7977-c8mlq"]
Jul 06 23:28:50.373758 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.373725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-oauth-config\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.373930 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.373771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8phn\" (UniqueName: \"kubernetes.io/projected/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-kube-api-access-k8phn\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.373930 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.373790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-serving-cert\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.373930 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.373816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-trusted-ca-bundle\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.373930 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.373874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-oauth-serving-cert\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.373930 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.373907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-config\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.373930 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.373924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-service-ca\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.474404 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.474365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8phn\" (UniqueName: \"kubernetes.io/projected/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-kube-api-access-k8phn\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.474404 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.474416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-serving-cert\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.474676 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.474450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-trusted-ca-bundle\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.474676 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.474478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-oauth-serving-cert\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.474676 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.474510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-config\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.474676 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.474527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-service-ca\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.474676 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.474558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-oauth-config\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.475406 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.475378    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-oauth-serving-cert\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.475522 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.475433    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-config\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.475522 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.475431    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-service-ca\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.475522 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.475510    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-trusted-ca-bundle\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.477042 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.477021    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-oauth-config\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.477156 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.477139    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-serving-cert\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.481643 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.481626    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8phn\" (UniqueName: \"kubernetes.io/projected/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-kube-api-access-k8phn\") pod \"console-77d4c7977-c8mlq\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") " pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.600126 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.600010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:28:50.731003 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:50.730967    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d4c7977-c8mlq"]
Jul 06 23:28:50.734394 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:28:50.734366    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ed5d09_c9a1_49f8_9bb4_b26be380a2d3.slice/crio-eb888575dea391e3ea832001e623b1dc370c8c230577a13ac77ec54341a31f0d WatchSource:0}: Error finding container eb888575dea391e3ea832001e623b1dc370c8c230577a13ac77ec54341a31f0d: Status 404 returned error can't find the container with id eb888575dea391e3ea832001e623b1dc370c8c230577a13ac77ec54341a31f0d
Jul 06 23:28:51.351755 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:51.351714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d4c7977-c8mlq" event={"ID":"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3","Type":"ContainerStarted","Data":"10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb"}
Jul 06 23:28:51.352159 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:51.351764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d4c7977-c8mlq" event={"ID":"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3","Type":"ContainerStarted","Data":"eb888575dea391e3ea832001e623b1dc370c8c230577a13ac77ec54341a31f0d"}
Jul 06 23:28:51.369880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:28:51.369829    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77d4c7977-c8mlq" podStartSLOduration=1.369812709 podStartE2EDuration="1.369812709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:28:51.368164418 +0000 UTC m=+246.502156618" watchObservedRunningTime="2026-07-06 23:28:51.369812709 +0000 UTC m=+246.503804903"
Jul 06 23:29:00.600514 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:00.600477    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:29:00.600912 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:00.600558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:29:00.605327 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:00.605310    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:29:01.388549 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:01.388522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:29:01.433261 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:01.433227    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c95476dd-swbmg"]
Jul 06 23:29:26.458647 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.458600    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74c95476dd-swbmg" podUID="8d0e853d-99eb-46f9-b27a-ba724131f0de" containerName="console" containerID="cri-o://ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a" gracePeriod=15
Jul 06 23:29:26.700036 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.700014    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:29:26.859210 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859106    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzbmq\" (UniqueName: \"kubernetes.io/projected/8d0e853d-99eb-46f9-b27a-ba724131f0de-kube-api-access-bzbmq\") pod \"8d0e853d-99eb-46f9-b27a-ba724131f0de\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") "
Jul 06 23:29:26.859210 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859162    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-config\") pod \"8d0e853d-99eb-46f9-b27a-ba724131f0de\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") "
Jul 06 23:29:26.859210 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-serving-cert\") pod \"8d0e853d-99eb-46f9-b27a-ba724131f0de\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") "
Jul 06 23:29:26.859210 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859218    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-service-ca\") pod \"8d0e853d-99eb-46f9-b27a-ba724131f0de\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") "
Jul 06 23:29:26.859541 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-oauth-config\") pod \"8d0e853d-99eb-46f9-b27a-ba724131f0de\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") "
Jul 06 23:29:26.859541 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859293    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-trusted-ca-bundle\") pod \"8d0e853d-99eb-46f9-b27a-ba724131f0de\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") "
Jul 06 23:29:26.859541 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-oauth-serving-cert\") pod \"8d0e853d-99eb-46f9-b27a-ba724131f0de\" (UID: \"8d0e853d-99eb-46f9-b27a-ba724131f0de\") "
Jul 06 23:29:26.859716 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859689    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-config" (OuterVolumeSpecName: "console-config") pod "8d0e853d-99eb-46f9-b27a-ba724131f0de" (UID: "8d0e853d-99eb-46f9-b27a-ba724131f0de"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:29:26.859716 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859703    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d0e853d-99eb-46f9-b27a-ba724131f0de" (UID: "8d0e853d-99eb-46f9-b27a-ba724131f0de"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:29:26.859822 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859727    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d0e853d-99eb-46f9-b27a-ba724131f0de" (UID: "8d0e853d-99eb-46f9-b27a-ba724131f0de"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:29:26.859822 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.859792    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d0e853d-99eb-46f9-b27a-ba724131f0de" (UID: "8d0e853d-99eb-46f9-b27a-ba724131f0de"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:29:26.861550 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.861518    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d0e853d-99eb-46f9-b27a-ba724131f0de" (UID: "8d0e853d-99eb-46f9-b27a-ba724131f0de"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:29:26.861659 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.861562    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d0e853d-99eb-46f9-b27a-ba724131f0de" (UID: "8d0e853d-99eb-46f9-b27a-ba724131f0de"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:29:26.861659 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.861569    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0e853d-99eb-46f9-b27a-ba724131f0de-kube-api-access-bzbmq" (OuterVolumeSpecName: "kube-api-access-bzbmq") pod "8d0e853d-99eb-46f9-b27a-ba724131f0de" (UID: "8d0e853d-99eb-46f9-b27a-ba724131f0de"). InnerVolumeSpecName "kube-api-access-bzbmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:29:26.960728 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.960697    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzbmq\" (UniqueName: \"kubernetes.io/projected/8d0e853d-99eb-46f9-b27a-ba724131f0de-kube-api-access-bzbmq\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:29:26.960728 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.960726    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-config\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:29:26.960882 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.960739    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-serving-cert\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:29:26.960882 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.960748    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:29:26.960882 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.960756    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d0e853d-99eb-46f9-b27a-ba724131f0de-console-oauth-config\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:29:26.960882 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.960763    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-trusted-ca-bundle\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:29:26.960882 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:26.960772    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d0e853d-99eb-46f9-b27a-ba724131f0de-oauth-serving-cert\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:29:27.468437 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.468399    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d0e853d-99eb-46f9-b27a-ba724131f0de" containerID="ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a" exitCode=0
Jul 06 23:29:27.468843 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.468444    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c95476dd-swbmg"
Jul 06 23:29:27.468843 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.468488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c95476dd-swbmg" event={"ID":"8d0e853d-99eb-46f9-b27a-ba724131f0de","Type":"ContainerDied","Data":"ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a"}
Jul 06 23:29:27.468843 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.468536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c95476dd-swbmg" event={"ID":"8d0e853d-99eb-46f9-b27a-ba724131f0de","Type":"ContainerDied","Data":"9a5b33132fe738f8211fb8dac0e2ce26d8511909620b639a7ebc961c2405f8e6"}
Jul 06 23:29:27.468843 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.468597    2579 scope.go:117] "RemoveContainer" containerID="ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a"
Jul 06 23:29:27.476670 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.476654    2579 scope.go:117] "RemoveContainer" containerID="ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a"
Jul 06 23:29:27.476922 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:29:27.476904    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a\": container with ID starting with ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a not found: ID does not exist" containerID="ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a"
Jul 06 23:29:27.476988 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.476933    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a"} err="failed to get container status \"ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a\": rpc error: code = NotFound desc = could not find container \"ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a\": container with ID starting with ec2321d07ed6e8999fa5f81527ed30ebeeb67783d65d783d46161623f452798a not found: ID does not exist"
Jul 06 23:29:27.483020 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.482992    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c95476dd-swbmg"]
Jul 06 23:29:27.487019 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:27.486988    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74c95476dd-swbmg"]
Jul 06 23:29:29.379140 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:29.379109    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0e853d-99eb-46f9-b27a-ba724131f0de" path="/var/lib/kubelet/pods/8d0e853d-99eb-46f9-b27a-ba724131f0de/volumes"
Jul 06 23:29:45.250124 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:45.250090    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:29:45.256455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:45.256431    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 23:29:45.257870 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:29:45.257847    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:30:04.177785 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.177749    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lgc2k"]
Jul 06 23:30:04.180315 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.177998    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0e853d-99eb-46f9-b27a-ba724131f0de" containerName="console"
Jul 06 23:30:04.180315 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.178010    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0e853d-99eb-46f9-b27a-ba724131f0de" containerName="console"
Jul 06 23:30:04.180315 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.178075    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0e853d-99eb-46f9-b27a-ba724131f0de" containerName="console"
Jul 06 23:30:04.181167 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.181152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:04.184495 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.184472    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 23:30:04.184628 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.184479    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 23:30:04.184628 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.184497    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vt77g\""
Jul 06 23:30:04.195959 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.192497    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lgc2k"]
Jul 06 23:30:04.222309 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.222283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff95813c-2a72-4704-b0e2-f643372f83cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lgc2k\" (UID: \"ff95813c-2a72-4704-b0e2-f643372f83cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:04.222416 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.222311    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvt5p\" (UniqueName: \"kubernetes.io/projected/ff95813c-2a72-4704-b0e2-f643372f83cf-kube-api-access-fvt5p\") pod \"cert-manager-webhook-6486ffd997-lgc2k\" (UID: \"ff95813c-2a72-4704-b0e2-f643372f83cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:04.323340 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.323302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff95813c-2a72-4704-b0e2-f643372f83cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lgc2k\" (UID: \"ff95813c-2a72-4704-b0e2-f643372f83cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:04.323340 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.323340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvt5p\" (UniqueName: \"kubernetes.io/projected/ff95813c-2a72-4704-b0e2-f643372f83cf-kube-api-access-fvt5p\") pod \"cert-manager-webhook-6486ffd997-lgc2k\" (UID: \"ff95813c-2a72-4704-b0e2-f643372f83cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:04.332258 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.332227    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvt5p\" (UniqueName: \"kubernetes.io/projected/ff95813c-2a72-4704-b0e2-f643372f83cf-kube-api-access-fvt5p\") pod \"cert-manager-webhook-6486ffd997-lgc2k\" (UID: \"ff95813c-2a72-4704-b0e2-f643372f83cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:04.332780 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.332757    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff95813c-2a72-4704-b0e2-f643372f83cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lgc2k\" (UID: \"ff95813c-2a72-4704-b0e2-f643372f83cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:04.489559 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.489526    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:04.626134 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.626104    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lgc2k"]
Jul 06 23:30:04.629235 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:30:04.629200    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff95813c_2a72_4704_b0e2_f643372f83cf.slice/crio-ac39053fc6daf383b503989a8e35d032210b128ab3b242a53c6ea26fb7a979b4 WatchSource:0}: Error finding container ac39053fc6daf383b503989a8e35d032210b128ab3b242a53c6ea26fb7a979b4: Status 404 returned error can't find the container with id ac39053fc6daf383b503989a8e35d032210b128ab3b242a53c6ea26fb7a979b4
Jul 06 23:30:04.631014 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:04.630999    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:30:05.597418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:05.597381    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k" event={"ID":"ff95813c-2a72-4704-b0e2-f643372f83cf","Type":"ContainerStarted","Data":"ac39053fc6daf383b503989a8e35d032210b128ab3b242a53c6ea26fb7a979b4"}
Jul 06 23:30:08.404295 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.404260    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"]
Jul 06 23:30:08.407308 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.407291    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"
Jul 06 23:30:08.410221 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.410203    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9rhw9\""
Jul 06 23:30:08.416154 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.416131    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"]
Jul 06 23:30:08.456194 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.456161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xtpn\" (UniqueName: \"kubernetes.io/projected/889a3e36-98b6-4eb8-9ba9-950b1a5f70ca-kube-api-access-6xtpn\") pod \"cert-manager-cainjector-559cdd8c87-jc9fx\" (UID: \"889a3e36-98b6-4eb8-9ba9-950b1a5f70ca\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"
Jul 06 23:30:08.456194 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.456204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889a3e36-98b6-4eb8-9ba9-950b1a5f70ca-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jc9fx\" (UID: \"889a3e36-98b6-4eb8-9ba9-950b1a5f70ca\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"
Jul 06 23:30:08.557278 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.557171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xtpn\" (UniqueName: \"kubernetes.io/projected/889a3e36-98b6-4eb8-9ba9-950b1a5f70ca-kube-api-access-6xtpn\") pod \"cert-manager-cainjector-559cdd8c87-jc9fx\" (UID: \"889a3e36-98b6-4eb8-9ba9-950b1a5f70ca\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"
Jul 06 23:30:08.557278 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.557227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889a3e36-98b6-4eb8-9ba9-950b1a5f70ca-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jc9fx\" (UID: \"889a3e36-98b6-4eb8-9ba9-950b1a5f70ca\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"
Jul 06 23:30:08.564981 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.564957    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889a3e36-98b6-4eb8-9ba9-950b1a5f70ca-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jc9fx\" (UID: \"889a3e36-98b6-4eb8-9ba9-950b1a5f70ca\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"
Jul 06 23:30:08.565256 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.565237    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xtpn\" (UniqueName: \"kubernetes.io/projected/889a3e36-98b6-4eb8-9ba9-950b1a5f70ca-kube-api-access-6xtpn\") pod \"cert-manager-cainjector-559cdd8c87-jc9fx\" (UID: \"889a3e36-98b6-4eb8-9ba9-950b1a5f70ca\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"
Jul 06 23:30:08.613342 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.613300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k" event={"ID":"ff95813c-2a72-4704-b0e2-f643372f83cf","Type":"ContainerStarted","Data":"beacdcf295e7c28722ce1305f6957ce738ed7204b50ec6ecb0c18eac7fe5f0e4"}
Jul 06 23:30:08.613665 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.613642    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:08.630786 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.630742    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k" podStartSLOduration=0.953451348 podStartE2EDuration="4.630728605s" totalImagesPullingTime="3.677277257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:30:08.629848094 +0000 UTC m=+323.763840287" watchObservedRunningTime="2026-07-06 23:30:08.630728605 +0000 UTC m=+323.764720795"
Jul 06 23:30:08.717513 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.717481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"
Jul 06 23:30:08.847046 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:08.846966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx"]
Jul 06 23:30:08.849703 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:30:08.849677    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod889a3e36_98b6_4eb8_9ba9_950b1a5f70ca.slice/crio-e9fd5edeb45e1fdd8f3520ee9240c8fcf16fd127559f40a494d1db33a5fffa2c WatchSource:0}: Error finding container e9fd5edeb45e1fdd8f3520ee9240c8fcf16fd127559f40a494d1db33a5fffa2c: Status 404 returned error can't find the container with id e9fd5edeb45e1fdd8f3520ee9240c8fcf16fd127559f40a494d1db33a5fffa2c
Jul 06 23:30:09.617969 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:09.617934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx" event={"ID":"889a3e36-98b6-4eb8-9ba9-950b1a5f70ca","Type":"ContainerStarted","Data":"b93feef83c5c933df079fc01c29ee5af34dd16e43813ab0c43426a91e40e4eda"}
Jul 06 23:30:09.617969 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:09.617982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx" event={"ID":"889a3e36-98b6-4eb8-9ba9-950b1a5f70ca","Type":"ContainerStarted","Data":"e9fd5edeb45e1fdd8f3520ee9240c8fcf16fd127559f40a494d1db33a5fffa2c"}
Jul 06 23:30:09.637758 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:09.637715    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jc9fx" podStartSLOduration=1.637699908 podStartE2EDuration="1.637699908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:30:09.637135359 +0000 UTC m=+324.771127551" watchObservedRunningTime="2026-07-06 23:30:09.637699908 +0000 UTC m=+324.771692099"
Jul 06 23:30:14.620206 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:14.620176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lgc2k"
Jul 06 23:30:17.540701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.540660    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"]
Jul 06 23:30:17.544000 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.543976    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"
Jul 06 23:30:17.546578 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.546553    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:30:17.546674 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.546616    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7lxp8\""
Jul 06 23:30:17.547627 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.547609    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 23:30:17.557001 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.556979    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"]
Jul 06 23:30:17.620317 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.620287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32122421-ff30-4ae6-a0e7-b48a2fbf2b7c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5g22p\" (UID: \"32122421-ff30-4ae6-a0e7-b48a2fbf2b7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"
Jul 06 23:30:17.620484 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.620369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7gc\" (UniqueName: \"kubernetes.io/projected/32122421-ff30-4ae6-a0e7-b48a2fbf2b7c-kube-api-access-fq7gc\") pod \"openshift-lws-operator-fd8ccff4c-5g22p\" (UID: \"32122421-ff30-4ae6-a0e7-b48a2fbf2b7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"
Jul 06 23:30:17.721737 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.721694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32122421-ff30-4ae6-a0e7-b48a2fbf2b7c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5g22p\" (UID: \"32122421-ff30-4ae6-a0e7-b48a2fbf2b7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"
Jul 06 23:30:17.721909 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.721760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7gc\" (UniqueName: \"kubernetes.io/projected/32122421-ff30-4ae6-a0e7-b48a2fbf2b7c-kube-api-access-fq7gc\") pod \"openshift-lws-operator-fd8ccff4c-5g22p\" (UID: \"32122421-ff30-4ae6-a0e7-b48a2fbf2b7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"
Jul 06 23:30:17.722173 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.722153    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32122421-ff30-4ae6-a0e7-b48a2fbf2b7c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5g22p\" (UID: \"32122421-ff30-4ae6-a0e7-b48a2fbf2b7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"
Jul 06 23:30:17.730464 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.730426    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7gc\" (UniqueName: \"kubernetes.io/projected/32122421-ff30-4ae6-a0e7-b48a2fbf2b7c-kube-api-access-fq7gc\") pod \"openshift-lws-operator-fd8ccff4c-5g22p\" (UID: \"32122421-ff30-4ae6-a0e7-b48a2fbf2b7c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"
Jul 06 23:30:17.853597 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.853512    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"
Jul 06 23:30:17.981838 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:17.981810    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p"]
Jul 06 23:30:17.984943 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:30:17.984914    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32122421_ff30_4ae6_a0e7_b48a2fbf2b7c.slice/crio-bf990ad4a6dacba56c25543e4bd83b49d4af4e14108251f64efd08f11e26972e WatchSource:0}: Error finding container bf990ad4a6dacba56c25543e4bd83b49d4af4e14108251f64efd08f11e26972e: Status 404 returned error can't find the container with id bf990ad4a6dacba56c25543e4bd83b49d4af4e14108251f64efd08f11e26972e
Jul 06 23:30:18.654594 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:18.654558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p" event={"ID":"32122421-ff30-4ae6-a0e7-b48a2fbf2b7c","Type":"ContainerStarted","Data":"bf990ad4a6dacba56c25543e4bd83b49d4af4e14108251f64efd08f11e26972e"}
Jul 06 23:30:20.663616 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:20.663527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p" event={"ID":"32122421-ff30-4ae6-a0e7-b48a2fbf2b7c","Type":"ContainerStarted","Data":"0f0b47e7f6a3022a4152293a5e74255600ca413d9ea98eccbc6aeeb4ec7cd242"}
Jul 06 23:30:20.680752 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:20.680701    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5g22p" podStartSLOduration=1.43609827 podStartE2EDuration="3.680686508s" totalImagesPullingTime="2.244588238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:30:20.679412011 +0000 UTC m=+335.813404202" watchObservedRunningTime="2026-07-06 23:30:20.680686508 +0000 UTC m=+335.814678700"
Jul 06 23:30:37.282273 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.282195    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"]
Jul 06 23:30:37.285313 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.285295    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.289325 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.289298    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8sd44\""
Jul 06 23:30:37.289539 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.289519    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 23:30:37.290169 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.290151    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 23:30:37.290278 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.290262    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 23:30:37.290380 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.290365    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 23:30:37.305788 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.305761    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"]
Jul 06 23:30:37.386446 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.386412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwtdv\" (UniqueName: \"kubernetes.io/projected/eaa02c61-ffa1-47d8-b2bb-15da4478517e-kube-api-access-dwtdv\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.386606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.386470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eaa02c61-ffa1-47d8-b2bb-15da4478517e-manifests\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.386606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.386542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eaa02c61-ffa1-47d8-b2bb-15da4478517e-tmp\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.386606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.386579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eaa02c61-ffa1-47d8-b2bb-15da4478517e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.386606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.386598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaa02c61-ffa1-47d8-b2bb-15da4478517e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.487140 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.487107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwtdv\" (UniqueName: \"kubernetes.io/projected/eaa02c61-ffa1-47d8-b2bb-15da4478517e-kube-api-access-dwtdv\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.487329 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.487166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eaa02c61-ffa1-47d8-b2bb-15da4478517e-manifests\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.487329 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.487199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eaa02c61-ffa1-47d8-b2bb-15da4478517e-tmp\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.487329 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.487217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eaa02c61-ffa1-47d8-b2bb-15da4478517e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.487329 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.487233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaa02c61-ffa1-47d8-b2bb-15da4478517e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.487723 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.487694    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eaa02c61-ffa1-47d8-b2bb-15da4478517e-manifests\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.489694 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.489662    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eaa02c61-ffa1-47d8-b2bb-15da4478517e-tmp\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.489818 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.489718    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaa02c61-ffa1-47d8-b2bb-15da4478517e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.489878 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.489855    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eaa02c61-ffa1-47d8-b2bb-15da4478517e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.528386 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.528353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwtdv\" (UniqueName: \"kubernetes.io/projected/eaa02c61-ffa1-47d8-b2bb-15da4478517e-kube-api-access-dwtdv\") pod \"opendatahub-operator-controller-manager-d555ff84d-wmpmt\" (UID: \"eaa02c61-ffa1-47d8-b2bb-15da4478517e\") " pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.596098 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.595985    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:37.756241 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:37.756209    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"]
Jul 06 23:30:37.760033 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:30:37.760010    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa02c61_ffa1_47d8_b2bb_15da4478517e.slice/crio-5994ffffab93092b588f82262cfca5ff651ec46b8c09af9aa66c23bb47e8a823 WatchSource:0}: Error finding container 5994ffffab93092b588f82262cfca5ff651ec46b8c09af9aa66c23bb47e8a823: Status 404 returned error can't find the container with id 5994ffffab93092b588f82262cfca5ff651ec46b8c09af9aa66c23bb47e8a823
Jul 06 23:30:38.730512 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:38.730475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt" event={"ID":"eaa02c61-ffa1-47d8-b2bb-15da4478517e","Type":"ContainerStarted","Data":"5994ffffab93092b588f82262cfca5ff651ec46b8c09af9aa66c23bb47e8a823"}
Jul 06 23:30:41.742953 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:41.742911    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt" event={"ID":"eaa02c61-ffa1-47d8-b2bb-15da4478517e","Type":"ContainerStarted","Data":"162b752808e4e6a1cd5a2f3de382b48e5e82d0d64ab8141297c78cc3d8f426af"}
Jul 06 23:30:42.748334 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:42.748299    2579 generic.go:356] "Generic (PLEG): container finished" podID="eaa02c61-ffa1-47d8-b2bb-15da4478517e" containerID="162b752808e4e6a1cd5a2f3de382b48e5e82d0d64ab8141297c78cc3d8f426af" exitCode=0
Jul 06 23:30:42.748764 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:42.748390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt" event={"ID":"eaa02c61-ffa1-47d8-b2bb-15da4478517e","Type":"ContainerDied","Data":"162b752808e4e6a1cd5a2f3de382b48e5e82d0d64ab8141297c78cc3d8f426af"}
Jul 06 23:30:43.754465 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:43.754425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt" event={"ID":"eaa02c61-ffa1-47d8-b2bb-15da4478517e","Type":"ContainerStarted","Data":"d0cfd5efca83a155f307d1e7d2928ac64bdba97c25b527ee19dd192cb206f70d"}
Jul 06 23:30:43.754885 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:43.754513    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:43.793031 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:43.792976    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt" podStartSLOduration=2.087956912 podStartE2EDuration="6.79295819s" totalImagesPullingTime="3.695325286s" totalInitContainerRuntime="1.009675992s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:30:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:30:43.792873045 +0000 UTC m=+358.926865236" watchObservedRunningTime="2026-07-06 23:30:43.79295819 +0000 UTC m=+358.926950380"
Jul 06 23:30:54.760943 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:54.760913    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d555ff84d-wmpmt"
Jul 06 23:30:57.850830 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:57.850796    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zkd5"]
Jul 06 23:30:57.859765 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:57.859738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:30:57.863318 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:57.863294    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wdckz\""
Jul 06 23:30:57.863546 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:57.863528    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 23:30:57.894928 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:57.894897    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zkd5"]
Jul 06 23:30:57.954972 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:57.954940    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm6r7\" (UniqueName: \"kubernetes.io/projected/fea166d9-d041-4709-9b27-21a3aae74b66-kube-api-access-mm6r7\") pod \"odh-model-controller-7998c67dc4-9zkd5\" (UID: \"fea166d9-d041-4709-9b27-21a3aae74b66\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:30:57.955177 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:57.955026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fea166d9-d041-4709-9b27-21a3aae74b66-cert\") pod \"odh-model-controller-7998c67dc4-9zkd5\" (UID: \"fea166d9-d041-4709-9b27-21a3aae74b66\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:30:58.055639 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.055611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fea166d9-d041-4709-9b27-21a3aae74b66-cert\") pod \"odh-model-controller-7998c67dc4-9zkd5\" (UID: \"fea166d9-d041-4709-9b27-21a3aae74b66\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:30:58.055815 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.055659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm6r7\" (UniqueName: \"kubernetes.io/projected/fea166d9-d041-4709-9b27-21a3aae74b66-kube-api-access-mm6r7\") pod \"odh-model-controller-7998c67dc4-9zkd5\" (UID: \"fea166d9-d041-4709-9b27-21a3aae74b66\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:30:58.058268 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.058248    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fea166d9-d041-4709-9b27-21a3aae74b66-cert\") pod \"odh-model-controller-7998c67dc4-9zkd5\" (UID: \"fea166d9-d041-4709-9b27-21a3aae74b66\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:30:58.073013 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.072988    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm6r7\" (UniqueName: \"kubernetes.io/projected/fea166d9-d041-4709-9b27-21a3aae74b66-kube-api-access-mm6r7\") pod \"odh-model-controller-7998c67dc4-9zkd5\" (UID: \"fea166d9-d041-4709-9b27-21a3aae74b66\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:30:58.172990 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.172914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:30:58.323447 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.323413    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zkd5"]
Jul 06 23:30:58.325122 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:30:58.325095    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea166d9_d041_4709_9b27_21a3aae74b66.slice/crio-86405041f310313b6ae8cd5bb90b7406a539e5b24a814926e3f05dd1851a7c4f WatchSource:0}: Error finding container 86405041f310313b6ae8cd5bb90b7406a539e5b24a814926e3f05dd1851a7c4f: Status 404 returned error can't find the container with id 86405041f310313b6ae8cd5bb90b7406a539e5b24a814926e3f05dd1851a7c4f
Jul 06 23:30:58.716912 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.716876    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6ghx9"]
Jul 06 23:30:58.721405 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.721387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:30:58.727045 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.727018    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 23:30:58.734707 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.734672    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6ghx9"]
Jul 06 23:30:58.760511 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.760477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d9026b-36ce-409d-af8b-cdabee7722d2-tls-certs\") pod \"model-serving-api-54d89bd5fc-6ghx9\" (UID: \"b4d9026b-36ce-409d-af8b-cdabee7722d2\") " pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:30:58.760675 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.760536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9qh9\" (UniqueName: \"kubernetes.io/projected/b4d9026b-36ce-409d-af8b-cdabee7722d2-kube-api-access-j9qh9\") pod \"model-serving-api-54d89bd5fc-6ghx9\" (UID: \"b4d9026b-36ce-409d-af8b-cdabee7722d2\") " pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:30:58.815134 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.815093    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5" event={"ID":"fea166d9-d041-4709-9b27-21a3aae74b66","Type":"ContainerStarted","Data":"86405041f310313b6ae8cd5bb90b7406a539e5b24a814926e3f05dd1851a7c4f"}
Jul 06 23:30:58.861663 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.861614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d9026b-36ce-409d-af8b-cdabee7722d2-tls-certs\") pod \"model-serving-api-54d89bd5fc-6ghx9\" (UID: \"b4d9026b-36ce-409d-af8b-cdabee7722d2\") " pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:30:58.862140 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.861672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9qh9\" (UniqueName: \"kubernetes.io/projected/b4d9026b-36ce-409d-af8b-cdabee7722d2-kube-api-access-j9qh9\") pod \"model-serving-api-54d89bd5fc-6ghx9\" (UID: \"b4d9026b-36ce-409d-af8b-cdabee7722d2\") " pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:30:58.862140 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:30:58.861815    2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 23:30:58.862140 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:30:58.861885    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d9026b-36ce-409d-af8b-cdabee7722d2-tls-certs podName:b4d9026b-36ce-409d-af8b-cdabee7722d2 nodeName:}" failed. No retries permitted until 2026-07-06 23:30:59.361862492 +0000 UTC m=+374.495854680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b4d9026b-36ce-409d-af8b-cdabee7722d2-tls-certs") pod "model-serving-api-54d89bd5fc-6ghx9" (UID: "b4d9026b-36ce-409d-af8b-cdabee7722d2") : secret "model-serving-api-tls" not found
Jul 06 23:30:58.882453 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:58.882412    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9qh9\" (UniqueName: \"kubernetes.io/projected/b4d9026b-36ce-409d-af8b-cdabee7722d2-kube-api-access-j9qh9\") pod \"model-serving-api-54d89bd5fc-6ghx9\" (UID: \"b4d9026b-36ce-409d-af8b-cdabee7722d2\") " pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:30:59.365734 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:59.365693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d9026b-36ce-409d-af8b-cdabee7722d2-tls-certs\") pod \"model-serving-api-54d89bd5fc-6ghx9\" (UID: \"b4d9026b-36ce-409d-af8b-cdabee7722d2\") " pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:30:59.368898 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:59.368866    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d9026b-36ce-409d-af8b-cdabee7722d2-tls-certs\") pod \"model-serving-api-54d89bd5fc-6ghx9\" (UID: \"b4d9026b-36ce-409d-af8b-cdabee7722d2\") " pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:30:59.631298 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:30:59.631223    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:31:00.864897 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:00.864867    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6ghx9"]
Jul 06 23:31:00.866459 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:31:00.866437    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d9026b_36ce_409d_af8b_cdabee7722d2.slice/crio-6763ca5a4d0034eaaab9fe983131a2552b2165b96b1b83a0f55723f1e255fc25 WatchSource:0}: Error finding container 6763ca5a4d0034eaaab9fe983131a2552b2165b96b1b83a0f55723f1e255fc25: Status 404 returned error can't find the container with id 6763ca5a4d0034eaaab9fe983131a2552b2165b96b1b83a0f55723f1e255fc25
Jul 06 23:31:01.830264 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:01.830225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9" event={"ID":"b4d9026b-36ce-409d-af8b-cdabee7722d2","Type":"ContainerStarted","Data":"6763ca5a4d0034eaaab9fe983131a2552b2165b96b1b83a0f55723f1e255fc25"}
Jul 06 23:31:01.831812 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:01.831779    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5" event={"ID":"fea166d9-d041-4709-9b27-21a3aae74b66","Type":"ContainerStarted","Data":"7eb664373577afdf748d8602f25b39bd45ed00ae689da27b32da744397297fb6"}
Jul 06 23:31:01.832028 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:01.832003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:31:02.837167 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:02.837127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9" event={"ID":"b4d9026b-36ce-409d-af8b-cdabee7722d2","Type":"ContainerStarted","Data":"69e07af5c6aafd4d4930fea426dc823e0b26490a6dadd9d84ddd8f6829908b96"}
Jul 06 23:31:02.837564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:02.837342    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:31:02.852741 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:02.852695    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5" podStartSLOduration=3.389173671 podStartE2EDuration="5.852675851s" totalImagesPullingTime="2.46350218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:31:01.848421708 +0000 UTC m=+376.982413899" watchObservedRunningTime="2026-07-06 23:31:02.852675851 +0000 UTC m=+377.986668042"
Jul 06 23:31:02.852875 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:02.852779    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9" podStartSLOduration=3.310655255 podStartE2EDuration="4.852773651s" totalImagesPullingTime="1.542118396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:31:02.85191451 +0000 UTC m=+377.985906702" watchObservedRunningTime="2026-07-06 23:31:02.852773651 +0000 UTC m=+377.986766024"
Jul 06 23:31:07.252727 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.252697    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"]
Jul 06 23:31:07.255682 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.255666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:07.258097 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.258075    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 23:31:07.261492 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.261472    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-d76vn\""
Jul 06 23:31:07.264283 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.264257    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"]
Jul 06 23:31:07.273666 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.273646    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"]
Jul 06 23:31:07.281239 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.281219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:07.283869 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.283851    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 23:31:07.283993 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.283889    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-x4qxg\""
Jul 06 23:31:07.288809 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.288790    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"]
Jul 06 23:31:07.329519 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.329475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnn4b\" (UniqueName: \"kubernetes.io/projected/dc080633-5808-4a44-a5d2-af5ef81e225e-kube-api-access-cnn4b\") pod \"kserve-controller-manager-d6f4b65b8-zn5qt\" (UID: \"dc080633-5808-4a44-a5d2-af5ef81e225e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:07.329692 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.329534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc080633-5808-4a44-a5d2-af5ef81e225e-cert\") pod \"kserve-controller-manager-d6f4b65b8-zn5qt\" (UID: \"dc080633-5808-4a44-a5d2-af5ef81e225e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:07.329692 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.329609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93828de8-6b47-4a69-bd23-a27e83f802be-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7khxz\" (UID: \"93828de8-6b47-4a69-bd23-a27e83f802be\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:07.329692 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.329641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xklkt\" (UniqueName: \"kubernetes.io/projected/93828de8-6b47-4a69-bd23-a27e83f802be-kube-api-access-xklkt\") pod \"llmisvc-controller-manager-777c6bd7d5-7khxz\" (UID: \"93828de8-6b47-4a69-bd23-a27e83f802be\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:07.430606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.430570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93828de8-6b47-4a69-bd23-a27e83f802be-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7khxz\" (UID: \"93828de8-6b47-4a69-bd23-a27e83f802be\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:07.430606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.430607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xklkt\" (UniqueName: \"kubernetes.io/projected/93828de8-6b47-4a69-bd23-a27e83f802be-kube-api-access-xklkt\") pod \"llmisvc-controller-manager-777c6bd7d5-7khxz\" (UID: \"93828de8-6b47-4a69-bd23-a27e83f802be\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:07.430842 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.430676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnn4b\" (UniqueName: \"kubernetes.io/projected/dc080633-5808-4a44-a5d2-af5ef81e225e-kube-api-access-cnn4b\") pod \"kserve-controller-manager-d6f4b65b8-zn5qt\" (UID: \"dc080633-5808-4a44-a5d2-af5ef81e225e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:07.430842 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.430733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc080633-5808-4a44-a5d2-af5ef81e225e-cert\") pod \"kserve-controller-manager-d6f4b65b8-zn5qt\" (UID: \"dc080633-5808-4a44-a5d2-af5ef81e225e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:07.430941 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:31:07.430850    2579 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 06 23:31:07.430941 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:31:07.430920    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc080633-5808-4a44-a5d2-af5ef81e225e-cert podName:dc080633-5808-4a44-a5d2-af5ef81e225e nodeName:}" failed. No retries permitted until 2026-07-06 23:31:07.93090068 +0000 UTC m=+383.064892855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dc080633-5808-4a44-a5d2-af5ef81e225e-cert") pod "kserve-controller-manager-d6f4b65b8-zn5qt" (UID: "dc080633-5808-4a44-a5d2-af5ef81e225e") : secret "kserve-webhook-server-cert" not found
Jul 06 23:31:07.433153 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.433130    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93828de8-6b47-4a69-bd23-a27e83f802be-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7khxz\" (UID: \"93828de8-6b47-4a69-bd23-a27e83f802be\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:07.442153 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.442130    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xklkt\" (UniqueName: \"kubernetes.io/projected/93828de8-6b47-4a69-bd23-a27e83f802be-kube-api-access-xklkt\") pod \"llmisvc-controller-manager-777c6bd7d5-7khxz\" (UID: \"93828de8-6b47-4a69-bd23-a27e83f802be\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:07.461454 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.461425    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnn4b\" (UniqueName: \"kubernetes.io/projected/dc080633-5808-4a44-a5d2-af5ef81e225e-kube-api-access-cnn4b\") pod \"kserve-controller-manager-d6f4b65b8-zn5qt\" (UID: \"dc080633-5808-4a44-a5d2-af5ef81e225e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:07.592317 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.592231    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:07.727630 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.727595    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"]
Jul 06 23:31:07.731310 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:31:07.731280    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod93828de8_6b47_4a69_bd23_a27e83f802be.slice/crio-3d5cdbe088cf78d37b5d1252484096a447292911ac4e41ca36dfaeb550f316ab WatchSource:0}: Error finding container 3d5cdbe088cf78d37b5d1252484096a447292911ac4e41ca36dfaeb550f316ab: Status 404 returned error can't find the container with id 3d5cdbe088cf78d37b5d1252484096a447292911ac4e41ca36dfaeb550f316ab
Jul 06 23:31:07.858732 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.858652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz" event={"ID":"93828de8-6b47-4a69-bd23-a27e83f802be","Type":"ContainerStarted","Data":"3d5cdbe088cf78d37b5d1252484096a447292911ac4e41ca36dfaeb550f316ab"}
Jul 06 23:31:07.935947 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.935914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc080633-5808-4a44-a5d2-af5ef81e225e-cert\") pod \"kserve-controller-manager-d6f4b65b8-zn5qt\" (UID: \"dc080633-5808-4a44-a5d2-af5ef81e225e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:07.938355 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:07.938332    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc080633-5808-4a44-a5d2-af5ef81e225e-cert\") pod \"kserve-controller-manager-d6f4b65b8-zn5qt\" (UID: \"dc080633-5808-4a44-a5d2-af5ef81e225e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:08.166583 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.166503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:08.302178 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.302147    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"]
Jul 06 23:31:08.305630 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:31:08.305604    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc080633_5808_4a44_a5d2_af5ef81e225e.slice/crio-f95cb0473c6e5ac7d646029e0c1468dce344bfb8c5a91849edc385f1959b2575 WatchSource:0}: Error finding container f95cb0473c6e5ac7d646029e0c1468dce344bfb8c5a91849edc385f1959b2575: Status 404 returned error can't find the container with id f95cb0473c6e5ac7d646029e0c1468dce344bfb8c5a91849edc385f1959b2575
Jul 06 23:31:08.344692 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.344656    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66bf577d87-d848p"]
Jul 06 23:31:08.347498 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.347482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.350627 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.350606    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 23:31:08.350856 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.350842    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 23:31:08.350944 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.350910    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 23:31:08.350944 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.350924    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5l9hp\""
Jul 06 23:31:08.351460 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.351446    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 23:31:08.357737 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.357718    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66bf577d87-d848p"]
Jul 06 23:31:08.442169 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.442081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d99h\" (UniqueName: \"kubernetes.io/projected/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-kube-api-access-9d99h\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.442169 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.442134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tls-certs\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.442390 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.442209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tmp\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.543267 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.543235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d99h\" (UniqueName: \"kubernetes.io/projected/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-kube-api-access-9d99h\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.543267 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.543275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tls-certs\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.543516 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.543324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tmp\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.544004 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:31:08.543695    2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 23:31:08.544004 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:31:08.543774    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tls-certs podName:aaad8a68-05f3-4ebc-aa52-93c9639f1d47 nodeName:}" failed. No retries permitted until 2026-07-06 23:31:09.043754361 +0000 UTC m=+384.177746536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tls-certs") pod "kube-auth-proxy-66bf577d87-d848p" (UID: "aaad8a68-05f3-4ebc-aa52-93c9639f1d47") : secret "kube-auth-proxy-tls" not found
Jul 06 23:31:08.546132 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.546104    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tmp\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.562738 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.562654    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d99h\" (UniqueName: \"kubernetes.io/projected/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-kube-api-access-9d99h\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:08.864575 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:08.864542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt" event={"ID":"dc080633-5808-4a44-a5d2-af5ef81e225e","Type":"ContainerStarted","Data":"f95cb0473c6e5ac7d646029e0c1468dce344bfb8c5a91849edc385f1959b2575"}
Jul 06 23:31:09.048039 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:09.047997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tls-certs\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:09.050627 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:09.050602    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaad8a68-05f3-4ebc-aa52-93c9639f1d47-tls-certs\") pod \"kube-auth-proxy-66bf577d87-d848p\" (UID: \"aaad8a68-05f3-4ebc-aa52-93c9639f1d47\") " pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:09.258746 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:09.258711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p"
Jul 06 23:31:09.416767 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:09.416665    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66bf577d87-d848p"]
Jul 06 23:31:09.420857 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:31:09.420830    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaad8a68_05f3_4ebc_aa52_93c9639f1d47.slice/crio-c4920a12efd4959f1ba835bed40c547ff8593df167e7a0763a5948facd30b7d9 WatchSource:0}: Error finding container c4920a12efd4959f1ba835bed40c547ff8593df167e7a0763a5948facd30b7d9: Status 404 returned error can't find the container with id c4920a12efd4959f1ba835bed40c547ff8593df167e7a0763a5948facd30b7d9
Jul 06 23:31:09.871347 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:09.871306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p" event={"ID":"aaad8a68-05f3-4ebc-aa52-93c9639f1d47","Type":"ContainerStarted","Data":"c4920a12efd4959f1ba835bed40c547ff8593df167e7a0763a5948facd30b7d9"}
Jul 06 23:31:10.399151 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.399121    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"]
Jul 06 23:31:10.402758 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.402728    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.407087 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.407043    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 23:31:10.407087 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.407071    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 23:31:10.407358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.407301    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xq5vp\""
Jul 06 23:31:10.407435 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.407389    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 23:31:10.407527 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.407509    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 23:31:10.417529 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.417501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"]
Jul 06 23:31:10.461414 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.461381    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.461619 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.461433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.461619 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.461456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.461619 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.461530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.461619 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.461579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c19891e-2507-40e3-8fba-7b548ba411ef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.461619 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.461609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.461873 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.461673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq55m\" (UniqueName: \"kubernetes.io/projected/3c19891e-2507-40e3-8fba-7b548ba411ef-kube-api-access-pq55m\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.562845 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.562806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c19891e-2507-40e3-8fba-7b548ba411ef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.563042 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.562859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.563042 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.562977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq55m\" (UniqueName: \"kubernetes.io/projected/3c19891e-2507-40e3-8fba-7b548ba411ef-kube-api-access-pq55m\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.563195 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.563041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.563195 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.563137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.563195 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.563182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.563341 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.563225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.563982 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.563953    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.566170 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.565823    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c19891e-2507-40e3-8fba-7b548ba411ef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.566170 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.566130    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.566326 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.566248    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.566326 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.566250    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.572105 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.572080    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c19891e-2507-40e3-8fba-7b548ba411ef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.572411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.572385    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq55m\" (UniqueName: \"kubernetes.io/projected/3c19891e-2507-40e3-8fba-7b548ba411ef-kube-api-access-pq55m\") pod \"istiod-openshift-gateway-94bb8fbfd-vnjrc\" (UID: \"3c19891e-2507-40e3-8fba-7b548ba411ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:10.715950 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:10.715908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:11.046305 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:11.046277    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"]
Jul 06 23:31:11.047924 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:31:11.047891    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c19891e_2507_40e3_8fba_7b548ba411ef.slice/crio-6cd588eb6724bdb68c11f5ffaf1f24c4810a2e074457bf91575f09c8eafc7bde WatchSource:0}: Error finding container 6cd588eb6724bdb68c11f5ffaf1f24c4810a2e074457bf91575f09c8eafc7bde: Status 404 returned error can't find the container with id 6cd588eb6724bdb68c11f5ffaf1f24c4810a2e074457bf91575f09c8eafc7bde
Jul 06 23:31:11.887208 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:11.887167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt" event={"ID":"dc080633-5808-4a44-a5d2-af5ef81e225e","Type":"ContainerStarted","Data":"a76923b1933fd885485fc7e214a5ab1bd7c3c3a172b086a0b483e8d343c2b671"}
Jul 06 23:31:11.887676 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:11.887293    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:31:11.889260 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:11.889207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc" event={"ID":"3c19891e-2507-40e3-8fba-7b548ba411ef","Type":"ContainerStarted","Data":"6cd588eb6724bdb68c11f5ffaf1f24c4810a2e074457bf91575f09c8eafc7bde"}
Jul 06 23:31:11.891747 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:11.891273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz" event={"ID":"93828de8-6b47-4a69-bd23-a27e83f802be","Type":"ContainerStarted","Data":"c0ded17489c629f93f50c769db77e7a3775ea3294024418a164280a04ca953e4"}
Jul 06 23:31:11.891747 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:11.891499    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:11.904367 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:11.904312    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt" podStartSLOduration=2.324777868 podStartE2EDuration="4.904296901s" totalImagesPullingTime="2.579519033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:31:11.904036613 +0000 UTC m=+387.038028816" watchObservedRunningTime="2026-07-06 23:31:11.904296901 +0000 UTC m=+387.038289095"
Jul 06 23:31:11.920711 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:11.920665    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz" podStartSLOduration=1.770185073 podStartE2EDuration="4.920647686s" totalImagesPullingTime="3.150462613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:31:11.919703849 +0000 UTC m=+387.053696046" watchObservedRunningTime="2026-07-06 23:31:11.920647686 +0000 UTC m=+387.054639879"
Jul 06 23:31:12.840159 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:12.840125    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9zkd5"
Jul 06 23:31:13.690533 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:13.690498    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 06 23:31:13.690957 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:13.690582    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 06 23:31:13.846532 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:13.846501    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6ghx9"
Jul 06 23:31:13.905177 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:13.905118    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc" event={"ID":"3c19891e-2507-40e3-8fba-7b548ba411ef","Type":"ContainerStarted","Data":"320f11ce5cf0687d316542853e99e932d56b875b4a5aa33f0648f157ef982cc5"}
Jul 06 23:31:13.905333 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:13.905218    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:13.906801 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:13.906778    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p" event={"ID":"aaad8a68-05f3-4ebc-aa52-93c9639f1d47","Type":"ContainerStarted","Data":"b1a0ae9d968ffa18d57894c6ffec2436b13d4429454e82aedd8378ddf60ceb8a"}
Jul 06 23:31:13.925341 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:13.925289    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc" podStartSLOduration=1.285189313 podStartE2EDuration="3.925270152s" totalImagesPullingTime="2.640080839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:31:13.922920427 +0000 UTC m=+389.056912622" watchObservedRunningTime="2026-07-06 23:31:13.925270152 +0000 UTC m=+389.059262343"
Jul 06 23:31:13.940778 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:13.940690    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66bf577d87-d848p" podStartSLOduration=1.6744935399999998 podStartE2EDuration="5.940671682s" totalImagesPullingTime="4.266178142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:31:13.938917874 +0000 UTC m=+389.072910072" watchObservedRunningTime="2026-07-06 23:31:13.940671682 +0000 UTC m=+389.074663875"
Jul 06 23:31:14.912943 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:14.912906    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-vnjrc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 23:31:14.913320 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:14.912976    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc" podUID="3c19891e-2507-40e3-8fba-7b548ba411ef" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 23:31:17.912692 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:17.912663    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vnjrc"
Jul 06 23:31:42.901738 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:42.901705    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7khxz"
Jul 06 23:31:42.904313 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:31:42.904286    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zn5qt"
Jul 06 23:32:42.138747 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.138708    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"]
Jul 06 23:32:42.142257 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.142235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"
Jul 06 23:32:42.144539 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.144509    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 23:32:42.144661 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.144575    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 23:32:42.145420 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.145404    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mqsz5\""
Jul 06 23:32:42.160710 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.160684    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"]
Jul 06 23:32:42.238553 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.238515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7qx\" (UniqueName: \"kubernetes.io/projected/247c46db-b8ba-4c52-a90f-3d357554073a-kube-api-access-sl7qx\") pod \"authorino-operator-75cc8d5cb7-mx6fl\" (UID: \"247c46db-b8ba-4c52-a90f-3d357554073a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"
Jul 06 23:32:42.339710 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.339672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7qx\" (UniqueName: \"kubernetes.io/projected/247c46db-b8ba-4c52-a90f-3d357554073a-kube-api-access-sl7qx\") pod \"authorino-operator-75cc8d5cb7-mx6fl\" (UID: \"247c46db-b8ba-4c52-a90f-3d357554073a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"
Jul 06 23:32:42.353693 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.353653    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7qx\" (UniqueName: \"kubernetes.io/projected/247c46db-b8ba-4c52-a90f-3d357554073a-kube-api-access-sl7qx\") pod \"authorino-operator-75cc8d5cb7-mx6fl\" (UID: \"247c46db-b8ba-4c52-a90f-3d357554073a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"
Jul 06 23:32:42.451901 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.451870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"
Jul 06 23:32:42.590565 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:42.590533    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"]
Jul 06 23:32:42.593973 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:32:42.593948    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247c46db_b8ba_4c52_a90f_3d357554073a.slice/crio-6f5d27cac102d588f8fabee93006bab30e776ea917266a19b7b34ef138a888bb WatchSource:0}: Error finding container 6f5d27cac102d588f8fabee93006bab30e776ea917266a19b7b34ef138a888bb: Status 404 returned error can't find the container with id 6f5d27cac102d588f8fabee93006bab30e776ea917266a19b7b34ef138a888bb
Jul 06 23:32:43.289745 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:43.289699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl" event={"ID":"247c46db-b8ba-4c52-a90f-3d357554073a","Type":"ContainerStarted","Data":"6f5d27cac102d588f8fabee93006bab30e776ea917266a19b7b34ef138a888bb"}
Jul 06 23:32:45.299642 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:45.299607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl" event={"ID":"247c46db-b8ba-4c52-a90f-3d357554073a","Type":"ContainerStarted","Data":"3480a690411e332ffbe33e7d71ab7ca810bbcedee35e7366b36a45ba423e73af"}
Jul 06 23:32:45.300070 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:45.299749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"
Jul 06 23:32:45.317440 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:45.317394    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl" podStartSLOduration=1.321618417 podStartE2EDuration="3.317378548s" totalImagesPullingTime="1.995760131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:32:45.317068577 +0000 UTC m=+480.451060758" watchObservedRunningTime="2026-07-06 23:32:45.317378548 +0000 UTC m=+480.451370826"
Jul 06 23:32:53.874576 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:53.874544    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d4c7977-c8mlq"]
Jul 06 23:32:56.306643 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:32:56.306612    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mx6fl"
Jul 06 23:33:18.901799 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:18.901734    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77d4c7977-c8mlq" podUID="f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" containerName="console" containerID="cri-o://10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb" gracePeriod=15
Jul 06 23:33:19.139472 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.139449    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:33:19.228966 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.228939    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-oauth-config\") pod \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") "
Jul 06 23:33:19.229132 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.228976    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-service-ca\") pod \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") "
Jul 06 23:33:19.229132 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229026    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-serving-cert\") pod \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") "
Jul 06 23:33:19.229203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229147    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-oauth-serving-cert\") pod \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") "
Jul 06 23:33:19.229203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-config\") pod \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") "
Jul 06 23:33:19.229290 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229216    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-trusted-ca-bundle\") pod \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") "
Jul 06 23:33:19.229290 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229268    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8phn\" (UniqueName: \"kubernetes.io/projected/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-kube-api-access-k8phn\") pod \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\" (UID: \"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3\") "
Jul 06 23:33:19.229570 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229514    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" (UID: "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:33:19.229706 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229566    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-config" (OuterVolumeSpecName: "console-config") pod "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" (UID: "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:33:19.229706 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229580    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:33:19.229706 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229588    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" (UID: "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:33:19.229706 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.229630    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" (UID: "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:33:19.231304 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.231278    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" (UID: "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:33:19.231394 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.231343    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" (UID: "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:33:19.231480 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.231458    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-kube-api-access-k8phn" (OuterVolumeSpecName: "kube-api-access-k8phn") pod "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" (UID: "f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3"). InnerVolumeSpecName "kube-api-access-k8phn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:33:19.330949 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.330912    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-serving-cert\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:33:19.330949 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.330941    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-oauth-serving-cert\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:33:19.330949 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.330952    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-config\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:33:19.330949 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.330960    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-trusted-ca-bundle\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:33:19.331239 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.330969    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8phn\" (UniqueName: \"kubernetes.io/projected/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-kube-api-access-k8phn\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:33:19.331239 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.330977    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3-console-oauth-config\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:33:19.447177 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.447146    2579 generic.go:356] "Generic (PLEG): container finished" podID="f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" containerID="10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb" exitCode=0
Jul 06 23:33:19.447330 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.447189    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d4c7977-c8mlq"
Jul 06 23:33:19.447330 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.447228    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d4c7977-c8mlq" event={"ID":"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3","Type":"ContainerDied","Data":"10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb"}
Jul 06 23:33:19.447330 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.447272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d4c7977-c8mlq" event={"ID":"f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3","Type":"ContainerDied","Data":"eb888575dea391e3ea832001e623b1dc370c8c230577a13ac77ec54341a31f0d"}
Jul 06 23:33:19.447330 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.447296    2579 scope.go:117] "RemoveContainer" containerID="10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb"
Jul 06 23:33:19.456139 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.456119    2579 scope.go:117] "RemoveContainer" containerID="10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb"
Jul 06 23:33:19.456432 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:33:19.456416    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb\": container with ID starting with 10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb not found: ID does not exist" containerID="10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb"
Jul 06 23:33:19.456485 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.456441    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb"} err="failed to get container status \"10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb\": rpc error: code = NotFound desc = could not find container \"10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb\": container with ID starting with 10d32b5dd26ee977a218d3fb52447e00d39dda8a7e700efdaff849054cccdafb not found: ID does not exist"
Jul 06 23:33:19.465549 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.465526    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d4c7977-c8mlq"]
Jul 06 23:33:19.470165 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:19.470137    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77d4c7977-c8mlq"]
Jul 06 23:33:21.380374 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:21.380339    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" path="/var/lib/kubelet/pods/f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3/volumes"
Jul 06 23:33:38.894822 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.894745    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:33:38.895234 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.895096    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" containerName="console"
Jul 06 23:33:38.895234 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.895109    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" containerName="console"
Jul 06 23:33:38.895234 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.895190    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ed5d09-c9a1-49f8-9bb4-b26be380a2d3" containerName="console"
Jul 06 23:33:38.898020 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.898001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:38.900273 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.900251    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 23:33:38.900392 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.900308    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zn66c\""
Jul 06 23:33:38.904762 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.904740    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:33:38.936400 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:38.936369    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:33:39.003239 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.003211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59fa0548-6ba3-4f8d-a281-2be435986c67-config-file\") pod \"limitador-limitador-54d6d988d5-tj7zj\" (UID: \"59fa0548-6ba3-4f8d-a281-2be435986c67\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:39.003381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.003341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v24l\" (UniqueName: \"kubernetes.io/projected/59fa0548-6ba3-4f8d-a281-2be435986c67-kube-api-access-6v24l\") pod \"limitador-limitador-54d6d988d5-tj7zj\" (UID: \"59fa0548-6ba3-4f8d-a281-2be435986c67\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:39.104029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.103994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59fa0548-6ba3-4f8d-a281-2be435986c67-config-file\") pod \"limitador-limitador-54d6d988d5-tj7zj\" (UID: \"59fa0548-6ba3-4f8d-a281-2be435986c67\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:39.104250 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.104076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v24l\" (UniqueName: \"kubernetes.io/projected/59fa0548-6ba3-4f8d-a281-2be435986c67-kube-api-access-6v24l\") pod \"limitador-limitador-54d6d988d5-tj7zj\" (UID: \"59fa0548-6ba3-4f8d-a281-2be435986c67\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:39.104609 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.104590    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59fa0548-6ba3-4f8d-a281-2be435986c67-config-file\") pod \"limitador-limitador-54d6d988d5-tj7zj\" (UID: \"59fa0548-6ba3-4f8d-a281-2be435986c67\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:39.111965 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.111935    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v24l\" (UniqueName: \"kubernetes.io/projected/59fa0548-6ba3-4f8d-a281-2be435986c67-kube-api-access-6v24l\") pod \"limitador-limitador-54d6d988d5-tj7zj\" (UID: \"59fa0548-6ba3-4f8d-a281-2be435986c67\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:39.209092 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.209046    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:39.342895 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.342837    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:33:39.347354 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:33:39.347322    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fa0548_6ba3_4f8d_a281_2be435986c67.slice/crio-cd603f04b38e8f0d921da31a2a1fb7a0e90cbdfa5a9ecde69dcf14e9e26b9665 WatchSource:0}: Error finding container cd603f04b38e8f0d921da31a2a1fb7a0e90cbdfa5a9ecde69dcf14e9e26b9665: Status 404 returned error can't find the container with id cd603f04b38e8f0d921da31a2a1fb7a0e90cbdfa5a9ecde69dcf14e9e26b9665
Jul 06 23:33:39.535162 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:39.535049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj" event={"ID":"59fa0548-6ba3-4f8d-a281-2be435986c67","Type":"ContainerStarted","Data":"cd603f04b38e8f0d921da31a2a1fb7a0e90cbdfa5a9ecde69dcf14e9e26b9665"}
Jul 06 23:33:42.556752 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:42.556715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj" event={"ID":"59fa0548-6ba3-4f8d-a281-2be435986c67","Type":"ContainerStarted","Data":"27cfec958511203e60e94561a3ae8fcca14a99e76b36fba1c161b43dc8fd1828"}
Jul 06 23:33:42.557154 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:42.556787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:33:42.573040 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:42.572993    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj" podStartSLOduration=2.200435937 podStartE2EDuration="4.572978761s" totalImagesPullingTime="2.372542824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:33:42.57222058 +0000 UTC m=+537.706212771" watchObservedRunningTime="2026-07-06 23:33:42.572978761 +0000 UTC m=+537.706970951"
Jul 06 23:33:53.562270 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:33:53.562236    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"
Jul 06 23:34:45.275909 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:34:45.275880    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:34:45.281737 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:34:45.281716    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:35:00.234711 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:00.234673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:35:21.674589 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:21.674504    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:35:29.364868 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:29.364828    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:35:48.967236 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:48.967206    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"]
Jul 06 23:35:48.970765 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:48.970741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:48.973244 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:48.973212    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 23:35:48.973350 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:48.973261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 23:35:48.973350 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:48.973307    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 23:35:48.973482 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:48.973465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g2mcc\""
Jul 06 23:35:48.977998 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:48.977973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"]
Jul 06 23:35:49.004552 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.004529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j6rw\" (UniqueName: \"kubernetes.io/projected/a630ec6a-741a-4378-8b1c-10b2a494ac71-kube-api-access-6j6rw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.004691 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.004567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.004691 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.004591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.004691 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.004683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.004820 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.004712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a630ec6a-741a-4378-8b1c-10b2a494ac71-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.004820 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.004737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.105586 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.105558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.105756 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.105595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j6rw\" (UniqueName: \"kubernetes.io/projected/a630ec6a-741a-4378-8b1c-10b2a494ac71-kube-api-access-6j6rw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.105756 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.105618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.105756 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.105637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.105756 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.105672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.105756 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.105691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a630ec6a-741a-4378-8b1c-10b2a494ac71-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.106031 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.105954    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.106115 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.106027    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.106155 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.106131    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.108009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.107987    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a630ec6a-741a-4378-8b1c-10b2a494ac71-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.108229 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.108212    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a630ec6a-741a-4378-8b1c-10b2a494ac71-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.112817 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.112791    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j6rw\" (UniqueName: \"kubernetes.io/projected/a630ec6a-741a-4378-8b1c-10b2a494ac71-kube-api-access-6j6rw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5jngf\" (UID: \"a630ec6a-741a-4378-8b1c-10b2a494ac71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.284023 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.283937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:49.416402 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.416307    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"]
Jul 06 23:35:49.418942 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:35:49.418915    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda630ec6a_741a_4378_8b1c_10b2a494ac71.slice/crio-c5fcff6791a796dc0912ba1c0869ac43013629ecdbcece9cdbf05fb4c1b31944 WatchSource:0}: Error finding container c5fcff6791a796dc0912ba1c0869ac43013629ecdbcece9cdbf05fb4c1b31944: Status 404 returned error can't find the container with id c5fcff6791a796dc0912ba1c0869ac43013629ecdbcece9cdbf05fb4c1b31944
Jul 06 23:35:49.420281 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:49.420253    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:35:50.102077 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:50.102017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf" event={"ID":"a630ec6a-741a-4378-8b1c-10b2a494ac71","Type":"ContainerStarted","Data":"c5fcff6791a796dc0912ba1c0869ac43013629ecdbcece9cdbf05fb4c1b31944"}
Jul 06 23:35:50.164432 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:50.164392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:35:51.108203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:51.108163    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf" event={"ID":"a630ec6a-741a-4378-8b1c-10b2a494ac71","Type":"ContainerStarted","Data":"3f05b58d81c910af17e5cb3947a9883e93000f62642736286a2f3154adeeee92"}
Jul 06 23:35:51.125101 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:51.125032    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf" podStartSLOduration=2.105742677 podStartE2EDuration="3.12501657s" totalImagesPullingTime="1.019273893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:35:51.124818508 +0000 UTC m=+666.258810711" watchObservedRunningTime="2026-07-06 23:35:51.12501657 +0000 UTC m=+666.259008761"
Jul 06 23:35:56.870692 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:56.870659    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:35:59.284337 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:59.284301    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:59.284807 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:59.284371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:35:59.296886 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:35:59.296864    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:36:00.158081 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:36:00.158027    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5jngf"
Jul 06 23:36:07.971328 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:36:07.971291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:36:16.673517 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:36:16.673479    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:37:23.766623 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:37:23.766587    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:37:35.567791 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:37:35.567758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:37:42.975120 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:37:42.975083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:37:53.463558 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:37:53.463521    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:38:05.462883 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:38:05.462801    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:38:14.067996 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:38:14.067956    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:38:36.575310 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:38:36.575272    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:38:48.468855 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:38:48.468820    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:39:22.575289 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:39:22.575251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:39:31.261484 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:39:31.261450    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:39:41.162696 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:39:41.162619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:39:45.301552 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:39:45.301525    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:39:45.304397 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:39:45.304368    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:39:48.858935 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:39:48.858896    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:39:59.076677 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:39:59.076640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:40:09.268658 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:40:09.268627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:40:21.069048 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:40:21.069008    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:40:30.070310 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:40:30.070279    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:40:53.572967 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:40:53.572937    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:41:05.667522 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:41:05.667447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:41:28.767949 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:41:28.767911    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:41:39.257646 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:41:39.257608    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:41:54.470684 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:41:54.470646    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:42:05.364601 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:42:05.364564    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:42:14.474277 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:42:14.474236    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:42:23.358524 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:42:23.358489    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:42:33.372132 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:42:33.372084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:44:23.703005 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:44:23.702971    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:44:35.172362 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:44:35.172317    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:44:44.074738 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:44:44.074702    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:44:45.327690 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:44:45.327657    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:44:45.328526 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:44:45.328506    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:44:56.374940 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:44:56.374906    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:45:00.131820 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.131781    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723025-r69s7"]
Jul 06 23:45:00.135284 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.135265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7"
Jul 06 23:45:00.138067 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.138034    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:45:00.142444 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.142395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723025-r69s7"]
Jul 06 23:45:00.170901 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.170864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-448zr\" (UniqueName: \"kubernetes.io/projected/c81108fd-d62d-4819-ac6c-6a3a2fe9441a-kube-api-access-448zr\") pod \"maas-api-key-cleanup-29723025-r69s7\" (UID: \"c81108fd-d62d-4819-ac6c-6a3a2fe9441a\") " pod="opendatahub/maas-api-key-cleanup-29723025-r69s7"
Jul 06 23:45:00.271428 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.271386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-448zr\" (UniqueName: \"kubernetes.io/projected/c81108fd-d62d-4819-ac6c-6a3a2fe9441a-kube-api-access-448zr\") pod \"maas-api-key-cleanup-29723025-r69s7\" (UID: \"c81108fd-d62d-4819-ac6c-6a3a2fe9441a\") " pod="opendatahub/maas-api-key-cleanup-29723025-r69s7"
Jul 06 23:45:00.279546 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.279504    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-448zr\" (UniqueName: \"kubernetes.io/projected/c81108fd-d62d-4819-ac6c-6a3a2fe9441a-kube-api-access-448zr\") pod \"maas-api-key-cleanup-29723025-r69s7\" (UID: \"c81108fd-d62d-4819-ac6c-6a3a2fe9441a\") " pod="opendatahub/maas-api-key-cleanup-29723025-r69s7"
Jul 06 23:45:00.446902 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.446874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7"
Jul 06 23:45:00.580517 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.580491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723025-r69s7"]
Jul 06 23:45:00.582607 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:45:00.582582    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81108fd_d62d_4819_ac6c_6a3a2fe9441a.slice/crio-26a379921cc281c12bde7dc2c616eec53543ed454032b4c7707357eb680d49d9 WatchSource:0}: Error finding container 26a379921cc281c12bde7dc2c616eec53543ed454032b4c7707357eb680d49d9: Status 404 returned error can't find the container with id 26a379921cc281c12bde7dc2c616eec53543ed454032b4c7707357eb680d49d9
Jul 06 23:45:00.584433 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:00.584417    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:45:01.490337 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:01.490297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7" event={"ID":"c81108fd-d62d-4819-ac6c-6a3a2fe9441a","Type":"ContainerStarted","Data":"26a379921cc281c12bde7dc2c616eec53543ed454032b4c7707357eb680d49d9"}
Jul 06 23:45:03.502812 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:03.502773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7" event={"ID":"c81108fd-d62d-4819-ac6c-6a3a2fe9441a","Type":"ContainerStarted","Data":"6d3307c1e3ac64211141e59e08211eaa49cfc55fef97c20b3a80f59a7f19a189"}
Jul 06 23:45:03.518304 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:03.518254    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7" podStartSLOduration=1.2669463570000001 podStartE2EDuration="3.518238034s" totalImagesPullingTime="2.251291677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:45:03.51722126 +0000 UTC m=+1218.651213452" watchObservedRunningTime="2026-07-06 23:45:03.518238034 +0000 UTC m=+1218.652230225"
Jul 06 23:45:04.509324 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:04.509291    2579 generic.go:356] "Generic (PLEG): container finished" podID="c81108fd-d62d-4819-ac6c-6a3a2fe9441a" containerID="6d3307c1e3ac64211141e59e08211eaa49cfc55fef97c20b3a80f59a7f19a189" exitCode=0
Jul 06 23:45:04.509768 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:04.509351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7" event={"ID":"c81108fd-d62d-4819-ac6c-6a3a2fe9441a","Type":"ContainerDied","Data":"6d3307c1e3ac64211141e59e08211eaa49cfc55fef97c20b3a80f59a7f19a189"}
Jul 06 23:45:05.650864 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:05.650836    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7"
Jul 06 23:45:05.713466 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:05.713429    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-448zr\" (UniqueName: \"kubernetes.io/projected/c81108fd-d62d-4819-ac6c-6a3a2fe9441a-kube-api-access-448zr\") pod \"c81108fd-d62d-4819-ac6c-6a3a2fe9441a\" (UID: \"c81108fd-d62d-4819-ac6c-6a3a2fe9441a\") "
Jul 06 23:45:05.715740 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:05.715709    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c81108fd-d62d-4819-ac6c-6a3a2fe9441a-kube-api-access-448zr" (OuterVolumeSpecName: "kube-api-access-448zr") pod "c81108fd-d62d-4819-ac6c-6a3a2fe9441a" (UID: "c81108fd-d62d-4819-ac6c-6a3a2fe9441a"). InnerVolumeSpecName "kube-api-access-448zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:45:05.814455 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:05.814370    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-448zr\" (UniqueName: \"kubernetes.io/projected/c81108fd-d62d-4819-ac6c-6a3a2fe9441a-kube-api-access-448zr\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:45:06.519176 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:06.519145    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7"
Jul 06 23:45:06.519176 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:06.519162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723025-r69s7" event={"ID":"c81108fd-d62d-4819-ac6c-6a3a2fe9441a","Type":"ContainerDied","Data":"26a379921cc281c12bde7dc2c616eec53543ed454032b4c7707357eb680d49d9"}
Jul 06 23:45:06.519382 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:06.519208    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26a379921cc281c12bde7dc2c616eec53543ed454032b4c7707357eb680d49d9"
Jul 06 23:45:07.964191 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:07.964155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:45:17.163906 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:17.163816    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:45:27.364229 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:27.364191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:45:37.967385 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:37.966709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:45:49.367287 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:49.367249    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:45:58.759808 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:45:58.759772    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:46:09.028546 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:46:09.028511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:46:33.867312 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:46:33.867276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:46:41.268999 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:46:41.268962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:46:50.270637 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:46:50.270604    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:47:00.465958 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:47:00.465921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:47:17.963765 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:47:17.963730    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:47:26.462131 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:47:26.462093    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:47:35.766265 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:47:35.766226    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:47:45.570597 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:47:45.570566    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:47:54.077770 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:47:54.077276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:48:03.366492 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:48:03.366455    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:48:17.373656 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:48:17.373624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:48:26.476243 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:48:26.476208    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:48:36.583032 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:48:36.582959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:48:46.178270 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:48:46.178233    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:48:59.162493 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:48:59.162457    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:49:08.970627 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:49:08.970591    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:49:21.263121 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:49:21.263076    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:49:32.076411 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:49:32.076373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:49:40.470479 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:49:40.470435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:49:45.353505 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:49:45.353476    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:49:45.354470 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:49:45.354449    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:49:47.964339 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:49:47.964300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:50:00.070241 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:00.070205    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:50:08.779478 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:08.779383    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:50:20.776590 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:20.776549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:50:35.166633 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.166594    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"]
Jul 06 23:50:35.167047 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.166964    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c81108fd-d62d-4819-ac6c-6a3a2fe9441a" containerName="cleanup"
Jul 06 23:50:35.167047 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.166977    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c81108fd-d62d-4819-ac6c-6a3a2fe9441a" containerName="cleanup"
Jul 06 23:50:35.167171 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.167115    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c81108fd-d62d-4819-ac6c-6a3a2fe9441a" containerName="cleanup"
Jul 06 23:50:35.170446 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.170426    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.172900 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.172876    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-migrate-5e8d5579-serving-cert\""
Jul 06 23:50:35.173012 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.172938    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:50:35.181426 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.181406    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"]
Jul 06 23:50:35.263817 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.263785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b96cb-b47c-4d2d-b1cb-916d69ed7815-openshift-service-ca\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.263996 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.263841    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm667\" (UniqueName: \"kubernetes.io/projected/951b96cb-b47c-4d2d-b1cb-916d69ed7815-kube-api-access-pm667\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.263996 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.263921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b96cb-b47c-4d2d-b1cb-916d69ed7815-maas-api-tls\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.365402 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.365373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b96cb-b47c-4d2d-b1cb-916d69ed7815-maas-api-tls\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.365594 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.365419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b96cb-b47c-4d2d-b1cb-916d69ed7815-openshift-service-ca\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.365594 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.365450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm667\" (UniqueName: \"kubernetes.io/projected/951b96cb-b47c-4d2d-b1cb-916d69ed7815-kube-api-access-pm667\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.366125 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.366099    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b96cb-b47c-4d2d-b1cb-916d69ed7815-openshift-service-ca\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.368126 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.368105    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b96cb-b47c-4d2d-b1cb-916d69ed7815-maas-api-tls\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.373545 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.373514    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm667\" (UniqueName: \"kubernetes.io/projected/951b96cb-b47c-4d2d-b1cb-916d69ed7815-kube-api-access-pm667\") pod \"maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") " pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.481187 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.481153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:35.620643 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.620618    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"]
Jul 06 23:50:35.623191 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:50:35.623163    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951b96cb_b47c_4d2d_b1cb_916d69ed7815.slice/crio-d3901b7cf5683ee4db3ce01fcc8a06b909df2c1c7c8e42c12eaa58e7c4c45fd7 WatchSource:0}: Error finding container d3901b7cf5683ee4db3ce01fcc8a06b909df2c1c7c8e42c12eaa58e7c4c45fd7: Status 404 returned error can't find the container with id d3901b7cf5683ee4db3ce01fcc8a06b909df2c1c7c8e42c12eaa58e7c4c45fd7
Jul 06 23:50:35.624400 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.624383    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:50:35.960338 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:35.960306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc" event={"ID":"951b96cb-b47c-4d2d-b1cb-916d69ed7815","Type":"ContainerStarted","Data":"d3901b7cf5683ee4db3ce01fcc8a06b909df2c1c7c8e42c12eaa58e7c4c45fd7"}
Jul 06 23:50:37.866883 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:37.866847    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:50:37.970169 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:37.970038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc" event={"ID":"951b96cb-b47c-4d2d-b1cb-916d69ed7815","Type":"ContainerStarted","Data":"b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7"}
Jul 06 23:50:37.970169 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:37.970140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:37.987300 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:37.987255    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc" podStartSLOduration=1.615774496 podStartE2EDuration="2.987240014s" totalImagesPullingTime="1.371465518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:37.985936666 +0000 UTC m=+1553.119928858" watchObservedRunningTime="2026-07-06 23:50:37.987240014 +0000 UTC m=+1553.121232204"
Jul 06 23:50:40.087743 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.087712    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"]
Jul 06 23:50:40.088329 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.087913    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc" podUID="951b96cb-b47c-4d2d-b1cb-916d69ed7815" containerName="maas-api" containerID="cri-o://b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7" gracePeriod=30
Jul 06 23:50:40.340265 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.340201    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:40.508003 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.507963    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm667\" (UniqueName: \"kubernetes.io/projected/951b96cb-b47c-4d2d-b1cb-916d69ed7815-kube-api-access-pm667\") pod \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") "
Jul 06 23:50:40.508223 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.508088    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b96cb-b47c-4d2d-b1cb-916d69ed7815-openshift-service-ca\") pod \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") "
Jul 06 23:50:40.508223 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.508128    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b96cb-b47c-4d2d-b1cb-916d69ed7815-maas-api-tls\") pod \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\" (UID: \"951b96cb-b47c-4d2d-b1cb-916d69ed7815\") "
Jul 06 23:50:40.508467 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.508438    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951b96cb-b47c-4d2d-b1cb-916d69ed7815-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "951b96cb-b47c-4d2d-b1cb-916d69ed7815" (UID: "951b96cb-b47c-4d2d-b1cb-916d69ed7815"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:50:40.510187 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.510165    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951b96cb-b47c-4d2d-b1cb-916d69ed7815-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "951b96cb-b47c-4d2d-b1cb-916d69ed7815" (UID: "951b96cb-b47c-4d2d-b1cb-916d69ed7815"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:50:40.510309 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.510254    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951b96cb-b47c-4d2d-b1cb-916d69ed7815-kube-api-access-pm667" (OuterVolumeSpecName: "kube-api-access-pm667") pod "951b96cb-b47c-4d2d-b1cb-916d69ed7815" (UID: "951b96cb-b47c-4d2d-b1cb-916d69ed7815"). InnerVolumeSpecName "kube-api-access-pm667". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:50:40.609097 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.608984    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm667\" (UniqueName: \"kubernetes.io/projected/951b96cb-b47c-4d2d-b1cb-916d69ed7815-kube-api-access-pm667\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:50:40.609097 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.609011    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b96cb-b47c-4d2d-b1cb-916d69ed7815-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:50:40.609097 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.609024    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b96cb-b47c-4d2d-b1cb-916d69ed7815-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:50:40.984880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.984845    2579 generic.go:356] "Generic (PLEG): container finished" podID="951b96cb-b47c-4d2d-b1cb-916d69ed7815" containerID="b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7" exitCode=0
Jul 06 23:50:40.984880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.984885    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"
Jul 06 23:50:40.985153 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.984933    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc" event={"ID":"951b96cb-b47c-4d2d-b1cb-916d69ed7815","Type":"ContainerDied","Data":"b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7"}
Jul 06 23:50:40.985153 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.984978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc" event={"ID":"951b96cb-b47c-4d2d-b1cb-916d69ed7815","Type":"ContainerDied","Data":"d3901b7cf5683ee4db3ce01fcc8a06b909df2c1c7c8e42c12eaa58e7c4c45fd7"}
Jul 06 23:50:40.985153 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.984999    2579 scope.go:117] "RemoveContainer" containerID="b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7"
Jul 06 23:50:40.993564 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.993549    2579 scope.go:117] "RemoveContainer" containerID="b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7"
Jul 06 23:50:40.993786 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:50:40.993770    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7\": container with ID starting with b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7 not found: ID does not exist" containerID="b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7"
Jul 06 23:50:40.993823 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:40.993798    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7"} err="failed to get container status \"b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7\": rpc error: code = NotFound desc = could not find container \"b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7\": container with ID starting with b2e76d10fc6e72166a93225409aa9ad097c52f4dbe185508b52f6c5b0a7a8af7 not found: ID does not exist"
Jul 06 23:50:41.005509 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:41.005484    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"]
Jul 06 23:50:41.007785 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:41.007765    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-migrate-5e8d5579-bb69fcb7f-tbljc"]
Jul 06 23:50:41.380163 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:41.380086    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951b96cb-b47c-4d2d-b1cb-916d69ed7815" path="/var/lib/kubelet/pods/951b96cb-b47c-4d2d-b1cb-916d69ed7815/volumes"
Jul 06 23:50:47.300115 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.300082    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"]
Jul 06 23:50:47.300501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.300450    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951b96cb-b47c-4d2d-b1cb-916d69ed7815" containerName="maas-api"
Jul 06 23:50:47.300501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.300466    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="951b96cb-b47c-4d2d-b1cb-916d69ed7815" containerName="maas-api"
Jul 06 23:50:47.300610 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.300537    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="951b96cb-b47c-4d2d-b1cb-916d69ed7815" containerName="maas-api"
Jul 06 23:50:47.304762 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.304738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.307867 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.307848    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:50:47.307988 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.307893    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-b1b9f5c3-serving-cert\""
Jul 06 23:50:47.317250 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.317227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"]
Jul 06 23:50:47.473939 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.473904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d00b445b-25d1-48de-b43e-633e4e54cdc8-openshift-service-ca\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.474136 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.473945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d00b445b-25d1-48de-b43e-633e4e54cdc8-maas-api-tls\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.474136 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.473982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7qfl\" (UniqueName: \"kubernetes.io/projected/d00b445b-25d1-48de-b43e-633e4e54cdc8-kube-api-access-k7qfl\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.574459 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.574380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d00b445b-25d1-48de-b43e-633e4e54cdc8-openshift-service-ca\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.574459 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.574416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d00b445b-25d1-48de-b43e-633e4e54cdc8-maas-api-tls\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.574459 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.574444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7qfl\" (UniqueName: \"kubernetes.io/projected/d00b445b-25d1-48de-b43e-633e4e54cdc8-kube-api-access-k7qfl\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.575168 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.575141    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d00b445b-25d1-48de-b43e-633e4e54cdc8-openshift-service-ca\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.576934 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.576912    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d00b445b-25d1-48de-b43e-633e4e54cdc8-maas-api-tls\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.586741 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.586718    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7qfl\" (UniqueName: \"kubernetes.io/projected/d00b445b-25d1-48de-b43e-633e4e54cdc8-kube-api-access-k7qfl\") pod \"maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") " pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.617443 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.617409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:47.753093 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:47.753043    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"]
Jul 06 23:50:47.755474 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:50:47.755447    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00b445b_25d1_48de_b43e_633e4e54cdc8.slice/crio-153c7ce0bce1225606a1962aaa87971d34928d0e3b13f493f4fa713bb5524956 WatchSource:0}: Error finding container 153c7ce0bce1225606a1962aaa87971d34928d0e3b13f493f4fa713bb5524956: Status 404 returned error can't find the container with id 153c7ce0bce1225606a1962aaa87971d34928d0e3b13f493f4fa713bb5524956
Jul 06 23:50:48.021297 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:48.021264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh" event={"ID":"d00b445b-25d1-48de-b43e-633e4e54cdc8","Type":"ContainerStarted","Data":"153c7ce0bce1225606a1962aaa87971d34928d0e3b13f493f4fa713bb5524956"}
Jul 06 23:50:49.027041 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:49.027009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh" event={"ID":"d00b445b-25d1-48de-b43e-633e4e54cdc8","Type":"ContainerStarted","Data":"63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c"}
Jul 06 23:50:49.027454 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:49.027134    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:49.046028 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:49.045976    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh" podStartSLOduration=1.579995313 podStartE2EDuration="2.0459609s" totalImagesPullingTime="465.965587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:49.04474093 +0000 UTC m=+1564.178733134" watchObservedRunningTime="2026-07-06 23:50:49.0459609 +0000 UTC m=+1564.179953091"
Jul 06 23:50:50.062007 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:50.061973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:50:53.101638 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.101602    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"]
Jul 06 23:50:53.102034 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.101825    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh" podUID="d00b445b-25d1-48de-b43e-633e4e54cdc8" containerName="maas-api" containerID="cri-o://63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c" gracePeriod=30
Jul 06 23:50:53.108960 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.108937    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:53.339900 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.339878    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:53.421219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.421147    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7qfl\" (UniqueName: \"kubernetes.io/projected/d00b445b-25d1-48de-b43e-633e4e54cdc8-kube-api-access-k7qfl\") pod \"d00b445b-25d1-48de-b43e-633e4e54cdc8\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") "
Jul 06 23:50:53.421219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.421199    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d00b445b-25d1-48de-b43e-633e4e54cdc8-maas-api-tls\") pod \"d00b445b-25d1-48de-b43e-633e4e54cdc8\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") "
Jul 06 23:50:53.421219 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.421221    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d00b445b-25d1-48de-b43e-633e4e54cdc8-openshift-service-ca\") pod \"d00b445b-25d1-48de-b43e-633e4e54cdc8\" (UID: \"d00b445b-25d1-48de-b43e-633e4e54cdc8\") "
Jul 06 23:50:53.421626 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.421599    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d00b445b-25d1-48de-b43e-633e4e54cdc8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d00b445b-25d1-48de-b43e-633e4e54cdc8" (UID: "d00b445b-25d1-48de-b43e-633e4e54cdc8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:50:53.423422 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.423397    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d00b445b-25d1-48de-b43e-633e4e54cdc8-kube-api-access-k7qfl" (OuterVolumeSpecName: "kube-api-access-k7qfl") pod "d00b445b-25d1-48de-b43e-633e4e54cdc8" (UID: "d00b445b-25d1-48de-b43e-633e4e54cdc8"). InnerVolumeSpecName "kube-api-access-k7qfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:50:53.423500 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.423422    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d00b445b-25d1-48de-b43e-633e4e54cdc8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d00b445b-25d1-48de-b43e-633e4e54cdc8" (UID: "d00b445b-25d1-48de-b43e-633e4e54cdc8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:50:53.522468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.522431    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7qfl\" (UniqueName: \"kubernetes.io/projected/d00b445b-25d1-48de-b43e-633e4e54cdc8-kube-api-access-k7qfl\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:50:53.522468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.522463    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d00b445b-25d1-48de-b43e-633e4e54cdc8-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:50:53.522468 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:53.522473    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d00b445b-25d1-48de-b43e-633e4e54cdc8-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:50:54.050121 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.050087    2579 generic.go:356] "Generic (PLEG): container finished" podID="d00b445b-25d1-48de-b43e-633e4e54cdc8" containerID="63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c" exitCode=0
Jul 06 23:50:54.050290 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.050182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh" event={"ID":"d00b445b-25d1-48de-b43e-633e4e54cdc8","Type":"ContainerDied","Data":"63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c"}
Jul 06 23:50:54.050290 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.050207    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"
Jul 06 23:50:54.050290 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.050236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh" event={"ID":"d00b445b-25d1-48de-b43e-633e4e54cdc8","Type":"ContainerDied","Data":"153c7ce0bce1225606a1962aaa87971d34928d0e3b13f493f4fa713bb5524956"}
Jul 06 23:50:54.050290 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.050266    2579 scope.go:117] "RemoveContainer" containerID="63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c"
Jul 06 23:50:54.060851 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.060810    2579 scope.go:117] "RemoveContainer" containerID="63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c"
Jul 06 23:50:54.061525 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:50:54.061502    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c\": container with ID starting with 63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c not found: ID does not exist" containerID="63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c"
Jul 06 23:50:54.061626 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.061533    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c"} err="failed to get container status \"63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c\": rpc error: code = NotFound desc = could not find container \"63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c\": container with ID starting with 63b4d3a90f46a36edd37ea4553b0d23d8e9d41dfe5acd81f394f9132cf0cbc0c not found: ID does not exist"
Jul 06 23:50:54.071714 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.071691    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"]
Jul 06 23:50:54.075992 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:54.075967    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-b1b9f5c3-577b766f47-f46fh"]
Jul 06 23:50:55.380138 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:50:55.380105    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d00b445b-25d1-48de-b43e-633e4e54cdc8" path="/var/lib/kubelet/pods/d00b445b-25d1-48de-b43e-633e4e54cdc8/volumes"
Jul 06 23:51:01.361282 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:01.361246    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:51:06.222183 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.222150    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"]
Jul 06 23:51:06.222654 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.222478    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d00b445b-25d1-48de-b43e-633e4e54cdc8" containerName="maas-api"
Jul 06 23:51:06.222654 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.222491    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d00b445b-25d1-48de-b43e-633e4e54cdc8" containerName="maas-api"
Jul 06 23:51:06.222654 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.222556    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d00b445b-25d1-48de-b43e-633e4e54cdc8" containerName="maas-api"
Jul 06 23:51:06.227155 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.227131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.230083 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.230042    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:51:06.230198 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.230042    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-325feefe-serving-cert\""
Jul 06 23:51:06.238382 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.238360    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"]
Jul 06 23:51:06.328073 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.328019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qlk2\" (UniqueName: \"kubernetes.io/projected/7375e72d-717e-4dd1-a444-6e5cac7098d6-kube-api-access-9qlk2\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.328225 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.328086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.328225 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.328110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7375e72d-717e-4dd1-a444-6e5cac7098d6-openshift-service-ca\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.429115 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.429049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qlk2\" (UniqueName: \"kubernetes.io/projected/7375e72d-717e-4dd1-a444-6e5cac7098d6-kube-api-access-9qlk2\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.429300 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.429130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.429300 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.429163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7375e72d-717e-4dd1-a444-6e5cac7098d6-openshift-service-ca\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.429300 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:51:06.429264    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-325feefe-serving-cert: secret "maas-api-e2e-derive-325feefe-serving-cert" not found
Jul 06 23:51:06.429470 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:51:06.429323    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls podName:7375e72d-717e-4dd1-a444-6e5cac7098d6 nodeName:}" failed. No retries permitted until 2026-07-06 23:51:06.929308094 +0000 UTC m=+1582.063300262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls") pod "maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb" (UID: "7375e72d-717e-4dd1-a444-6e5cac7098d6") : secret "maas-api-e2e-derive-325feefe-serving-cert" not found
Jul 06 23:51:06.429861 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.429837    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7375e72d-717e-4dd1-a444-6e5cac7098d6-openshift-service-ca\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.437708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.437678    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qlk2\" (UniqueName: \"kubernetes.io/projected/7375e72d-717e-4dd1-a444-6e5cac7098d6-kube-api-access-9qlk2\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.940382 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.940343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:06.942852 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:06.942821    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls\") pod \"maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") " pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:07.138222 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:07.138189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:07.272275 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:07.272246    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"]
Jul 06 23:51:07.273805 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:51:07.273782    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7375e72d_717e_4dd1_a444_6e5cac7098d6.slice/crio-ba0fa5729ce6709b67cb5944efcf7abccbfe78404d65576238dc07af54b242d5 WatchSource:0}: Error finding container ba0fa5729ce6709b67cb5944efcf7abccbfe78404d65576238dc07af54b242d5: Status 404 returned error can't find the container with id ba0fa5729ce6709b67cb5944efcf7abccbfe78404d65576238dc07af54b242d5
Jul 06 23:51:08.112314 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:08.112279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb" event={"ID":"7375e72d-717e-4dd1-a444-6e5cac7098d6","Type":"ContainerStarted","Data":"9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24"}
Jul 06 23:51:08.112501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:08.112335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb" event={"ID":"7375e72d-717e-4dd1-a444-6e5cac7098d6","Type":"ContainerStarted","Data":"ba0fa5729ce6709b67cb5944efcf7abccbfe78404d65576238dc07af54b242d5"}
Jul 06 23:51:08.112501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:08.112447    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:08.130804 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:08.130760    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb" podStartSLOduration=1.805210311 podStartE2EDuration="2.130745675s" totalImagesPullingTime="325.535364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:08.130149939 +0000 UTC m=+1583.264142131" watchObservedRunningTime="2026-07-06 23:51:08.130745675 +0000 UTC m=+1583.264737891"
Jul 06 23:51:09.383633 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:09.383602    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:51:11.066025 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.065986    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"]
Jul 06 23:51:11.066513 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.066203    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb" podUID="7375e72d-717e-4dd1-a444-6e5cac7098d6" containerName="maas-api" containerID="cri-o://9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24" gracePeriod=30
Jul 06 23:51:11.299215 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.299192    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:11.374189 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.374106    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qlk2\" (UniqueName: \"kubernetes.io/projected/7375e72d-717e-4dd1-a444-6e5cac7098d6-kube-api-access-9qlk2\") pod \"7375e72d-717e-4dd1-a444-6e5cac7098d6\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") "
Jul 06 23:51:11.374189 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.374170    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls\") pod \"7375e72d-717e-4dd1-a444-6e5cac7098d6\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") "
Jul 06 23:51:11.374189 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.374186    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7375e72d-717e-4dd1-a444-6e5cac7098d6-openshift-service-ca\") pod \"7375e72d-717e-4dd1-a444-6e5cac7098d6\" (UID: \"7375e72d-717e-4dd1-a444-6e5cac7098d6\") "
Jul 06 23:51:11.374580 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.374541    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7375e72d-717e-4dd1-a444-6e5cac7098d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7375e72d-717e-4dd1-a444-6e5cac7098d6" (UID: "7375e72d-717e-4dd1-a444-6e5cac7098d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:51:11.376431 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.376408    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7375e72d-717e-4dd1-a444-6e5cac7098d6-kube-api-access-9qlk2" (OuterVolumeSpecName: "kube-api-access-9qlk2") pod "7375e72d-717e-4dd1-a444-6e5cac7098d6" (UID: "7375e72d-717e-4dd1-a444-6e5cac7098d6"). InnerVolumeSpecName "kube-api-access-9qlk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:11.376553 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.376509    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7375e72d-717e-4dd1-a444-6e5cac7098d6" (UID: "7375e72d-717e-4dd1-a444-6e5cac7098d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:11.474928 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.474886    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7375e72d-717e-4dd1-a444-6e5cac7098d6-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:51:11.474928 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.474920    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7375e72d-717e-4dd1-a444-6e5cac7098d6-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:51:11.474928 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:11.474930    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qlk2\" (UniqueName: \"kubernetes.io/projected/7375e72d-717e-4dd1-a444-6e5cac7098d6-kube-api-access-9qlk2\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:51:12.136501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.136459    2579 generic.go:356] "Generic (PLEG): container finished" podID="7375e72d-717e-4dd1-a444-6e5cac7098d6" containerID="9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24" exitCode=0
Jul 06 23:51:12.136984 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.136519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb" event={"ID":"7375e72d-717e-4dd1-a444-6e5cac7098d6","Type":"ContainerDied","Data":"9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24"}
Jul 06 23:51:12.136984 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.136524    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"
Jul 06 23:51:12.136984 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.136597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb" event={"ID":"7375e72d-717e-4dd1-a444-6e5cac7098d6","Type":"ContainerDied","Data":"ba0fa5729ce6709b67cb5944efcf7abccbfe78404d65576238dc07af54b242d5"}
Jul 06 23:51:12.136984 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.136626    2579 scope.go:117] "RemoveContainer" containerID="9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24"
Jul 06 23:51:12.151940 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.151921    2579 scope.go:117] "RemoveContainer" containerID="9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24"
Jul 06 23:51:12.152449 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:51:12.152425    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24\": container with ID starting with 9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24 not found: ID does not exist" containerID="9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24"
Jul 06 23:51:12.152559 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.152456    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24"} err="failed to get container status \"9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24\": rpc error: code = NotFound desc = could not find container \"9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24\": container with ID starting with 9a335f259eebf1f0bfa4cad42464d223f3d752729b633e12f8f3c63ce959ea24 not found: ID does not exist"
Jul 06 23:51:12.152810 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.152793    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"]
Jul 06 23:51:12.156674 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:12.156654    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-325feefe-864fcd5c74-f8nmb"]
Jul 06 23:51:13.379771 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:13.379735    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7375e72d-717e-4dd1-a444-6e5cac7098d6" path="/var/lib/kubelet/pods/7375e72d-717e-4dd1-a444-6e5cac7098d6/volumes"
Jul 06 23:51:21.285102 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:51:21.285066    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:52:38.770829 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:38.770788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:52:45.969321 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:45.969281    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:52:55.164977 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.164940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:52:55.577892 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.577853    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"]
Jul 06 23:52:55.578510 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.578486    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7375e72d-717e-4dd1-a444-6e5cac7098d6" containerName="maas-api"
Jul 06 23:52:55.578606 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.578515    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7375e72d-717e-4dd1-a444-6e5cac7098d6" containerName="maas-api"
Jul 06 23:52:55.578655 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.578605    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7375e72d-717e-4dd1-a444-6e5cac7098d6" containerName="maas-api"
Jul 06 23:52:55.582070 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.582035    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:55.584495 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.584474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:52:55.584495 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.584484    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-793bb430-serving-cert\""
Jul 06 23:52:55.590351 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.590322    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"]
Jul 06 23:52:55.642050 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.642012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:55.642263 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.642091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-openshift-service-ca\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:55.642263 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.642146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsv9v\" (UniqueName: \"kubernetes.io/projected/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-kube-api-access-rsv9v\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:55.742997 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.742959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:55.742997 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.743000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-openshift-service-ca\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:55.743254 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.743034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsv9v\" (UniqueName: \"kubernetes.io/projected/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-kube-api-access-rsv9v\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:55.743254 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:52:55.743145    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-793bb430-serving-cert: secret "maas-api-e2e-mt-793bb430-serving-cert" not found
Jul 06 23:52:55.743254 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:52:55.743223    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls podName:b1f2ac95-b73f-413d-85fb-5b60d3bb09cd nodeName:}" failed. No retries permitted until 2026-07-06 23:52:56.243203051 +0000 UTC m=+1691.377195220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls") pod "maas-api-e2e-mt-793bb430-746bb78887-x7z67" (UID: "b1f2ac95-b73f-413d-85fb-5b60d3bb09cd") : secret "maas-api-e2e-mt-793bb430-serving-cert" not found
Jul 06 23:52:55.743709 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.743691    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-openshift-service-ca\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:55.753427 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:55.753396    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsv9v\" (UniqueName: \"kubernetes.io/projected/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-kube-api-access-rsv9v\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:56.248404 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:56.248367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:56.250864 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:56.250830    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls\") pod \"maas-api-e2e-mt-793bb430-746bb78887-x7z67\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") " pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:56.493311 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:56.493266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:56.633678 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:56.633648    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"]
Jul 06 23:52:56.636035 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:52:56.636008    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f2ac95_b73f_413d_85fb_5b60d3bb09cd.slice/crio-a7a3da3a241465da9d14d5656b6f6a7a2a29e5bc5585c2fbc0df826b6e2ae3a4 WatchSource:0}: Error finding container a7a3da3a241465da9d14d5656b6f6a7a2a29e5bc5585c2fbc0df826b6e2ae3a4: Status 404 returned error can't find the container with id a7a3da3a241465da9d14d5656b6f6a7a2a29e5bc5585c2fbc0df826b6e2ae3a4
Jul 06 23:52:57.594585 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:57.594550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67" event={"ID":"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd","Type":"ContainerStarted","Data":"fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e"}
Jul 06 23:52:57.594947 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:57.594601    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67" event={"ID":"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd","Type":"ContainerStarted","Data":"a7a3da3a241465da9d14d5656b6f6a7a2a29e5bc5585c2fbc0df826b6e2ae3a4"}
Jul 06 23:52:57.594947 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:57.594708    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:52:57.609640 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:52:57.609583    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67" podStartSLOduration=2.0926269 podStartE2EDuration="2.609566447s" totalImagesPullingTime="516.939547ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:52:57.608924573 +0000 UTC m=+1692.742916764" watchObservedRunningTime="2026-07-06 23:52:57.609566447 +0000 UTC m=+1692.743558638"
Jul 06 23:53:03.605252 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:03.605220    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:53:05.875546 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:05.875463    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:53:07.582494 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.582461    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"]
Jul 06 23:53:07.582960 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.582708    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67" podUID="b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" containerName="maas-api" containerID="cri-o://fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e" gracePeriod=30
Jul 06 23:53:07.840964 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.840907    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:53:07.947456 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.947427    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsv9v\" (UniqueName: \"kubernetes.io/projected/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-kube-api-access-rsv9v\") pod \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") "
Jul 06 23:53:07.947645 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.947477    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-openshift-service-ca\") pod \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") "
Jul 06 23:53:07.947645 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.947538    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls\") pod \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\" (UID: \"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd\") "
Jul 06 23:53:07.947893 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.947868    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" (UID: "b1f2ac95-b73f-413d-85fb-5b60d3bb09cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:53:07.949554 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.949531    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-kube-api-access-rsv9v" (OuterVolumeSpecName: "kube-api-access-rsv9v") pod "b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" (UID: "b1f2ac95-b73f-413d-85fb-5b60d3bb09cd"). InnerVolumeSpecName "kube-api-access-rsv9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:53:07.949626 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:07.949604    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" (UID: "b1f2ac95-b73f-413d-85fb-5b60d3bb09cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:53:08.048808 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.048780    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsv9v\" (UniqueName: \"kubernetes.io/projected/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-kube-api-access-rsv9v\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:53:08.048808 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.048806    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:53:08.048959 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.048816    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:53:08.645293 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.645260    2579 generic.go:356] "Generic (PLEG): container finished" podID="b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" containerID="fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e" exitCode=0
Jul 06 23:53:08.645733 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.645306    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"
Jul 06 23:53:08.645733 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.645316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67" event={"ID":"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd","Type":"ContainerDied","Data":"fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e"}
Jul 06 23:53:08.645733 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.645357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67" event={"ID":"b1f2ac95-b73f-413d-85fb-5b60d3bb09cd","Type":"ContainerDied","Data":"a7a3da3a241465da9d14d5656b6f6a7a2a29e5bc5585c2fbc0df826b6e2ae3a4"}
Jul 06 23:53:08.645733 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.645378    2579 scope.go:117] "RemoveContainer" containerID="fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e"
Jul 06 23:53:08.654067 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.654030    2579 scope.go:117] "RemoveContainer" containerID="fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e"
Jul 06 23:53:08.654343 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:53:08.654326    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e\": container with ID starting with fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e not found: ID does not exist" containerID="fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e"
Jul 06 23:53:08.654391 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.654352    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e"} err="failed to get container status \"fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e\": rpc error: code = NotFound desc = could not find container \"fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e\": container with ID starting with fc40ff6e571ae574c3a528ea029fdf383459195b971910c12471712232d1484e not found: ID does not exist"
Jul 06 23:53:08.665708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.665679    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"]
Jul 06 23:53:08.672486 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:08.672459    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-793bb430-746bb78887-x7z67"]
Jul 06 23:53:09.379775 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:09.379742    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" path="/var/lib/kubelet/pods/b1f2ac95-b73f-413d-85fb-5b60d3bb09cd/volumes"
Jul 06 23:53:15.969132 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:15.969094    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:53:36.645081 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.645020    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"]
Jul 06 23:53:36.645522 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.645415    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" containerName="maas-api"
Jul 06 23:53:36.645522 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.645430    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" containerName="maas-api"
Jul 06 23:53:36.645522 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.645488    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f2ac95-b73f-413d-85fb-5b60d3bb09cd" containerName="maas-api"
Jul 06 23:53:36.651087 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.649431    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.653373 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.653347    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:53:36.653701 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.653682    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-5443d911-serving-cert\""
Jul 06 23:53:36.660693 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.660669    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"]
Jul 06 23:53:36.693691 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.693657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46cc3d0-5ab7-44ae-8aac-787a13cac174-openshift-service-ca\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.693691 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.693692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46cc3d0-5ab7-44ae-8aac-787a13cac174-maas-api-tls\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.693872 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.693774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvvhc\" (UniqueName: \"kubernetes.io/projected/b46cc3d0-5ab7-44ae-8aac-787a13cac174-kube-api-access-wvvhc\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.794501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.794466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46cc3d0-5ab7-44ae-8aac-787a13cac174-openshift-service-ca\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.794501 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.794498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46cc3d0-5ab7-44ae-8aac-787a13cac174-maas-api-tls\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.794703 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.794547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvvhc\" (UniqueName: \"kubernetes.io/projected/b46cc3d0-5ab7-44ae-8aac-787a13cac174-kube-api-access-wvvhc\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.795262 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.795231    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46cc3d0-5ab7-44ae-8aac-787a13cac174-openshift-service-ca\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.797098 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.797080    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46cc3d0-5ab7-44ae-8aac-787a13cac174-maas-api-tls\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.804884 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.804861    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvvhc\" (UniqueName: \"kubernetes.io/projected/b46cc3d0-5ab7-44ae-8aac-787a13cac174-kube-api-access-wvvhc\") pod \"maas-api-e2e-mt-5443d911-5d75d97b4-z69wh\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") " pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:36.965351 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:36.965321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:37.100364 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:37.100305    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"]
Jul 06 23:53:37.103197 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:53:37.103166    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46cc3d0_5ab7_44ae_8aac_787a13cac174.slice/crio-65c9dc5757e0831cd34582fce5cea0e4220fc6c6e86ebb3b7e8959b6475df4f7 WatchSource:0}: Error finding container 65c9dc5757e0831cd34582fce5cea0e4220fc6c6e86ebb3b7e8959b6475df4f7: Status 404 returned error can't find the container with id 65c9dc5757e0831cd34582fce5cea0e4220fc6c6e86ebb3b7e8959b6475df4f7
Jul 06 23:53:37.778594 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:37.778559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh" event={"ID":"b46cc3d0-5ab7-44ae-8aac-787a13cac174","Type":"ContainerStarted","Data":"324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4"}
Jul 06 23:53:37.778993 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:37.778621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh" event={"ID":"b46cc3d0-5ab7-44ae-8aac-787a13cac174","Type":"ContainerStarted","Data":"65c9dc5757e0831cd34582fce5cea0e4220fc6c6e86ebb3b7e8959b6475df4f7"}
Jul 06 23:53:37.778993 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:37.778661    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:53:37.796187 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:37.796140    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh" podStartSLOduration=1.4647320449999999 podStartE2EDuration="1.796124373s" totalImagesPullingTime="331.392328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:53:37.794116214 +0000 UTC m=+1732.928108407" watchObservedRunningTime="2026-07-06 23:53:37.796124373 +0000 UTC m=+1732.930116563"
Jul 06 23:53:41.166898 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:41.166862    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:53:43.787928 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:53:43.787901    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:54:00.268209 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.268176    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"]
Jul 06 23:54:00.272773 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.272746    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.276240 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.276219    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5443d911\"/\"default-dockercfg-hn9vf\""
Jul 06 23:54:00.276366 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.276221    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5443d911\"/\"kube-root-ca.crt\""
Jul 06 23:54:00.276366 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.276222    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5443d911\"/\"openshift-service-ca.crt\""
Jul 06 23:54:00.276366 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.276259    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5443d911\"/\"e2e-lifecycle-model-5443d911-kserve-self-signed-certs\""
Jul 06 23:54:00.279838 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.279817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"]
Jul 06 23:54:00.393943 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.393905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lw2r\" (UniqueName: \"kubernetes.io/projected/719eb34c-1542-4585-923a-b372a4149008-kube-api-access-8lw2r\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.393943 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.393950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-dshm\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.394178 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.393970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719eb34c-1542-4585-923a-b372a4149008-tls-certs\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.394178 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.394049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-home\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.394178 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.394116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-model-cache\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.394178 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.394131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-tmp-dir\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.494896 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.494862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lw2r\" (UniqueName: \"kubernetes.io/projected/719eb34c-1542-4585-923a-b372a4149008-kube-api-access-8lw2r\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.494896 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.494895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-dshm\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.495190 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.494916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719eb34c-1542-4585-923a-b372a4149008-tls-certs\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.495190 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.494944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-home\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.495190 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.494972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-model-cache\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.495190 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.494990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-tmp-dir\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.495937 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.495848    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-model-cache\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.495937 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.495694    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-tmp-dir\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.495937 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.495418    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-home\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.497611 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.497575    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-dshm\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.502142 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.497773    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719eb34c-1542-4585-923a-b372a4149008-tls-certs\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.503857 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.503831    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lw2r\" (UniqueName: \"kubernetes.io/projected/719eb34c-1542-4585-923a-b372a4149008-kube-api-access-8lw2r\") pod \"e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") " pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.583887 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.583799    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:00.719967 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.719940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"]
Jul 06 23:54:00.721938 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:54:00.721911    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod719eb34c_1542_4585_923a_b372a4149008.slice/crio-fd8c73061f6d4e726ba86507e672d282af99d24dc253269bd5247307be91e332 WatchSource:0}: Error finding container fd8c73061f6d4e726ba86507e672d282af99d24dc253269bd5247307be91e332: Status 404 returned error can't find the container with id fd8c73061f6d4e726ba86507e672d282af99d24dc253269bd5247307be91e332
Jul 06 23:54:00.886418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.886342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69" event={"ID":"719eb34c-1542-4585-923a-b372a4149008","Type":"ContainerStarted","Data":"8c28090b5cc4a5314903182b41af98567a13fd7f8695258b3342dd6c69b97058"}
Jul 06 23:54:00.886418 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.886382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69" event={"ID":"719eb34c-1542-4585-923a-b372a4149008","Type":"ContainerStarted","Data":"fd8c73061f6d4e726ba86507e672d282af99d24dc253269bd5247307be91e332"}
Jul 06 23:54:00.902550 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:00.902418    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69" podStartSLOduration=0.902399693 podStartE2EDuration="902.399693ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:54:00.902294428 +0000 UTC m=+1756.036286620" watchObservedRunningTime="2026-07-06 23:54:00.902399693 +0000 UTC m=+1756.036391885"
Jul 06 23:54:03.165074 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:03.165023    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:54:10.584715 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:10.584674    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:10.585151 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:10.584736    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:10.597241 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:10.597219    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:10.939317 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:10.939243    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:18.267140 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:18.267084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:54:24.013651 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.013616    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"]
Jul 06 23:54:24.014162 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.013880    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh" podUID="b46cc3d0-5ab7-44ae-8aac-787a13cac174" containerName="maas-api" containerID="cri-o://324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4" gracePeriod=30
Jul 06 23:54:24.265337 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.265286    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:54:24.301807 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.301773    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvvhc\" (UniqueName: \"kubernetes.io/projected/b46cc3d0-5ab7-44ae-8aac-787a13cac174-kube-api-access-wvvhc\") pod \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") "
Jul 06 23:54:24.301959 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.301834    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46cc3d0-5ab7-44ae-8aac-787a13cac174-maas-api-tls\") pod \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") "
Jul 06 23:54:24.301959 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.301902    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46cc3d0-5ab7-44ae-8aac-787a13cac174-openshift-service-ca\") pod \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\" (UID: \"b46cc3d0-5ab7-44ae-8aac-787a13cac174\") "
Jul 06 23:54:24.302304 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.302278    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46cc3d0-5ab7-44ae-8aac-787a13cac174-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b46cc3d0-5ab7-44ae-8aac-787a13cac174" (UID: "b46cc3d0-5ab7-44ae-8aac-787a13cac174"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:54:24.303949 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.303920    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46cc3d0-5ab7-44ae-8aac-787a13cac174-kube-api-access-wvvhc" (OuterVolumeSpecName: "kube-api-access-wvvhc") pod "b46cc3d0-5ab7-44ae-8aac-787a13cac174" (UID: "b46cc3d0-5ab7-44ae-8aac-787a13cac174"). InnerVolumeSpecName "kube-api-access-wvvhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:54:24.304081 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.304041    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46cc3d0-5ab7-44ae-8aac-787a13cac174-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b46cc3d0-5ab7-44ae-8aac-787a13cac174" (UID: "b46cc3d0-5ab7-44ae-8aac-787a13cac174"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:54:24.403394 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.403361    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvvhc\" (UniqueName: \"kubernetes.io/projected/b46cc3d0-5ab7-44ae-8aac-787a13cac174-kube-api-access-wvvhc\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:24.403394 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.403395    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46cc3d0-5ab7-44ae-8aac-787a13cac174-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:24.403641 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.403410    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46cc3d0-5ab7-44ae-8aac-787a13cac174-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:24.989812 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.989777    2579 generic.go:356] "Generic (PLEG): container finished" podID="b46cc3d0-5ab7-44ae-8aac-787a13cac174" containerID="324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4" exitCode=0
Jul 06 23:54:24.990010 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.989829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh" event={"ID":"b46cc3d0-5ab7-44ae-8aac-787a13cac174","Type":"ContainerDied","Data":"324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4"}
Jul 06 23:54:24.990010 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.989839    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"
Jul 06 23:54:24.990010 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.989885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh" event={"ID":"b46cc3d0-5ab7-44ae-8aac-787a13cac174","Type":"ContainerDied","Data":"65c9dc5757e0831cd34582fce5cea0e4220fc6c6e86ebb3b7e8959b6475df4f7"}
Jul 06 23:54:24.990010 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.989913    2579 scope.go:117] "RemoveContainer" containerID="324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4"
Jul 06 23:54:24.998809 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.998790    2579 scope.go:117] "RemoveContainer" containerID="324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4"
Jul 06 23:54:24.999105 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:54:24.999078    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4\": container with ID starting with 324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4 not found: ID does not exist" containerID="324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4"
Jul 06 23:54:24.999158 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:24.999122    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4"} err="failed to get container status \"324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4\": rpc error: code = NotFound desc = could not find container \"324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4\": container with ID starting with 324a0788491eeb0fe9e121b9ea4949ac014a3975e46dce064cb0f4eee340bcc4 not found: ID does not exist"
Jul 06 23:54:25.009816 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:25.009790    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"]
Jul 06 23:54:25.013797 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:25.013776    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-5443d911-5d75d97b4-z69wh"]
Jul 06 23:54:25.379381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:25.379306    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46cc3d0-5ab7-44ae-8aac-787a13cac174" path="/var/lib/kubelet/pods/b46cc3d0-5ab7-44ae-8aac-787a13cac174/volumes"
Jul 06 23:54:27.963982 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:27.963954    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:54:34.859986 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:34.859944    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"]
Jul 06 23:54:38.167420 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:38.167329    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:54:45.377824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:45.377799    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:54:45.380456 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:45.380432    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:54:49.881503 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:49.881442    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69" podUID="719eb34c-1542-4585-923a-b372a4149008" containerName="main" containerID="cri-o://8c28090b5cc4a5314903182b41af98567a13fd7f8695258b3342dd6c69b97058" gracePeriod=45
Jul 06 23:54:50.102029 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.101999    2579 generic.go:356] "Generic (PLEG): container finished" podID="719eb34c-1542-4585-923a-b372a4149008" containerID="8c28090b5cc4a5314903182b41af98567a13fd7f8695258b3342dd6c69b97058" exitCode=0
Jul 06 23:54:50.102201 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.102046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69" event={"ID":"719eb34c-1542-4585-923a-b372a4149008","Type":"ContainerDied","Data":"8c28090b5cc4a5314903182b41af98567a13fd7f8695258b3342dd6c69b97058"}
Jul 06 23:54:50.152472 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.152450    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:50.231487 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231451    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-dshm\") pod \"719eb34c-1542-4585-923a-b372a4149008\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") "
Jul 06 23:54:50.231487 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231488    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-home\") pod \"719eb34c-1542-4585-923a-b372a4149008\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") "
Jul 06 23:54:50.231715 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-model-cache\") pod \"719eb34c-1542-4585-923a-b372a4149008\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") "
Jul 06 23:54:50.231715 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231559    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719eb34c-1542-4585-923a-b372a4149008-tls-certs\") pod \"719eb34c-1542-4585-923a-b372a4149008\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") "
Jul 06 23:54:50.231715 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231596    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-tmp-dir\") pod \"719eb34c-1542-4585-923a-b372a4149008\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") "
Jul 06 23:54:50.231715 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231653    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lw2r\" (UniqueName: \"kubernetes.io/projected/719eb34c-1542-4585-923a-b372a4149008-kube-api-access-8lw2r\") pod \"719eb34c-1542-4585-923a-b372a4149008\" (UID: \"719eb34c-1542-4585-923a-b372a4149008\") "
Jul 06 23:54:50.231939 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231773    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-home" (OuterVolumeSpecName: "home") pod "719eb34c-1542-4585-923a-b372a4149008" (UID: "719eb34c-1542-4585-923a-b372a4149008"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:54:50.231939 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231797    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-model-cache" (OuterVolumeSpecName: "model-cache") pod "719eb34c-1542-4585-923a-b372a4149008" (UID: "719eb34c-1542-4585-923a-b372a4149008"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:54:50.231939 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231850    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "719eb34c-1542-4585-923a-b372a4149008" (UID: "719eb34c-1542-4585-923a-b372a4149008"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:54:50.232119 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231941    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-home\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:50.232119 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231952    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-model-cache\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:50.232119 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.231962    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-tmp-dir\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:50.233778 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.233748    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/719eb34c-1542-4585-923a-b372a4149008-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "719eb34c-1542-4585-923a-b372a4149008" (UID: "719eb34c-1542-4585-923a-b372a4149008"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:54:50.233778 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.233774    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-dshm" (OuterVolumeSpecName: "dshm") pod "719eb34c-1542-4585-923a-b372a4149008" (UID: "719eb34c-1542-4585-923a-b372a4149008"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:54:50.233919 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.233802    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/719eb34c-1542-4585-923a-b372a4149008-kube-api-access-8lw2r" (OuterVolumeSpecName: "kube-api-access-8lw2r") pod "719eb34c-1542-4585-923a-b372a4149008" (UID: "719eb34c-1542-4585-923a-b372a4149008"). InnerVolumeSpecName "kube-api-access-8lw2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:54:50.333099 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.333046    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/719eb34c-1542-4585-923a-b372a4149008-tls-certs\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:50.333099 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.333093    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lw2r\" (UniqueName: \"kubernetes.io/projected/719eb34c-1542-4585-923a-b372a4149008-kube-api-access-8lw2r\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:50.333099 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:50.333101    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/719eb34c-1542-4585-923a-b372a4149008-dshm\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:54:51.107378 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:51.107350    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"
Jul 06 23:54:51.107378 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:51.107360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69" event={"ID":"719eb34c-1542-4585-923a-b372a4149008","Type":"ContainerDied","Data":"fd8c73061f6d4e726ba86507e672d282af99d24dc253269bd5247307be91e332"}
Jul 06 23:54:51.107843 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:51.107404    2579 scope.go:117] "RemoveContainer" containerID="8c28090b5cc4a5314903182b41af98567a13fd7f8695258b3342dd6c69b97058"
Jul 06 23:54:51.127796 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:51.127768    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"]
Jul 06 23:54:51.131760 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:51.131738    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5443d911/e2e-lifecycle-model-5443d911-kserve-6d7b6fcd47-d6h69"]
Jul 06 23:54:51.379780 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:54:51.379691    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="719eb34c-1542-4585-923a-b372a4149008" path="/var/lib/kubelet/pods/719eb34c-1542-4585-923a-b372a4149008/volumes"
Jul 06 23:55:14.474821 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:55:14.474784    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:55:23.181214 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:55:23.181177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:55:35.472769 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:55:35.472732    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:56:16.509390 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.509298    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"]
Jul 06 23:56:16.509885 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.509785    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719eb34c-1542-4585-923a-b372a4149008" containerName="main"
Jul 06 23:56:16.509885 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.509804    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="719eb34c-1542-4585-923a-b372a4149008" containerName="main"
Jul 06 23:56:16.509885 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.509826    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46cc3d0-5ab7-44ae-8aac-787a13cac174" containerName="maas-api"
Jul 06 23:56:16.509885 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.509835    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46cc3d0-5ab7-44ae-8aac-787a13cac174" containerName="maas-api"
Jul 06 23:56:16.510103 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.509912    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46cc3d0-5ab7-44ae-8aac-787a13cac174" containerName="maas-api"
Jul 06 23:56:16.510103 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.509929    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="719eb34c-1542-4585-923a-b372a4149008" containerName="main"
Jul 06 23:56:16.513071 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.513026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.515607 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.515584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:56:16.515744 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.515669    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-8c6acb-serving-cert\""
Jul 06 23:56:16.522973 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.522933    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"]
Jul 06 23:56:16.537293 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.537263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c03aeb7e-0434-4b61-a353-8045abeb3538-maas-api-tls\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.537445 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.537344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp9mp\" (UniqueName: \"kubernetes.io/projected/c03aeb7e-0434-4b61-a353-8045abeb3538-kube-api-access-wp9mp\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.537445 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.537404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c03aeb7e-0434-4b61-a353-8045abeb3538-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.638131 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.638092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp9mp\" (UniqueName: \"kubernetes.io/projected/c03aeb7e-0434-4b61-a353-8045abeb3538-kube-api-access-wp9mp\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.638309 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.638166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c03aeb7e-0434-4b61-a353-8045abeb3538-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.638309 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.638205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c03aeb7e-0434-4b61-a353-8045abeb3538-maas-api-tls\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.638923 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.638904    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c03aeb7e-0434-4b61-a353-8045abeb3538-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.640810 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.640788    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c03aeb7e-0434-4b61-a353-8045abeb3538-maas-api-tls\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.646524 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.646497    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp9mp\" (UniqueName: \"kubernetes.io/projected/c03aeb7e-0434-4b61-a353-8045abeb3538-kube-api-access-wp9mp\") pod \"maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") " pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.824295 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.824201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:16.965006 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.964980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"]
Jul 06 23:56:16.967450 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:56:16.967425    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03aeb7e_0434_4b61_a353_8045abeb3538.slice/crio-e309f6bfed83f769ed3976490d311eeac3f775c475105c29ec3d1fcb64917da4 WatchSource:0}: Error finding container e309f6bfed83f769ed3976490d311eeac3f775c475105c29ec3d1fcb64917da4: Status 404 returned error can't find the container with id e309f6bfed83f769ed3976490d311eeac3f775c475105c29ec3d1fcb64917da4
Jul 06 23:56:16.968720 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:16.968699    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:56:17.473615 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:17.473587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf" event={"ID":"c03aeb7e-0434-4b61-a353-8045abeb3538","Type":"ContainerStarted","Data":"5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad"}
Jul 06 23:56:17.473745 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:17.473636    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf" event={"ID":"c03aeb7e-0434-4b61-a353-8045abeb3538","Type":"ContainerStarted","Data":"e309f6bfed83f769ed3976490d311eeac3f775c475105c29ec3d1fcb64917da4"}
Jul 06 23:56:17.473745 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:17.473735    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:17.491786 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:17.491742    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf" podStartSLOduration=1.066002198 podStartE2EDuration="1.491724812s" totalImagesPullingTime="425.722614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:17.490079911 +0000 UTC m=+1892.624072101" watchObservedRunningTime="2026-07-06 23:56:17.491724812 +0000 UTC m=+1892.625717013"
Jul 06 23:56:22.573185 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:22.573146    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:56:23.483765 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:23.483735    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:56:24.605184 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.605153    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"]
Jul 06 23:56:24.608857 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.608835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.611308 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.611283    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-4820fd-serving-cert\""
Jul 06 23:56:24.623914 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.623890    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"]
Jul 06 23:56:24.713138 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.713095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20c4180-7843-43fa-94f7-27fc849c83a8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.713314 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.713212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20c4180-7843-43fa-94f7-27fc849c83a8-maas-api-tls\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.713394 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.713265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxzps\" (UniqueName: \"kubernetes.io/projected/c20c4180-7843-43fa-94f7-27fc849c83a8-kube-api-access-lxzps\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.814031 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.813991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20c4180-7843-43fa-94f7-27fc849c83a8-maas-api-tls\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.814031 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.814039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxzps\" (UniqueName: \"kubernetes.io/projected/c20c4180-7843-43fa-94f7-27fc849c83a8-kube-api-access-lxzps\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.814250 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.814097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20c4180-7843-43fa-94f7-27fc849c83a8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.814727 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.814666    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20c4180-7843-43fa-94f7-27fc849c83a8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.816565 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.816541    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20c4180-7843-43fa-94f7-27fc849c83a8-maas-api-tls\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.826614 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.826594    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxzps\" (UniqueName: \"kubernetes.io/projected/c20c4180-7843-43fa-94f7-27fc849c83a8-kube-api-access-lxzps\") pod \"maas-api-e2e-inf-b-4820fd-57df64c656-pftp6\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") " pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:24.920165 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:24.920078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:25.054294 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:25.054269    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"]
Jul 06 23:56:25.056524 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:56:25.056497    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20c4180_7843_43fa_94f7_27fc849c83a8.slice/crio-67e0ccbfba5da46b19886c0cd80f661984cc45e4464a354ca9a9bb7f9f20d7ee WatchSource:0}: Error finding container 67e0ccbfba5da46b19886c0cd80f661984cc45e4464a354ca9a9bb7f9f20d7ee: Status 404 returned error can't find the container with id 67e0ccbfba5da46b19886c0cd80f661984cc45e4464a354ca9a9bb7f9f20d7ee
Jul 06 23:56:25.509562 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:25.509527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6" event={"ID":"c20c4180-7843-43fa-94f7-27fc849c83a8","Type":"ContainerStarted","Data":"575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5"}
Jul 06 23:56:25.509704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:25.509587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:25.509704 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:25.509604    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6" event={"ID":"c20c4180-7843-43fa-94f7-27fc849c83a8","Type":"ContainerStarted","Data":"67e0ccbfba5da46b19886c0cd80f661984cc45e4464a354ca9a9bb7f9f20d7ee"}
Jul 06 23:56:25.526138 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:25.526083    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6" podStartSLOduration=1.265510782 podStartE2EDuration="1.526042755s" totalImagesPullingTime="260.531973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:25.524933077 +0000 UTC m=+1900.658925269" watchObservedRunningTime="2026-07-06 23:56:25.526042755 +0000 UTC m=+1900.660034945"
Jul 06 23:56:31.519779 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:31.519751    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:56:38.070302 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:38.070262    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:56:44.578433 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.578398    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"]
Jul 06 23:56:44.582965 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.582948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.585302 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.585279    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8c6acb\"/\"openshift-service-ca.crt\""
Jul 06 23:56:44.586231 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.586212    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8c6acb\"/\"default-dockercfg-q4brv\""
Jul 06 23:56:44.586312 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.586290    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8c6acb\"/\"kube-root-ca.crt\""
Jul 06 23:56:44.586390 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.586373    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8c6acb\"/\"test-model-8c6acb-kserve-self-signed-certs\""
Jul 06 23:56:44.590294 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.590269    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"]
Jul 06 23:56:44.683666 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.683625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732c035c-2d6e-436f-8802-a8b36aaba0bc-tls-certs\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.683666 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.683673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-tmp-dir\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.683933 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.683798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-home\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.683933 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.683833    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-dshm\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.683933 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.683893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-model-cache\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.684102 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.683945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8thtc\" (UniqueName: \"kubernetes.io/projected/732c035c-2d6e-436f-8802-a8b36aaba0bc-kube-api-access-8thtc\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.784652 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.784615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732c035c-2d6e-436f-8802-a8b36aaba0bc-tls-certs\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.784831 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.784666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-tmp-dir\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.784831 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.784707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-home\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.784831 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.784724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-dshm\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.784831 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.784749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-model-cache\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.785009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.784888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8thtc\" (UniqueName: \"kubernetes.io/projected/732c035c-2d6e-436f-8802-a8b36aaba0bc-kube-api-access-8thtc\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.785200 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.785176    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-tmp-dir\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.785333 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.785253    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-model-cache\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.785333 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.785253    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-home\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.787263 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.787242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-dshm\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.787381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.787366    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732c035c-2d6e-436f-8802-a8b36aaba0bc-tls-certs\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.792709 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.792685    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8thtc\" (UniqueName: \"kubernetes.io/projected/732c035c-2d6e-436f-8802-a8b36aaba0bc-kube-api-access-8thtc\") pod \"test-model-8c6acb-kserve-6647f9bf9-kmd65\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") " pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:44.893270 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:44.893194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:45.027621 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:45.027587    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"]
Jul 06 23:56:45.031314 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:56:45.031281    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod732c035c_2d6e_436f_8802_a8b36aaba0bc.slice/crio-dcf0cf42d30ab0e39dda4a3fa102612c5f79152d4c92adcf8092e89440568104 WatchSource:0}: Error finding container dcf0cf42d30ab0e39dda4a3fa102612c5f79152d4c92adcf8092e89440568104: Status 404 returned error can't find the container with id dcf0cf42d30ab0e39dda4a3fa102612c5f79152d4c92adcf8092e89440568104
Jul 06 23:56:45.604664 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:45.604632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65" event={"ID":"732c035c-2d6e-436f-8802-a8b36aaba0bc","Type":"ContainerStarted","Data":"a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175"}
Jul 06 23:56:45.605044 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:45.604673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65" event={"ID":"732c035c-2d6e-436f-8802-a8b36aaba0bc","Type":"ContainerStarted","Data":"dcf0cf42d30ab0e39dda4a3fa102612c5f79152d4c92adcf8092e89440568104"}
Jul 06 23:56:45.621914 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:45.621865    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65" podStartSLOduration=1.621848153 podStartE2EDuration="1.621848153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:45.620388777 +0000 UTC m=+1920.754380968" watchObservedRunningTime="2026-07-06 23:56:45.621848153 +0000 UTC m=+1920.755840344"
Jul 06 23:56:48.060104 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:48.060068    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:56:54.893413 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:54.893378    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:54.893785 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:54.893426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:54.905688 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:54.905665    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:56:55.659522 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:56:55.659490    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:57:00.368768 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:00.368734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:57:25.960100 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:25.960049    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:57:38.470307 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:38.470225    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:57:47.894657 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:47.894624    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"]
Jul 06 23:57:49.935647 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:49.935613    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"]
Jul 06 23:57:49.936090 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:49.935828    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf" podUID="c03aeb7e-0434-4b61-a353-8045abeb3538" containerName="maas-api" containerID="cri-o://5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad" gracePeriod=30
Jul 06 23:57:50.256217 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:57:50.256181    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03aeb7e_0434_4b61_a353_8045abeb3538.slice/crio-conmon-5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad.scope\": RecentStats: unable to find data in memory cache]"
Jul 06 23:57:50.385370 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.385346    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:57:50.457940 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.457908    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c03aeb7e-0434-4b61-a353-8045abeb3538-openshift-service-ca\") pod \"c03aeb7e-0434-4b61-a353-8045abeb3538\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") "
Jul 06 23:57:50.458106 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.457959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp9mp\" (UniqueName: \"kubernetes.io/projected/c03aeb7e-0434-4b61-a353-8045abeb3538-kube-api-access-wp9mp\") pod \"c03aeb7e-0434-4b61-a353-8045abeb3538\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") "
Jul 06 23:57:50.458106 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.458003    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c03aeb7e-0434-4b61-a353-8045abeb3538-maas-api-tls\") pod \"c03aeb7e-0434-4b61-a353-8045abeb3538\" (UID: \"c03aeb7e-0434-4b61-a353-8045abeb3538\") "
Jul 06 23:57:50.458352 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.458328    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c03aeb7e-0434-4b61-a353-8045abeb3538-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c03aeb7e-0434-4b61-a353-8045abeb3538" (UID: "c03aeb7e-0434-4b61-a353-8045abeb3538"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:57:50.460084 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.460043    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c03aeb7e-0434-4b61-a353-8045abeb3538-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c03aeb7e-0434-4b61-a353-8045abeb3538" (UID: "c03aeb7e-0434-4b61-a353-8045abeb3538"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:57:50.460206 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.460186    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03aeb7e-0434-4b61-a353-8045abeb3538-kube-api-access-wp9mp" (OuterVolumeSpecName: "kube-api-access-wp9mp") pod "c03aeb7e-0434-4b61-a353-8045abeb3538" (UID: "c03aeb7e-0434-4b61-a353-8045abeb3538"). InnerVolumeSpecName "kube-api-access-wp9mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:57:50.559668 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.559581    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c03aeb7e-0434-4b61-a353-8045abeb3538-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:57:50.559668 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.559611    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp9mp\" (UniqueName: \"kubernetes.io/projected/c03aeb7e-0434-4b61-a353-8045abeb3538-kube-api-access-wp9mp\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:57:50.559668 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.559620    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c03aeb7e-0434-4b61-a353-8045abeb3538-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:57:50.914213 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.914131    2579 generic.go:356] "Generic (PLEG): container finished" podID="c03aeb7e-0434-4b61-a353-8045abeb3538" containerID="5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad" exitCode=0
Jul 06 23:57:50.914213 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.914174    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"
Jul 06 23:57:50.914422 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.914209    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf" event={"ID":"c03aeb7e-0434-4b61-a353-8045abeb3538","Type":"ContainerDied","Data":"5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad"}
Jul 06 23:57:50.914422 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.914261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf" event={"ID":"c03aeb7e-0434-4b61-a353-8045abeb3538","Type":"ContainerDied","Data":"e309f6bfed83f769ed3976490d311eeac3f775c475105c29ec3d1fcb64917da4"}
Jul 06 23:57:50.914422 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.914284    2579 scope.go:117] "RemoveContainer" containerID="5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad"
Jul 06 23:57:50.922787 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.922772    2579 scope.go:117] "RemoveContainer" containerID="5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad"
Jul 06 23:57:50.923047 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:57:50.923029    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad\": container with ID starting with 5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad not found: ID does not exist" containerID="5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad"
Jul 06 23:57:50.923147 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.923072    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad"} err="failed to get container status \"5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad\": rpc error: code = NotFound desc = could not find container \"5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad\": container with ID starting with 5591ad7a9dff442c409197a55420dff8669395d8f9df120dde6fce2c461853ad not found: ID does not exist"
Jul 06 23:57:50.934022 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.933999    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"]
Jul 06 23:57:50.939076 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:50.939035    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8c6acb-6bd46f57d6-gs4jf"]
Jul 06 23:57:51.380264 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:51.380233    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c03aeb7e-0434-4b61-a353-8045abeb3538" path="/var/lib/kubelet/pods/c03aeb7e-0434-4b61-a353-8045abeb3538/volumes"
Jul 06 23:57:51.570848 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:57:51.570812    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:58:02.918841 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:02.918784    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65" podUID="732c035c-2d6e-436f-8802-a8b36aaba0bc" containerName="main" containerID="cri-o://a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175" gracePeriod=45
Jul 06 23:58:03.157399 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.157378    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:58:03.266099 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-dshm\") pod \"732c035c-2d6e-436f-8802-a8b36aaba0bc\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") "
Jul 06 23:58:03.266253 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266120    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-home\") pod \"732c035c-2d6e-436f-8802-a8b36aaba0bc\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") "
Jul 06 23:58:03.266253 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266149    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732c035c-2d6e-436f-8802-a8b36aaba0bc-tls-certs\") pod \"732c035c-2d6e-436f-8802-a8b36aaba0bc\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") "
Jul 06 23:58:03.266253 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266204    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-model-cache\") pod \"732c035c-2d6e-436f-8802-a8b36aaba0bc\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") "
Jul 06 23:58:03.266253 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266228    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8thtc\" (UniqueName: \"kubernetes.io/projected/732c035c-2d6e-436f-8802-a8b36aaba0bc-kube-api-access-8thtc\") pod \"732c035c-2d6e-436f-8802-a8b36aaba0bc\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") "
Jul 06 23:58:03.266253 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266253    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-tmp-dir\") pod \"732c035c-2d6e-436f-8802-a8b36aaba0bc\" (UID: \"732c035c-2d6e-436f-8802-a8b36aaba0bc\") "
Jul 06 23:58:03.266790 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266384    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-home" (OuterVolumeSpecName: "home") pod "732c035c-2d6e-436f-8802-a8b36aaba0bc" (UID: "732c035c-2d6e-436f-8802-a8b36aaba0bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:58:03.266790 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266494    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "732c035c-2d6e-436f-8802-a8b36aaba0bc" (UID: "732c035c-2d6e-436f-8802-a8b36aaba0bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:58:03.266790 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.266612    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "732c035c-2d6e-436f-8802-a8b36aaba0bc" (UID: "732c035c-2d6e-436f-8802-a8b36aaba0bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:58:03.268489 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.268464    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-dshm" (OuterVolumeSpecName: "dshm") pod "732c035c-2d6e-436f-8802-a8b36aaba0bc" (UID: "732c035c-2d6e-436f-8802-a8b36aaba0bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:58:03.268582 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.268521    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/732c035c-2d6e-436f-8802-a8b36aaba0bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "732c035c-2d6e-436f-8802-a8b36aaba0bc" (UID: "732c035c-2d6e-436f-8802-a8b36aaba0bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:58:03.268582 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.268530    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/732c035c-2d6e-436f-8802-a8b36aaba0bc-kube-api-access-8thtc" (OuterVolumeSpecName: "kube-api-access-8thtc") pod "732c035c-2d6e-436f-8802-a8b36aaba0bc" (UID: "732c035c-2d6e-436f-8802-a8b36aaba0bc"). InnerVolumeSpecName "kube-api-access-8thtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:58:03.367769 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.367736    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-dshm\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:03.367769 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.367764    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-home\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:03.367769 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.367773    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732c035c-2d6e-436f-8802-a8b36aaba0bc-tls-certs\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:03.368005 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.367783    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-model-cache\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:03.368005 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.367792    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8thtc\" (UniqueName: \"kubernetes.io/projected/732c035c-2d6e-436f-8802-a8b36aaba0bc-kube-api-access-8thtc\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:03.368005 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.367800    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732c035c-2d6e-436f-8802-a8b36aaba0bc-tmp-dir\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:03.976305 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.976271    2579 generic.go:356] "Generic (PLEG): container finished" podID="732c035c-2d6e-436f-8802-a8b36aaba0bc" containerID="a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175" exitCode=0
Jul 06 23:58:03.976712 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.976318    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"
Jul 06 23:58:03.976712 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.976365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65" event={"ID":"732c035c-2d6e-436f-8802-a8b36aaba0bc","Type":"ContainerDied","Data":"a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175"}
Jul 06 23:58:03.976712 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.976409    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65" event={"ID":"732c035c-2d6e-436f-8802-a8b36aaba0bc","Type":"ContainerDied","Data":"dcf0cf42d30ab0e39dda4a3fa102612c5f79152d4c92adcf8092e89440568104"}
Jul 06 23:58:03.976712 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.976430    2579 scope.go:117] "RemoveContainer" containerID="a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175"
Jul 06 23:58:03.985090 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.985075    2579 scope.go:117] "RemoveContainer" containerID="a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175"
Jul 06 23:58:03.985348 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:58:03.985329    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175\": container with ID starting with a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175 not found: ID does not exist" containerID="a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175"
Jul 06 23:58:03.985385 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.985361    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175"} err="failed to get container status \"a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175\": rpc error: code = NotFound desc = could not find container \"a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175\": container with ID starting with a1722be75cf45267869c257a59102cfc87804d953bd7ed72bc4544ef71488175 not found: ID does not exist"
Jul 06 23:58:03.990943 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.990923    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"]
Jul 06 23:58:03.995038 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:03.995019    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8c6acb/test-model-8c6acb-kserve-6647f9bf9-kmd65"]
Jul 06 23:58:05.379354 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:05.379315    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="732c035c-2d6e-436f-8802-a8b36aaba0bc" path="/var/lib/kubelet/pods/732c035c-2d6e-436f-8802-a8b36aaba0bc/volumes"
Jul 06 23:58:32.842083 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:32.842035    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"]
Jul 06 23:58:32.842562 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:32.842372    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6" podUID="c20c4180-7843-43fa-94f7-27fc849c83a8" containerName="maas-api" containerID="cri-o://575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5" gracePeriod=30
Jul 06 23:58:33.095340 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.095286    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:58:33.110151 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.110119    2579 generic.go:356] "Generic (PLEG): container finished" podID="c20c4180-7843-43fa-94f7-27fc849c83a8" containerID="575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5" exitCode=0
Jul 06 23:58:33.110287 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.110156    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"
Jul 06 23:58:33.110287 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.110159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6" event={"ID":"c20c4180-7843-43fa-94f7-27fc849c83a8","Type":"ContainerDied","Data":"575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5"}
Jul 06 23:58:33.110287 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.110211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6" event={"ID":"c20c4180-7843-43fa-94f7-27fc849c83a8","Type":"ContainerDied","Data":"67e0ccbfba5da46b19886c0cd80f661984cc45e4464a354ca9a9bb7f9f20d7ee"}
Jul 06 23:58:33.110287 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.110242    2579 scope.go:117] "RemoveContainer" containerID="575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5"
Jul 06 23:58:33.120708 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.120682    2579 scope.go:117] "RemoveContainer" containerID="575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5"
Jul 06 23:58:33.121006 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:58:33.120976    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5\": container with ID starting with 575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5 not found: ID does not exist" containerID="575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5"
Jul 06 23:58:33.121095 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.121020    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5"} err="failed to get container status \"575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5\": rpc error: code = NotFound desc = could not find container \"575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5\": container with ID starting with 575274e58761c079654632ba45a1f3f085cdde6438377e1c324ea7beddb578c5 not found: ID does not exist"
Jul 06 23:58:33.215142 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.215102    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20c4180-7843-43fa-94f7-27fc849c83a8-maas-api-tls\") pod \"c20c4180-7843-43fa-94f7-27fc849c83a8\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") "
Jul 06 23:58:33.215314 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.215164    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20c4180-7843-43fa-94f7-27fc849c83a8-openshift-service-ca\") pod \"c20c4180-7843-43fa-94f7-27fc849c83a8\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") "
Jul 06 23:58:33.215314 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.215208    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxzps\" (UniqueName: \"kubernetes.io/projected/c20c4180-7843-43fa-94f7-27fc849c83a8-kube-api-access-lxzps\") pod \"c20c4180-7843-43fa-94f7-27fc849c83a8\" (UID: \"c20c4180-7843-43fa-94f7-27fc849c83a8\") "
Jul 06 23:58:33.215612 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.215583    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20c4180-7843-43fa-94f7-27fc849c83a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c20c4180-7843-43fa-94f7-27fc849c83a8" (UID: "c20c4180-7843-43fa-94f7-27fc849c83a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:58:33.217461 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.217431    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20c4180-7843-43fa-94f7-27fc849c83a8-kube-api-access-lxzps" (OuterVolumeSpecName: "kube-api-access-lxzps") pod "c20c4180-7843-43fa-94f7-27fc849c83a8" (UID: "c20c4180-7843-43fa-94f7-27fc849c83a8"). InnerVolumeSpecName "kube-api-access-lxzps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:58:33.217562 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.217466    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20c4180-7843-43fa-94f7-27fc849c83a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c20c4180-7843-43fa-94f7-27fc849c83a8" (UID: "c20c4180-7843-43fa-94f7-27fc849c83a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:58:33.316180 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.316149    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxzps\" (UniqueName: \"kubernetes.io/projected/c20c4180-7843-43fa-94f7-27fc849c83a8-kube-api-access-lxzps\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:33.316180 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.316173    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c20c4180-7843-43fa-94f7-27fc849c83a8-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:33.316180 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.316182    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c20c4180-7843-43fa-94f7-27fc849c83a8-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:58:33.424860 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.424829    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"]
Jul 06 23:58:33.428766 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:33.428741    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4820fd-57df64c656-pftp6"]
Jul 06 23:58:35.379446 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:35.379414    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c20c4180-7843-43fa-94f7-27fc849c83a8" path="/var/lib/kubelet/pods/c20c4180-7843-43fa-94f7-27fc849c83a8/volumes"
Jul 06 23:58:35.965850 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:35.965812    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:58:42.242799 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.242764    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"]
Jul 06 23:58:42.243203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243144    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="732c035c-2d6e-436f-8802-a8b36aaba0bc" containerName="main"
Jul 06 23:58:42.243203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243156    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="732c035c-2d6e-436f-8802-a8b36aaba0bc" containerName="main"
Jul 06 23:58:42.243203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243178    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20c4180-7843-43fa-94f7-27fc849c83a8" containerName="maas-api"
Jul 06 23:58:42.243203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243186    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20c4180-7843-43fa-94f7-27fc849c83a8" containerName="maas-api"
Jul 06 23:58:42.243203 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243197    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03aeb7e-0434-4b61-a353-8045abeb3538" containerName="maas-api"
Jul 06 23:58:42.243369 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243207    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03aeb7e-0434-4b61-a353-8045abeb3538" containerName="maas-api"
Jul 06 23:58:42.243369 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243267    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20c4180-7843-43fa-94f7-27fc849c83a8" containerName="maas-api"
Jul 06 23:58:42.243369 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243279    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="732c035c-2d6e-436f-8802-a8b36aaba0bc" containerName="main"
Jul 06 23:58:42.243369 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.243289    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c03aeb7e-0434-4b61-a353-8045abeb3538" containerName="maas-api"
Jul 06 23:58:42.247711 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.247692    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.250487 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.250466    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-87c0b0-serving-cert\""
Jul 06 23:58:42.250598 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.250520    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:58:42.260946 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.260922    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"]
Jul 06 23:58:42.295597 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.295567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st2t7\" (UniqueName: \"kubernetes.io/projected/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-kube-api-access-st2t7\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.295769 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.295605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-openshift-service-ca\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.295769 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.295639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.396789 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.396751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st2t7\" (UniqueName: \"kubernetes.io/projected/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-kube-api-access-st2t7\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.396954 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.396796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-openshift-service-ca\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.396954 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.396839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.396954 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:58:42.396935    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-87c0b0-serving-cert: secret "maas-api-e2e-api-a-87c0b0-serving-cert" not found
Jul 06 23:58:42.397164 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:58:42.396998    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls podName:b67e1109-58dc-44ad-aa22-f5ad0d6270f9 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:42.896981962 +0000 UTC m=+2038.030974131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls") pod "maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm" (UID: "b67e1109-58dc-44ad-aa22-f5ad0d6270f9") : secret "maas-api-e2e-api-a-87c0b0-serving-cert" not found
Jul 06 23:58:42.397483 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.397460    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-openshift-service-ca\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.406462 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.406438    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st2t7\" (UniqueName: \"kubernetes.io/projected/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-kube-api-access-st2t7\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.900010 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.899977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:42.902688 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:42.902663    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls\") pod \"maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") " pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:43.159076 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:43.158976    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:43.287788 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:43.287756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"]
Jul 06 23:58:43.290790 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:58:43.290761    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67e1109_58dc_44ad_aa22_f5ad0d6270f9.slice/crio-d7c1b5afa9e2dad6ee80b886fddbe7b40b291d38e9363faf7500c9afdef26d61 WatchSource:0}: Error finding container d7c1b5afa9e2dad6ee80b886fddbe7b40b291d38e9363faf7500c9afdef26d61: Status 404 returned error can't find the container with id d7c1b5afa9e2dad6ee80b886fddbe7b40b291d38e9363faf7500c9afdef26d61
Jul 06 23:58:44.161440 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:44.161358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm" event={"ID":"b67e1109-58dc-44ad-aa22-f5ad0d6270f9","Type":"ContainerStarted","Data":"1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5"}
Jul 06 23:58:44.161568 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:44.161472    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:44.161568 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:44.161507    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm" event={"ID":"b67e1109-58dc-44ad-aa22-f5ad0d6270f9","Type":"ContainerStarted","Data":"d7c1b5afa9e2dad6ee80b886fddbe7b40b291d38e9363faf7500c9afdef26d61"}
Jul 06 23:58:44.178542 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:44.178491    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm" podStartSLOduration=1.664924209 podStartE2EDuration="2.178476545s" totalImagesPullingTime="513.552336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:44.176798783 +0000 UTC m=+2039.310790975" watchObservedRunningTime="2026-07-06 23:58:44.178476545 +0000 UTC m=+2039.312468775"
Jul 06 23:58:49.278046 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:49.278013    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:58:50.170611 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.170582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:58:50.292428 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.292402    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"]
Jul 06 23:58:50.295852 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.295828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.298120 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.298099    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-68ab62-serving-cert\""
Jul 06 23:58:50.305871 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.305849    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"]
Jul 06 23:58:50.366217 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.366184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dce5d39-40f5-438b-90b4-4c45674b80bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.366373 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.366229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n48d\" (UniqueName: \"kubernetes.io/projected/6dce5d39-40f5-438b-90b4-4c45674b80bf-kube-api-access-9n48d\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.366373 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.366260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.467264 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.467239    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dce5d39-40f5-438b-90b4-4c45674b80bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.467440 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.467298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n48d\" (UniqueName: \"kubernetes.io/projected/6dce5d39-40f5-438b-90b4-4c45674b80bf-kube-api-access-9n48d\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.467440 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.467358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.467573 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:58:50.467446    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-68ab62-serving-cert: secret "maas-api-e2e-api-b-68ab62-serving-cert" not found
Jul 06 23:58:50.467573 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:58:50.467515    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls podName:6dce5d39-40f5-438b-90b4-4c45674b80bf nodeName:}" failed. No retries permitted until 2026-07-06 23:58:50.967497488 +0000 UTC m=+2046.101489670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls") pod "maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g" (UID: "6dce5d39-40f5-438b-90b4-4c45674b80bf") : secret "maas-api-e2e-api-b-68ab62-serving-cert" not found
Jul 06 23:58:50.467949 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.467925    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dce5d39-40f5-438b-90b4-4c45674b80bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.477803 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.477767    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n48d\" (UniqueName: \"kubernetes.io/projected/6dce5d39-40f5-438b-90b4-4c45674b80bf-kube-api-access-9n48d\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.972661 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.972626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:50.975102 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:50.975073    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls\") pod \"maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") " pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:51.208544 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:51.208511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:51.343213 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:51.343181    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"]
Jul 06 23:58:51.346434 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:58:51.346407    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dce5d39_40f5_438b_90b4_4c45674b80bf.slice/crio-f0eb4e45f24bd72276cc869e99a883c436ee6f004866d262c90b508346f9a261 WatchSource:0}: Error finding container f0eb4e45f24bd72276cc869e99a883c436ee6f004866d262c90b508346f9a261: Status 404 returned error can't find the container with id f0eb4e45f24bd72276cc869e99a883c436ee6f004866d262c90b508346f9a261
Jul 06 23:58:52.206241 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:52.206206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g" event={"ID":"6dce5d39-40f5-438b-90b4-4c45674b80bf","Type":"ContainerStarted","Data":"5648240db764fcfb6e7dd3b6ec4a05d786fbb0bdbe8784f0bae67e02fab47114"}
Jul 06 23:58:52.206469 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:52.206288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g" event={"ID":"6dce5d39-40f5-438b-90b4-4c45674b80bf","Type":"ContainerStarted","Data":"f0eb4e45f24bd72276cc869e99a883c436ee6f004866d262c90b508346f9a261"}
Jul 06 23:58:52.206469 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:52.206322    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:58:52.225180 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:52.225128    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g" podStartSLOduration=1.903887468 podStartE2EDuration="2.225114085s" totalImagesPullingTime="321.226617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:52.223482055 +0000 UTC m=+2047.357474246" watchObservedRunningTime="2026-07-06 23:58:52.225114085 +0000 UTC m=+2047.359106276"
Jul 06 23:58:58.216024 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:58:58.215995    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:59:03.591648 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.591612    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"]
Jul 06 23:59:03.592177 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.591866    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm" podUID="b67e1109-58dc-44ad-aa22-f5ad0d6270f9" containerName="maas-api" containerID="cri-o://1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5" gracePeriod=30
Jul 06 23:59:03.847791 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.847737    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:59:03.981878 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.981844    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-openshift-service-ca\") pod \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") "
Jul 06 23:59:03.981878 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.981885    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st2t7\" (UniqueName: \"kubernetes.io/projected/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-kube-api-access-st2t7\") pod \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") "
Jul 06 23:59:03.982121 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.981914    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls\") pod \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\" (UID: \"b67e1109-58dc-44ad-aa22-f5ad0d6270f9\") "
Jul 06 23:59:03.982259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.982236    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b67e1109-58dc-44ad-aa22-f5ad0d6270f9" (UID: "b67e1109-58dc-44ad-aa22-f5ad0d6270f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:59:03.984237 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.984202    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-kube-api-access-st2t7" (OuterVolumeSpecName: "kube-api-access-st2t7") pod "b67e1109-58dc-44ad-aa22-f5ad0d6270f9" (UID: "b67e1109-58dc-44ad-aa22-f5ad0d6270f9"). InnerVolumeSpecName "kube-api-access-st2t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:59:03.984237 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:03.984208    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b67e1109-58dc-44ad-aa22-f5ad0d6270f9" (UID: "b67e1109-58dc-44ad-aa22-f5ad0d6270f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:59:04.083143 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.083100    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:59:04.083143 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.083132    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st2t7\" (UniqueName: \"kubernetes.io/projected/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-kube-api-access-st2t7\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:59:04.083143 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.083141    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b67e1109-58dc-44ad-aa22-f5ad0d6270f9-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:59:04.260718 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.260687    2579 generic.go:356] "Generic (PLEG): container finished" podID="b67e1109-58dc-44ad-aa22-f5ad0d6270f9" containerID="1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5" exitCode=0
Jul 06 23:59:04.260880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.260743    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"
Jul 06 23:59:04.260880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.260769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm" event={"ID":"b67e1109-58dc-44ad-aa22-f5ad0d6270f9","Type":"ContainerDied","Data":"1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5"}
Jul 06 23:59:04.260880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.260839    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm" event={"ID":"b67e1109-58dc-44ad-aa22-f5ad0d6270f9","Type":"ContainerDied","Data":"d7c1b5afa9e2dad6ee80b886fddbe7b40b291d38e9363faf7500c9afdef26d61"}
Jul 06 23:59:04.260880 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.260860    2579 scope.go:117] "RemoveContainer" containerID="1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5"
Jul 06 23:59:04.269417 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.269401    2579 scope.go:117] "RemoveContainer" containerID="1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5"
Jul 06 23:59:04.269707 ip-10-0-138-34 kubenswrapper[2579]: E0706 23:59:04.269687    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5\": container with ID starting with 1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5 not found: ID does not exist" containerID="1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5"
Jul 06 23:59:04.269760 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.269714    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5"} err="failed to get container status \"1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5\": rpc error: code = NotFound desc = could not find container \"1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5\": container with ID starting with 1a70c6e06d8b7145899af9ee311fbf17ce09e5b9cc126040ad73e95929a636d5 not found: ID does not exist"
Jul 06 23:59:04.281267 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.281248    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"]
Jul 06 23:59:04.286942 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:04.286921    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-87c0b0-85544f64c4-vchfm"]
Jul 06 23:59:05.379643 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:05.379613    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b67e1109-58dc-44ad-aa22-f5ad0d6270f9" path="/var/lib/kubelet/pods/b67e1109-58dc-44ad-aa22-f5ad0d6270f9/volumes"
Jul 06 23:59:06.373905 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:06.373874    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:59:11.134345 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.134310    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"]
Jul 06 23:59:11.134824 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.134586    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g" podUID="6dce5d39-40f5-438b-90b4-4c45674b80bf" containerName="maas-api" containerID="cri-o://5648240db764fcfb6e7dd3b6ec4a05d786fbb0bdbe8784f0bae67e02fab47114" gracePeriod=30
Jul 06 23:59:11.294684 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.294648    2579 generic.go:356] "Generic (PLEG): container finished" podID="6dce5d39-40f5-438b-90b4-4c45674b80bf" containerID="5648240db764fcfb6e7dd3b6ec4a05d786fbb0bdbe8784f0bae67e02fab47114" exitCode=0
Jul 06 23:59:11.294838 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.294694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g" event={"ID":"6dce5d39-40f5-438b-90b4-4c45674b80bf","Type":"ContainerDied","Data":"5648240db764fcfb6e7dd3b6ec4a05d786fbb0bdbe8784f0bae67e02fab47114"}
Jul 06 23:59:11.377269 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.377247    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:59:11.452779 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.452751    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls\") pod \"6dce5d39-40f5-438b-90b4-4c45674b80bf\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") "
Jul 06 23:59:11.452936 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.452812    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n48d\" (UniqueName: \"kubernetes.io/projected/6dce5d39-40f5-438b-90b4-4c45674b80bf-kube-api-access-9n48d\") pod \"6dce5d39-40f5-438b-90b4-4c45674b80bf\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") "
Jul 06 23:59:11.452936 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.452853    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dce5d39-40f5-438b-90b4-4c45674b80bf-openshift-service-ca\") pod \"6dce5d39-40f5-438b-90b4-4c45674b80bf\" (UID: \"6dce5d39-40f5-438b-90b4-4c45674b80bf\") "
Jul 06 23:59:11.453263 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.453238    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dce5d39-40f5-438b-90b4-4c45674b80bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6dce5d39-40f5-438b-90b4-4c45674b80bf" (UID: "6dce5d39-40f5-438b-90b4-4c45674b80bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:59:11.455005 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.454978    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dce5d39-40f5-438b-90b4-4c45674b80bf-kube-api-access-9n48d" (OuterVolumeSpecName: "kube-api-access-9n48d") pod "6dce5d39-40f5-438b-90b4-4c45674b80bf" (UID: "6dce5d39-40f5-438b-90b4-4c45674b80bf"). InnerVolumeSpecName "kube-api-access-9n48d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:59:11.455106 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.455008    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6dce5d39-40f5-438b-90b4-4c45674b80bf" (UID: "6dce5d39-40f5-438b-90b4-4c45674b80bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:59:11.554484 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.554447    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n48d\" (UniqueName: \"kubernetes.io/projected/6dce5d39-40f5-438b-90b4-4c45674b80bf-kube-api-access-9n48d\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:59:11.554484 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.554476    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dce5d39-40f5-438b-90b4-4c45674b80bf-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:59:11.554484 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:11.554486    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dce5d39-40f5-438b-90b4-4c45674b80bf-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 06 23:59:12.300578 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:12.300548    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"
Jul 06 23:59:12.300578 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:12.300573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g" event={"ID":"6dce5d39-40f5-438b-90b4-4c45674b80bf","Type":"ContainerDied","Data":"f0eb4e45f24bd72276cc869e99a883c436ee6f004866d262c90b508346f9a261"}
Jul 06 23:59:12.301039 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:12.300625    2579 scope.go:117] "RemoveContainer" containerID="5648240db764fcfb6e7dd3b6ec4a05d786fbb0bdbe8784f0bae67e02fab47114"
Jul 06 23:59:12.320889 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:12.320860    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"]
Jul 06 23:59:12.324631 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:12.324609    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-68ab62-799c5f655b-ssz5g"]
Jul 06 23:59:13.378967 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:13.378934    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dce5d39-40f5-438b-90b4-4c45674b80bf" path="/var/lib/kubelet/pods/6dce5d39-40f5-438b-90b4-4c45674b80bf/volumes"
Jul 06 23:59:20.380639 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.380608    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:59:20.572205 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.572166    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"]
Jul 06 23:59:20.572617 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.572601    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dce5d39-40f5-438b-90b4-4c45674b80bf" containerName="maas-api"
Jul 06 23:59:20.572669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.572621    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dce5d39-40f5-438b-90b4-4c45674b80bf" containerName="maas-api"
Jul 06 23:59:20.572669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.572633    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b67e1109-58dc-44ad-aa22-f5ad0d6270f9" containerName="maas-api"
Jul 06 23:59:20.572669 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.572639    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b67e1109-58dc-44ad-aa22-f5ad0d6270f9" containerName="maas-api"
Jul 06 23:59:20.572773 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.572704    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dce5d39-40f5-438b-90b4-4c45674b80bf" containerName="maas-api"
Jul 06 23:59:20.572773 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.572715    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b67e1109-58dc-44ad-aa22-f5ad0d6270f9" containerName="maas-api"
Jul 06 23:59:20.575918 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.575896    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.578179 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.578157    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-9ea6e9-serving-cert\""
Jul 06 23:59:20.578179 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.578169    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7q6w\""
Jul 06 23:59:20.583147 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.582901    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"]
Jul 06 23:59:20.739599 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.739562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f19a298-8a22-4789-98cf-e8bc85001a19-maas-api-tls\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.739599 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.739601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f19a298-8a22-4789-98cf-e8bc85001a19-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.739843 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.739628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nshzr\" (UniqueName: \"kubernetes.io/projected/3f19a298-8a22-4789-98cf-e8bc85001a19-kube-api-access-nshzr\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.840314 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.840280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f19a298-8a22-4789-98cf-e8bc85001a19-maas-api-tls\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.840314 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.840317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f19a298-8a22-4789-98cf-e8bc85001a19-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.840589 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.840338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nshzr\" (UniqueName: \"kubernetes.io/projected/3f19a298-8a22-4789-98cf-e8bc85001a19-kube-api-access-nshzr\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.841036 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.841010    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f19a298-8a22-4789-98cf-e8bc85001a19-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.842872 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.842842    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f19a298-8a22-4789-98cf-e8bc85001a19-maas-api-tls\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.853217 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.853194    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nshzr\" (UniqueName: \"kubernetes.io/projected/3f19a298-8a22-4789-98cf-e8bc85001a19-kube-api-access-nshzr\") pod \"maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") " pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:20.887134 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:20.887096    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:21.025031 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:21.025007    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"]
Jul 06 23:59:21.027851 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:59:21.027816    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f19a298_8a22_4789_98cf_e8bc85001a19.slice/crio-c8ea67347e8d5ae5ef16677a2bbffd891be59c79f6afa53548746d21c4390df2 WatchSource:0}: Error finding container c8ea67347e8d5ae5ef16677a2bbffd891be59c79f6afa53548746d21c4390df2: Status 404 returned error can't find the container with id c8ea67347e8d5ae5ef16677a2bbffd891be59c79f6afa53548746d21c4390df2
Jul 06 23:59:21.343857 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:21.343773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x" event={"ID":"3f19a298-8a22-4789-98cf-e8bc85001a19","Type":"ContainerStarted","Data":"c8ea67347e8d5ae5ef16677a2bbffd891be59c79f6afa53548746d21c4390df2"}
Jul 06 23:59:22.349982 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:22.349948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x" event={"ID":"3f19a298-8a22-4789-98cf-e8bc85001a19","Type":"ContainerStarted","Data":"1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e"}
Jul 06 23:59:22.350384 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:22.350075    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:22.366738 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:22.366680    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x" podStartSLOduration=2.03969231 podStartE2EDuration="2.366659552s" totalImagesPullingTime="326.967242ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:22.365632925 +0000 UTC m=+2077.499625116" watchObservedRunningTime="2026-07-06 23:59:22.366659552 +0000 UTC m=+2077.500651744"
Jul 06 23:59:28.360410 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.360359    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 06 23:59:28.589712 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.589676    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"]
Jul 06 23:59:28.593200 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.593178    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.598580 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.598548    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-a1e3a6-serving-cert\""
Jul 06 23:59:28.607259 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.607232    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"]
Jul 06 23:59:28.607650 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.607621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4gps\" (UniqueName: \"kubernetes.io/projected/6e3f2a4e-b80f-40eb-a858-554395bb3e26-kube-api-access-v4gps\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.607751 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.607736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e3f2a4e-b80f-40eb-a858-554395bb3e26-maas-api-tls\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.607816 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.607757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3f2a4e-b80f-40eb-a858-554395bb3e26-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.708798 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.708763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4gps\" (UniqueName: \"kubernetes.io/projected/6e3f2a4e-b80f-40eb-a858-554395bb3e26-kube-api-access-v4gps\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.709009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.708837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e3f2a4e-b80f-40eb-a858-554395bb3e26-maas-api-tls\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.709009 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.708864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3f2a4e-b80f-40eb-a858-554395bb3e26-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.709551 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.709526    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3f2a4e-b80f-40eb-a858-554395bb3e26-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.711469 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.711449    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e3f2a4e-b80f-40eb-a858-554395bb3e26-maas-api-tls\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.717164 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.717133    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4gps\" (UniqueName: \"kubernetes.io/projected/6e3f2a4e-b80f-40eb-a858-554395bb3e26-kube-api-access-v4gps\") pod \"maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") " pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:28.904239 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:28.904200    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:29.042093 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:29.042070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"]
Jul 06 23:59:29.044479 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:59:29.044452    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3f2a4e_b80f_40eb_a858_554395bb3e26.slice/crio-d7bf678cf04f736205a8aa6652f6e280c50ee3077fbe19f5183b031ddae827d0 WatchSource:0}: Error finding container d7bf678cf04f736205a8aa6652f6e280c50ee3077fbe19f5183b031ddae827d0: Status 404 returned error can't find the container with id d7bf678cf04f736205a8aa6652f6e280c50ee3077fbe19f5183b031ddae827d0
Jul 06 23:59:29.382797 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:29.382761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f" event={"ID":"6e3f2a4e-b80f-40eb-a858-554395bb3e26","Type":"ContainerStarted","Data":"d7bf678cf04f736205a8aa6652f6e280c50ee3077fbe19f5183b031ddae827d0"}
Jul 06 23:59:30.388521 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:30.388483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f" event={"ID":"6e3f2a4e-b80f-40eb-a858-554395bb3e26","Type":"ContainerStarted","Data":"35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62"}
Jul 06 23:59:30.388974 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:30.388534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:30.405621 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:30.405575    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f" podStartSLOduration=2.085452073 podStartE2EDuration="2.405559611s" totalImagesPullingTime="320.107538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:30.404030987 +0000 UTC m=+2085.538023180" watchObservedRunningTime="2026-07-06 23:59:30.405559611 +0000 UTC m=+2085.539551802"
Jul 06 23:59:32.667096 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:32.667039    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:59:36.398921 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:36.398890    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 06 23:59:40.465707 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.465673    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"]
Jul 06 23:59:40.469393 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.469371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.472284 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.472263    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9ea6e9\"/\"openshift-service-ca.crt\""
Jul 06 23:59:40.472381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.472284    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9ea6e9\"/\"kube-root-ca.crt\""
Jul 06 23:59:40.472381 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.472303    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ea6e9\"/\"default-dockercfg-9h5qd\""
Jul 06 23:59:40.472469 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.472307    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ea6e9\"/\"auth-test-model-9ea6e9-kserve-self-signed-certs\""
Jul 06 23:59:40.476270 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.476249    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"]
Jul 06 23:59:40.517264 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.517227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-dshm\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.517445 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.517270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tls-certs\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.517445 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.517296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8297\" (UniqueName: \"kubernetes.io/projected/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-kube-api-access-z8297\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.517445 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.517431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-model-cache\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.517599 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.517469    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-home\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.517599 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.517493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tmp-dir\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618252 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-model-cache\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618434 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-home\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618434 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tmp-dir\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618434 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-dshm\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618434 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tls-certs\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618434 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8297\" (UniqueName: \"kubernetes.io/projected/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-kube-api-access-z8297\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618698 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618657    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-model-cache\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618833 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618808    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tmp-dir\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.618904 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.618832    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-home\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.620832 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.620803    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-dshm\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.621200 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.621180    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tls-certs\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.630090 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.630042    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8297\" (UniqueName: \"kubernetes.io/projected/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-kube-api-access-z8297\") pod \"auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") " pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.780358 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.780268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:40.921809 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:40.921782    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"]
Jul 06 23:59:40.924290 ip-10-0-138-34 kubenswrapper[2579]: W0706 23:59:40.924267    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b3be10d_0aac_405a_b6cb_74a9b65f56d1.slice/crio-6f8da38d64e1e7e10148e533cfe51a987207dae3e8f4c9f9f6f42dab358359ff WatchSource:0}: Error finding container 6f8da38d64e1e7e10148e533cfe51a987207dae3e8f4c9f9f6f42dab358359ff: Status 404 returned error can't find the container with id 6f8da38d64e1e7e10148e533cfe51a987207dae3e8f4c9f9f6f42dab358359ff
Jul 06 23:59:41.444631 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:41.444596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r" event={"ID":"2b3be10d-0aac-405a-b6cb-74a9b65f56d1","Type":"ContainerStarted","Data":"7ee1c527447be291c6573c90d0512287a8ffe6f2b2d63d0b5b4379d150b78cd9"}
Jul 06 23:59:41.444631 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:41.444635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r" event={"ID":"2b3be10d-0aac-405a-b6cb-74a9b65f56d1","Type":"ContainerStarted","Data":"6f8da38d64e1e7e10148e533cfe51a987207dae3e8f4c9f9f6f42dab358359ff"}
Jul 06 23:59:41.460646 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:41.460599    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r" podStartSLOduration=1.460586776 podStartE2EDuration="1.460586776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:41.459363573 +0000 UTC m=+2096.593355766" watchObservedRunningTime="2026-07-06 23:59:41.460586776 +0000 UTC m=+2096.594578966"
Jul 06 23:59:45.402863 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:45.402837    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:59:45.406829 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:45.406809    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 06 23:59:47.461290 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:47.461255    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 06 23:59:50.780473 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:50.780442    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:50.780840 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:50.780491    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:50.792961 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:50.792931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 06 23:59:51.501998 ip-10-0-138-34 kubenswrapper[2579]: I0706 23:59:51.501970    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 07 00:00:00.142125 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.142084    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"]
Jul 07 00:00:00.145669 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.145647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"
Jul 07 00:00:00.154504 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.154481    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"]
Jul 07 00:00:00.289234 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.289199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf84b\" (UniqueName: \"kubernetes.io/projected/4c948f20-be97-4691-a2b9-bd460e97fd4f-kube-api-access-cf84b\") pod \"maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z\" (UID: \"4c948f20-be97-4691-a2b9-bd460e97fd4f\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"
Jul 07 00:00:00.390670 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.390630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf84b\" (UniqueName: \"kubernetes.io/projected/4c948f20-be97-4691-a2b9-bd460e97fd4f-kube-api-access-cf84b\") pod \"maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z\" (UID: \"4c948f20-be97-4691-a2b9-bd460e97fd4f\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"
Jul 07 00:00:00.402484 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.402406    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf84b\" (UniqueName: \"kubernetes.io/projected/4c948f20-be97-4691-a2b9-bd460e97fd4f-kube-api-access-cf84b\") pod \"maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z\" (UID: \"4c948f20-be97-4691-a2b9-bd460e97fd4f\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"
Jul 07 00:00:00.473356 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.473321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"
Jul 07 00:00:00.607649 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.607615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"]
Jul 07 00:00:00.611315 ip-10-0-138-34 kubenswrapper[2579]: W0707 00:00:00.611280    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c948f20_be97_4691_a2b9_bd460e97fd4f.slice/crio-447eaa21b0cc3f715bd96d34c55faf22905cef1514242da2442d7d5df707bc2e WatchSource:0}: Error finding container 447eaa21b0cc3f715bd96d34c55faf22905cef1514242da2442d7d5df707bc2e: Status 404 returned error can't find the container with id 447eaa21b0cc3f715bd96d34c55faf22905cef1514242da2442d7d5df707bc2e
Jul 07 00:00:00.671868 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:00.671789    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:00:01.539509 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:01.539481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z" event={"ID":"4c948f20-be97-4691-a2b9-bd460e97fd4f","Type":"ContainerStarted","Data":"44ff1a4b68abe5ed0000e3628eaf932a16cb35310f4b9d25086d603d012356c0"}
Jul 07 00:00:01.539837 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:01.539544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z" event={"ID":"4c948f20-be97-4691-a2b9-bd460e97fd4f","Type":"ContainerStarted","Data":"447eaa21b0cc3f715bd96d34c55faf22905cef1514242da2442d7d5df707bc2e"}
Jul 07 00:00:02.546032 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:02.545939    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c948f20-be97-4691-a2b9-bd460e97fd4f" containerID="44ff1a4b68abe5ed0000e3628eaf932a16cb35310f4b9d25086d603d012356c0" exitCode=0
Jul 07 00:00:02.546032 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:02.546023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z" event={"ID":"4c948f20-be97-4691-a2b9-bd460e97fd4f","Type":"ContainerDied","Data":"44ff1a4b68abe5ed0000e3628eaf932a16cb35310f4b9d25086d603d012356c0"}
Jul 07 00:00:02.684713 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:02.684690    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"
Jul 07 00:00:02.813342 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:02.813232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf84b\" (UniqueName: \"kubernetes.io/projected/4c948f20-be97-4691-a2b9-bd460e97fd4f-kube-api-access-cf84b\") pod \"4c948f20-be97-4691-a2b9-bd460e97fd4f\" (UID: \"4c948f20-be97-4691-a2b9-bd460e97fd4f\") "
Jul 07 00:00:02.815629 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:02.815604    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c948f20-be97-4691-a2b9-bd460e97fd4f-kube-api-access-cf84b" (OuterVolumeSpecName: "kube-api-access-cf84b") pod "4c948f20-be97-4691-a2b9-bd460e97fd4f" (UID: "4c948f20-be97-4691-a2b9-bd460e97fd4f"). InnerVolumeSpecName "kube-api-access-cf84b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:00:02.914478 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:02.914449    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf84b\" (UniqueName: \"kubernetes.io/projected/4c948f20-be97-4691-a2b9-bd460e97fd4f-kube-api-access-cf84b\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.552071 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:03.552022    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"
Jul 07 00:00:03.552071 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:03.552040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z" event={"ID":"4c948f20-be97-4691-a2b9-bd460e97fd4f","Type":"ContainerDied","Data":"447eaa21b0cc3f715bd96d34c55faf22905cef1514242da2442d7d5df707bc2e"}
Jul 07 00:00:03.552500 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:03.552146    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="447eaa21b0cc3f715bd96d34c55faf22905cef1514242da2442d7d5df707bc2e"
Jul 07 00:00:22.973292 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:22.973253    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:00:39.261692 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:39.261658    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:00:53.969610 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:00:53.969577    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:01:09.379357 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:01:09.379329    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:01:26.868410 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:01:26.868374    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:01:44.370514 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:01:44.370472    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:01:57.890833 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:01:57.890775    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"]
Jul 07 00:02:00.475982 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:00.475946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:02:08.881105 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.881049    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"]
Jul 07 00:02:08.881464 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.881410    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c948f20-be97-4691-a2b9-bd460e97fd4f" containerName="cleanup"
Jul 07 00:02:08.881464 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.881420    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c948f20-be97-4691-a2b9-bd460e97fd4f" containerName="cleanup"
Jul 07 00:02:08.881539 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.881485    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c948f20-be97-4691-a2b9-bd460e97fd4f" containerName="cleanup"
Jul 07 00:02:08.884362 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.884346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:08.886627 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.886604    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ea6e9\"/\"sub-test-model-9ea6e9-kserve-self-signed-certs\""
Jul 07 00:02:08.892478 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.892454    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"]
Jul 07 00:02:08.997228 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.997195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-home\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:08.997382 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.997237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64n67\" (UniqueName: \"kubernetes.io/projected/7f1aa5b2-319e-4a8e-8960-1f35f160a698-kube-api-access-64n67\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:08.997382 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.997323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tmp-dir\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:08.997382 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.997351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-dshm\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:08.997492 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.997389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-model-cache\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:08.997492 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:08.997420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tls-certs\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098078 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-model-cache\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098270 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tls-certs\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098270 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-home\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098270 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64n67\" (UniqueName: \"kubernetes.io/projected/7f1aa5b2-319e-4a8e-8960-1f35f160a698-kube-api-access-64n67\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098270 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tmp-dir\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098270 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-dshm\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098541 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098517    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-model-cache\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098594 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098557    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-home\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.098633 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.098616    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tmp-dir\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.100741 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.100704    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-dshm\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.100867 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.100793    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tls-certs\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.106445 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.106422    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64n67\" (UniqueName: \"kubernetes.io/projected/7f1aa5b2-319e-4a8e-8960-1f35f160a698-kube-api-access-64n67\") pod \"sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") " pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.194147 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.194120    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:09.328557 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:09.328318    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"]
Jul 07 00:02:09.330931 ip-10-0-138-34 kubenswrapper[2579]: W0707 00:02:09.330902    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f1aa5b2_319e_4a8e_8960_1f35f160a698.slice/crio-b9220807db81a9fa090b220362295511353df0765fa91a6720605a126dd62112 WatchSource:0}: Error finding container b9220807db81a9fa090b220362295511353df0765fa91a6720605a126dd62112: Status 404 returned error can't find the container with id b9220807db81a9fa090b220362295511353df0765fa91a6720605a126dd62112
Jul 07 00:02:10.142205 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:10.142166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv" event={"ID":"7f1aa5b2-319e-4a8e-8960-1f35f160a698","Type":"ContainerStarted","Data":"8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61"}
Jul 07 00:02:10.142635 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:10.142219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv" event={"ID":"7f1aa5b2-319e-4a8e-8960-1f35f160a698","Type":"ContainerStarted","Data":"b9220807db81a9fa090b220362295511353df0765fa91a6720605a126dd62112"}
Jul 07 00:02:10.159443 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:10.159397    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv" podStartSLOduration=2.159382934 podStartE2EDuration="2.159382934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:02:10.157095683 +0000 UTC m=+2245.291087873" watchObservedRunningTime="2026-07-07 00:02:10.159382934 +0000 UTC m=+2245.293375310"
Jul 07 00:02:12.914624 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:12.914574    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r" podUID="2b3be10d-0aac-405a-b6cb-74a9b65f56d1" containerName="main" containerID="cri-o://7ee1c527447be291c6573c90d0512287a8ffe6f2b2d63d0b5b4379d150b78cd9" gracePeriod=45
Jul 07 00:02:13.156719 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.156688    2579 generic.go:356] "Generic (PLEG): container finished" podID="2b3be10d-0aac-405a-b6cb-74a9b65f56d1" containerID="7ee1c527447be291c6573c90d0512287a8ffe6f2b2d63d0b5b4379d150b78cd9" exitCode=0
Jul 07 00:02:13.156837 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.156755    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r" event={"ID":"2b3be10d-0aac-405a-b6cb-74a9b65f56d1","Type":"ContainerDied","Data":"7ee1c527447be291c6573c90d0512287a8ffe6f2b2d63d0b5b4379d150b78cd9"}
Jul 07 00:02:13.171511 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.171464    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 07 00:02:13.239675 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.239645    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-dshm\") pod \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") "
Jul 07 00:02:13.239832 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.239707    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-home\") pod \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") "
Jul 07 00:02:13.239832 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.239732    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tmp-dir\") pod \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") "
Jul 07 00:02:13.239832 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.239758    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8297\" (UniqueName: \"kubernetes.io/projected/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-kube-api-access-z8297\") pod \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") "
Jul 07 00:02:13.239832 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.239774    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tls-certs\") pod \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") "
Jul 07 00:02:13.239832 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.239788    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-model-cache\") pod \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\" (UID: \"2b3be10d-0aac-405a-b6cb-74a9b65f56d1\") "
Jul 07 00:02:13.240116 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.240004    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-home" (OuterVolumeSpecName: "home") pod "2b3be10d-0aac-405a-b6cb-74a9b65f56d1" (UID: "2b3be10d-0aac-405a-b6cb-74a9b65f56d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:02:13.240116 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.240020    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b3be10d-0aac-405a-b6cb-74a9b65f56d1" (UID: "2b3be10d-0aac-405a-b6cb-74a9b65f56d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:02:13.240220 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.240144    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-home\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:02:13.240220 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.240161    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tmp-dir\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:02:13.240220 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.240153    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b3be10d-0aac-405a-b6cb-74a9b65f56d1" (UID: "2b3be10d-0aac-405a-b6cb-74a9b65f56d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:02:13.241980 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.241950    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-kube-api-access-z8297" (OuterVolumeSpecName: "kube-api-access-z8297") pod "2b3be10d-0aac-405a-b6cb-74a9b65f56d1" (UID: "2b3be10d-0aac-405a-b6cb-74a9b65f56d1"). InnerVolumeSpecName "kube-api-access-z8297". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:02:13.241980 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.241957    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b3be10d-0aac-405a-b6cb-74a9b65f56d1" (UID: "2b3be10d-0aac-405a-b6cb-74a9b65f56d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:02:13.242193 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.242002    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-dshm" (OuterVolumeSpecName: "dshm") pod "2b3be10d-0aac-405a-b6cb-74a9b65f56d1" (UID: "2b3be10d-0aac-405a-b6cb-74a9b65f56d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:02:13.341241 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.341211    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-dshm\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:02:13.341241 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.341236    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8297\" (UniqueName: \"kubernetes.io/projected/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-kube-api-access-z8297\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:02:13.341241 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.341247    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-tls-certs\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:02:13.341489 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.341257    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3be10d-0aac-405a-b6cb-74a9b65f56d1-model-cache\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:02:13.768626 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:13.768596    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:02:14.162563 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:14.162485    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"
Jul 07 00:02:14.162563 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:14.162523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r" event={"ID":"2b3be10d-0aac-405a-b6cb-74a9b65f56d1","Type":"ContainerDied","Data":"6f8da38d64e1e7e10148e533cfe51a987207dae3e8f4c9f9f6f42dab358359ff"}
Jul 07 00:02:14.163008 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:14.162577    2579 scope.go:117] "RemoveContainer" containerID="7ee1c527447be291c6573c90d0512287a8ffe6f2b2d63d0b5b4379d150b78cd9"
Jul 07 00:02:14.177885 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:14.177860    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"]
Jul 07 00:02:14.181339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:14.181318    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/auth-test-model-9ea6e9-kserve-68569d64f9-xvr5r"]
Jul 07 00:02:15.380250 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:15.380219    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3be10d-0aac-405a-b6cb-74a9b65f56d1" path="/var/lib/kubelet/pods/2b3be10d-0aac-405a-b6cb-74a9b65f56d1/volumes"
Jul 07 00:02:19.194794 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:19.194760    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:19.195282 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:19.195010    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:19.207208 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:19.207185    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:20.202591 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:20.202563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:02:32.869426 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:32.869389    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:02:46.969622 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:02:46.969583    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:03:05.172268 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:05.172226    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:03:11.915050 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:11.915015    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"]
Jul 07 00:03:15.471973 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.471939    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"]
Jul 07 00:03:15.472351 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.472292    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3be10d-0aac-405a-b6cb-74a9b65f56d1" containerName="main"
Jul 07 00:03:15.472351 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.472304    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3be10d-0aac-405a-b6cb-74a9b65f56d1" containerName="main"
Jul 07 00:03:15.472428 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.472374    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3be10d-0aac-405a-b6cb-74a9b65f56d1" containerName="main"
Jul 07 00:03:15.475532 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.475514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.477615 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.477585    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ea6e9\"/\"rate-test-model-9ea6e9-kserve-self-signed-certs\""
Jul 07 00:03:15.484008 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.483984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"]
Jul 07 00:03:15.580242 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.580205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-tmp-dir\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.580242 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.580241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx4g2\" (UniqueName: \"kubernetes.io/projected/feb1750c-5970-40ab-bc59-ec68e229c02a-kube-api-access-jx4g2\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.580463 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.580280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feb1750c-5970-40ab-bc59-ec68e229c02a-tls-certs\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.580463 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.580335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-home\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.580463 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.580350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-dshm\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.580463 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.580369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-model-cache\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.681581 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.681546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-tmp-dir\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.681581 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.681581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx4g2\" (UniqueName: \"kubernetes.io/projected/feb1750c-5970-40ab-bc59-ec68e229c02a-kube-api-access-jx4g2\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.681804 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.681615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feb1750c-5970-40ab-bc59-ec68e229c02a-tls-certs\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.681804 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.681653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-home\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.681804 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.681670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-dshm\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.681804 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.681684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-model-cache\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.682050 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.682024    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-tmp-dir\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.682131 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.682087    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-model-cache\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.682131 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.682103    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-home\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.684209 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.684190    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-dshm\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.684382 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.684366    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feb1750c-5970-40ab-bc59-ec68e229c02a-tls-certs\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.689269 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.689250    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx4g2\" (UniqueName: \"kubernetes.io/projected/feb1750c-5970-40ab-bc59-ec68e229c02a-kube-api-access-jx4g2\") pod \"rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") " pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.786126 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.786029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:15.923724 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:15.923702    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"]
Jul 07 00:03:15.925812 ip-10-0-138-34 kubenswrapper[2579]: W0707 00:03:15.925785    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfeb1750c_5970_40ab_bc59_ec68e229c02a.slice/crio-18097c09c9d1c64a95a4bd9632386d3f9ff27fd71fd43f71d444a8ccbeb5737f WatchSource:0}: Error finding container 18097c09c9d1c64a95a4bd9632386d3f9ff27fd71fd43f71d444a8ccbeb5737f: Status 404 returned error can't find the container with id 18097c09c9d1c64a95a4bd9632386d3f9ff27fd71fd43f71d444a8ccbeb5737f
Jul 07 00:03:16.444225 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:16.444190    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx" event={"ID":"feb1750c-5970-40ab-bc59-ec68e229c02a","Type":"ContainerStarted","Data":"abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a"}
Jul 07 00:03:16.444395 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:16.444232    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx" event={"ID":"feb1750c-5970-40ab-bc59-ec68e229c02a","Type":"ContainerStarted","Data":"18097c09c9d1c64a95a4bd9632386d3f9ff27fd71fd43f71d444a8ccbeb5737f"}
Jul 07 00:03:16.459874 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:16.459826    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx" podStartSLOduration=1.459811146 podStartE2EDuration="1.459811146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:16.458961972 +0000 UTC m=+2311.592954170" watchObservedRunningTime="2026-07-07 00:03:16.459811146 +0000 UTC m=+2311.593803338"
Jul 07 00:03:23.268567 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:23.268523    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:03:25.787042 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:25.786996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:25.787470 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:25.787079    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:25.799774 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:25.799748    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:26.500944 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:26.500917    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:03:26.938909 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:26.938792    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv" podUID="7f1aa5b2-319e-4a8e-8960-1f35f160a698" containerName="main" containerID="cri-o://8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61" gracePeriod=45
Jul 07 00:03:27.179288 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.179265    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:03:27.282402 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282372    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tmp-dir\") pod \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") "
Jul 07 00:03:27.282402 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-model-cache\") pod \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") "
Jul 07 00:03:27.282662 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282456    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64n67\" (UniqueName: \"kubernetes.io/projected/7f1aa5b2-319e-4a8e-8960-1f35f160a698-kube-api-access-64n67\") pod \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") "
Jul 07 00:03:27.282662 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-home\") pod \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") "
Jul 07 00:03:27.282662 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282532    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tls-certs\") pod \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") "
Jul 07 00:03:27.282662 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282566    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-dshm\") pod \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\" (UID: \"7f1aa5b2-319e-4a8e-8960-1f35f160a698\") "
Jul 07 00:03:27.282864 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282693    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7f1aa5b2-319e-4a8e-8960-1f35f160a698" (UID: "7f1aa5b2-319e-4a8e-8960-1f35f160a698"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:03:27.282864 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282737    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-model-cache" (OuterVolumeSpecName: "model-cache") pod "7f1aa5b2-319e-4a8e-8960-1f35f160a698" (UID: "7f1aa5b2-319e-4a8e-8960-1f35f160a698"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:03:27.282864 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282757    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-home" (OuterVolumeSpecName: "home") pod "7f1aa5b2-319e-4a8e-8960-1f35f160a698" (UID: "7f1aa5b2-319e-4a8e-8960-1f35f160a698"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:03:27.282864 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282856    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-home\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:03:27.283041 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282875    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tmp-dir\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:03:27.283041 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.282888    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-model-cache\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:03:27.284733 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.284711    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7f1aa5b2-319e-4a8e-8960-1f35f160a698" (UID: "7f1aa5b2-319e-4a8e-8960-1f35f160a698"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:03:27.284872 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.284741    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-dshm" (OuterVolumeSpecName: "dshm") pod "7f1aa5b2-319e-4a8e-8960-1f35f160a698" (UID: "7f1aa5b2-319e-4a8e-8960-1f35f160a698"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:03:27.284872 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.284761    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1aa5b2-319e-4a8e-8960-1f35f160a698-kube-api-access-64n67" (OuterVolumeSpecName: "kube-api-access-64n67") pod "7f1aa5b2-319e-4a8e-8960-1f35f160a698" (UID: "7f1aa5b2-319e-4a8e-8960-1f35f160a698"). InnerVolumeSpecName "kube-api-access-64n67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:03:27.383378 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.383339    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1aa5b2-319e-4a8e-8960-1f35f160a698-tls-certs\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:03:27.383378 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.383363    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1aa5b2-319e-4a8e-8960-1f35f160a698-dshm\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:03:27.383378 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.383372    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64n67\" (UniqueName: \"kubernetes.io/projected/7f1aa5b2-319e-4a8e-8960-1f35f160a698-kube-api-access-64n67\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:03:27.496521 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.496493    2579 generic.go:356] "Generic (PLEG): container finished" podID="7f1aa5b2-319e-4a8e-8960-1f35f160a698" containerID="8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61" exitCode=0
Jul 07 00:03:27.496693 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.496528    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"
Jul 07 00:03:27.496693 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.496579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv" event={"ID":"7f1aa5b2-319e-4a8e-8960-1f35f160a698","Type":"ContainerDied","Data":"8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61"}
Jul 07 00:03:27.496693 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.496625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv" event={"ID":"7f1aa5b2-319e-4a8e-8960-1f35f160a698","Type":"ContainerDied","Data":"b9220807db81a9fa090b220362295511353df0765fa91a6720605a126dd62112"}
Jul 07 00:03:27.496693 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.496646    2579 scope.go:117] "RemoveContainer" containerID="8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61"
Jul 07 00:03:27.506572 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.506550    2579 scope.go:117] "RemoveContainer" containerID="8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61"
Jul 07 00:03:27.506932 ip-10-0-138-34 kubenswrapper[2579]: E0707 00:03:27.506902    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61\": container with ID starting with 8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61 not found: ID does not exist" containerID="8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61"
Jul 07 00:03:27.507022 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.506943    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61"} err="failed to get container status \"8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61\": rpc error: code = NotFound desc = could not find container \"8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61\": container with ID starting with 8267dbff037687e5bbb406b1a491636227673a3f46acba4cd6d3f9b350d04c61 not found: ID does not exist"
Jul 07 00:03:27.515652 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.515619    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"]
Jul 07 00:03:27.517213 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:27.517194    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/sub-test-model-9ea6e9-kserve-6b4744d75c-x5qzv"]
Jul 07 00:03:29.380345 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:29.380316    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f1aa5b2-319e-4a8e-8960-1f35f160a698" path="/var/lib/kubelet/pods/7f1aa5b2-319e-4a8e-8960-1f35f160a698/volumes"
Jul 07 00:03:50.971186 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:03:50.971153    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:04:04.765048 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:04.765007    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:04:24.466928 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:24.466883    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:04:29.116172 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:29.116139    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"]
Jul 07 00:04:31.777391 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:31.777348    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"]
Jul 07 00:04:31.777870 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:31.777603    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x" podUID="3f19a298-8a22-4789-98cf-e8bc85001a19" containerName="maas-api" containerID="cri-o://1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e" gracePeriod=30
Jul 07 00:04:32.020470 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.020444    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 07 00:04:32.033478 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.033424    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nshzr\" (UniqueName: \"kubernetes.io/projected/3f19a298-8a22-4789-98cf-e8bc85001a19-kube-api-access-nshzr\") pod \"3f19a298-8a22-4789-98cf-e8bc85001a19\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") "
Jul 07 00:04:32.033478 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.033466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f19a298-8a22-4789-98cf-e8bc85001a19-openshift-service-ca\") pod \"3f19a298-8a22-4789-98cf-e8bc85001a19\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") "
Jul 07 00:04:32.033653 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.033503    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f19a298-8a22-4789-98cf-e8bc85001a19-maas-api-tls\") pod \"3f19a298-8a22-4789-98cf-e8bc85001a19\" (UID: \"3f19a298-8a22-4789-98cf-e8bc85001a19\") "
Jul 07 00:04:32.033876 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.033850    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f19a298-8a22-4789-98cf-e8bc85001a19-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f19a298-8a22-4789-98cf-e8bc85001a19" (UID: "3f19a298-8a22-4789-98cf-e8bc85001a19"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:04:32.035658 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.035638    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f19a298-8a22-4789-98cf-e8bc85001a19-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f19a298-8a22-4789-98cf-e8bc85001a19" (UID: "3f19a298-8a22-4789-98cf-e8bc85001a19"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:04:32.035726 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.035711    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f19a298-8a22-4789-98cf-e8bc85001a19-kube-api-access-nshzr" (OuterVolumeSpecName: "kube-api-access-nshzr") pod "3f19a298-8a22-4789-98cf-e8bc85001a19" (UID: "3f19a298-8a22-4789-98cf-e8bc85001a19"). InnerVolumeSpecName "kube-api-access-nshzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:04:32.134701 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.134663    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f19a298-8a22-4789-98cf-e8bc85001a19-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:32.134701 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.134696    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nshzr\" (UniqueName: \"kubernetes.io/projected/3f19a298-8a22-4789-98cf-e8bc85001a19-kube-api-access-nshzr\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:32.134701 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.134709    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f19a298-8a22-4789-98cf-e8bc85001a19-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:32.798453 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.798416    2579 generic.go:356] "Generic (PLEG): container finished" podID="3f19a298-8a22-4789-98cf-e8bc85001a19" containerID="1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e" exitCode=0
Jul 07 00:04:32.798933 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.798459    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"
Jul 07 00:04:32.798933 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.798503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x" event={"ID":"3f19a298-8a22-4789-98cf-e8bc85001a19","Type":"ContainerDied","Data":"1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e"}
Jul 07 00:04:32.798933 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.798564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x" event={"ID":"3f19a298-8a22-4789-98cf-e8bc85001a19","Type":"ContainerDied","Data":"c8ea67347e8d5ae5ef16677a2bbffd891be59c79f6afa53548746d21c4390df2"}
Jul 07 00:04:32.798933 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.798596    2579 scope.go:117] "RemoveContainer" containerID="1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e"
Jul 07 00:04:32.807883 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.807865    2579 scope.go:117] "RemoveContainer" containerID="1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e"
Jul 07 00:04:32.808197 ip-10-0-138-34 kubenswrapper[2579]: E0707 00:04:32.808174    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e\": container with ID starting with 1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e not found: ID does not exist" containerID="1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e"
Jul 07 00:04:32.808268 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.808205    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e"} err="failed to get container status \"1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e\": rpc error: code = NotFound desc = could not find container \"1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e\": container with ID starting with 1387d360e94bd1254b0b2ca82727c3ab410483da3203ba267c06289f63abc73e not found: ID does not exist"
Jul 07 00:04:32.819841 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.819817    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"]
Jul 07 00:04:32.823160 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:32.823141    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9ea6e9-569cbcf47b-qnq7x"]
Jul 07 00:04:33.380038 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:33.380004    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f19a298-8a22-4789-98cf-e8bc85001a19" path="/var/lib/kubelet/pods/3f19a298-8a22-4789-98cf-e8bc85001a19/volumes"
Jul 07 00:04:34.965921 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:34.965883    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:04:44.138363 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.138324    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx" podUID="feb1750c-5970-40ab-bc59-ec68e229c02a" containerName="main" containerID="cri-o://abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a" gracePeriod=45
Jul 07 00:04:44.395586 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.395530    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:04:44.427961 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.427938    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-home\") pod \"feb1750c-5970-40ab-bc59-ec68e229c02a\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") "
Jul 07 00:04:44.428094 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.427991    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-dshm\") pod \"feb1750c-5970-40ab-bc59-ec68e229c02a\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") "
Jul 07 00:04:44.428094 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428014    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx4g2\" (UniqueName: \"kubernetes.io/projected/feb1750c-5970-40ab-bc59-ec68e229c02a-kube-api-access-jx4g2\") pod \"feb1750c-5970-40ab-bc59-ec68e229c02a\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") "
Jul 07 00:04:44.428094 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428033    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-tmp-dir\") pod \"feb1750c-5970-40ab-bc59-ec68e229c02a\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") "
Jul 07 00:04:44.428094 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-model-cache\") pod \"feb1750c-5970-40ab-bc59-ec68e229c02a\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") "
Jul 07 00:04:44.428094 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428095    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feb1750c-5970-40ab-bc59-ec68e229c02a-tls-certs\") pod \"feb1750c-5970-40ab-bc59-ec68e229c02a\" (UID: \"feb1750c-5970-40ab-bc59-ec68e229c02a\") "
Jul 07 00:04:44.428357 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428237    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-home" (OuterVolumeSpecName: "home") pod "feb1750c-5970-40ab-bc59-ec68e229c02a" (UID: "feb1750c-5970-40ab-bc59-ec68e229c02a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:04:44.428357 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428300    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-model-cache" (OuterVolumeSpecName: "model-cache") pod "feb1750c-5970-40ab-bc59-ec68e229c02a" (UID: "feb1750c-5970-40ab-bc59-ec68e229c02a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:04:44.428357 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428321    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "feb1750c-5970-40ab-bc59-ec68e229c02a" (UID: "feb1750c-5970-40ab-bc59-ec68e229c02a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:04:44.428507 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428428    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-tmp-dir\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:44.428507 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428453    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-model-cache\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:44.428507 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.428467    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-home\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:44.430284 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.430255    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb1750c-5970-40ab-bc59-ec68e229c02a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "feb1750c-5970-40ab-bc59-ec68e229c02a" (UID: "feb1750c-5970-40ab-bc59-ec68e229c02a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:04:44.430638 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.430614    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb1750c-5970-40ab-bc59-ec68e229c02a-kube-api-access-jx4g2" (OuterVolumeSpecName: "kube-api-access-jx4g2") pod "feb1750c-5970-40ab-bc59-ec68e229c02a" (UID: "feb1750c-5970-40ab-bc59-ec68e229c02a"). InnerVolumeSpecName "kube-api-access-jx4g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:04:44.430638 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.430627    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-dshm" (OuterVolumeSpecName: "dshm") pod "feb1750c-5970-40ab-bc59-ec68e229c02a" (UID: "feb1750c-5970-40ab-bc59-ec68e229c02a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:04:44.529862 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.529825    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feb1750c-5970-40ab-bc59-ec68e229c02a-dshm\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:44.529862 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.529858    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx4g2\" (UniqueName: \"kubernetes.io/projected/feb1750c-5970-40ab-bc59-ec68e229c02a-kube-api-access-jx4g2\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:44.530069 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.529874    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feb1750c-5970-40ab-bc59-ec68e229c02a-tls-certs\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:04:44.862319 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.862285    2579 generic.go:356] "Generic (PLEG): container finished" podID="feb1750c-5970-40ab-bc59-ec68e229c02a" containerID="abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a" exitCode=0
Jul 07 00:04:44.862505 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.862336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx" event={"ID":"feb1750c-5970-40ab-bc59-ec68e229c02a","Type":"ContainerDied","Data":"abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a"}
Jul 07 00:04:44.862505 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.862363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx" event={"ID":"feb1750c-5970-40ab-bc59-ec68e229c02a","Type":"ContainerDied","Data":"18097c09c9d1c64a95a4bd9632386d3f9ff27fd71fd43f71d444a8ccbeb5737f"}
Jul 07 00:04:44.862505 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.862360    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"
Jul 07 00:04:44.862505 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.862375    2579 scope.go:117] "RemoveContainer" containerID="abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a"
Jul 07 00:04:44.872041 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.872020    2579 scope.go:117] "RemoveContainer" containerID="abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a"
Jul 07 00:04:44.872325 ip-10-0-138-34 kubenswrapper[2579]: E0707 00:04:44.872306    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a\": container with ID starting with abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a not found: ID does not exist" containerID="abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a"
Jul 07 00:04:44.872373 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.872348    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a"} err="failed to get container status \"abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a\": rpc error: code = NotFound desc = could not find container \"abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a\": container with ID starting with abf694b87c59bc88d3177f890a7a67baef7189abeb8aa1dfa4f6d9b545e0f31a not found: ID does not exist"
Jul 07 00:04:44.882311 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.882287    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"]
Jul 07 00:04:44.885944 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:44.885915    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9ea6e9/rate-test-model-9ea6e9-kserve-67d9c68fb7-qjnmx"]
Jul 07 00:04:45.380291 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:45.380261    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb1750c-5970-40ab-bc59-ec68e229c02a" path="/var/lib/kubelet/pods/feb1750c-5970-40ab-bc59-ec68e229c02a/volumes"
Jul 07 00:04:45.426565 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:45.426541    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 07 00:04:45.433495 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:04:45.433475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cblqt_bf625c0c-d1d0-49ec-8925-191df5cac5e1/ovn-acl-logging/0.log"
Jul 07 00:05:14.348087 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.348030    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"]
Jul 07 00:05:14.348533 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.348301    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f" podUID="6e3f2a4e-b80f-40eb-a858-554395bb3e26" containerName="maas-api" containerID="cri-o://35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62" gracePeriod=30
Jul 07 00:05:14.384899 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.384869    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"]
Jul 07 00:05:14.387691 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.387667    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-a1e3a6-29723040-mhl6z"]
Jul 07 00:05:14.597527 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.597504    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 07 00:05:14.687545 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.687457    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4gps\" (UniqueName: \"kubernetes.io/projected/6e3f2a4e-b80f-40eb-a858-554395bb3e26-kube-api-access-v4gps\") pod \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") "
Jul 07 00:05:14.687545 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.687490    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3f2a4e-b80f-40eb-a858-554395bb3e26-openshift-service-ca\") pod \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") "
Jul 07 00:05:14.687545 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.687526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e3f2a4e-b80f-40eb-a858-554395bb3e26-maas-api-tls\") pod \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\" (UID: \"6e3f2a4e-b80f-40eb-a858-554395bb3e26\") "
Jul 07 00:05:14.687883 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.687860    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e3f2a4e-b80f-40eb-a858-554395bb3e26-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e3f2a4e-b80f-40eb-a858-554395bb3e26" (UID: "6e3f2a4e-b80f-40eb-a858-554395bb3e26"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:05:14.689797 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.689773    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e3f2a4e-b80f-40eb-a858-554395bb3e26-kube-api-access-v4gps" (OuterVolumeSpecName: "kube-api-access-v4gps") pod "6e3f2a4e-b80f-40eb-a858-554395bb3e26" (UID: "6e3f2a4e-b80f-40eb-a858-554395bb3e26"). InnerVolumeSpecName "kube-api-access-v4gps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:05:14.689797 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.689781    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e3f2a4e-b80f-40eb-a858-554395bb3e26-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e3f2a4e-b80f-40eb-a858-554395bb3e26" (UID: "6e3f2a4e-b80f-40eb-a858-554395bb3e26"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:05:14.788369 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.788337    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4gps\" (UniqueName: \"kubernetes.io/projected/6e3f2a4e-b80f-40eb-a858-554395bb3e26-kube-api-access-v4gps\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:05:14.788369 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.788363    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3f2a4e-b80f-40eb-a858-554395bb3e26-openshift-service-ca\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:05:14.788369 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.788374    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e3f2a4e-b80f-40eb-a858-554395bb3e26-maas-api-tls\") on node \"ip-10-0-138-34.ec2.internal\" DevicePath \"\""
Jul 07 00:05:14.997179 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.997144    2579 generic.go:356] "Generic (PLEG): container finished" podID="6e3f2a4e-b80f-40eb-a858-554395bb3e26" containerID="35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62" exitCode=0
Jul 07 00:05:14.997404 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.997191    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"
Jul 07 00:05:14.997404 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.997221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f" event={"ID":"6e3f2a4e-b80f-40eb-a858-554395bb3e26","Type":"ContainerDied","Data":"35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62"}
Jul 07 00:05:14.997404 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.997283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f" event={"ID":"6e3f2a4e-b80f-40eb-a858-554395bb3e26","Type":"ContainerDied","Data":"d7bf678cf04f736205a8aa6652f6e280c50ee3077fbe19f5183b031ddae827d0"}
Jul 07 00:05:14.997404 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:14.997307    2579 scope.go:117] "RemoveContainer" containerID="35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62"
Jul 07 00:05:15.006334 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:15.006318    2579 scope.go:117] "RemoveContainer" containerID="35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62"
Jul 07 00:05:15.006579 ip-10-0-138-34 kubenswrapper[2579]: E0707 00:05:15.006558    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62\": container with ID starting with 35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62 not found: ID does not exist" containerID="35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62"
Jul 07 00:05:15.006638 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:15.006586    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62"} err="failed to get container status \"35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62\": rpc error: code = NotFound desc = could not find container \"35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62\": container with ID starting with 35f9590252a0933787ca42e7fc712c7a0b771c4a5c3f9d16e05940245527be62 not found: ID does not exist"
Jul 07 00:05:15.019251 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:15.019228    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"]
Jul 07 00:05:15.022413 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:15.022394    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a1e3a6-5c6764f987-94z6f"]
Jul 07 00:05:15.384270 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:15.384194    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c948f20-be97-4691-a2b9-bd460e97fd4f" path="/var/lib/kubelet/pods/4c948f20-be97-4691-a2b9-bd460e97fd4f/volumes"
Jul 07 00:05:15.384607 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:15.384563    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e3f2a4e-b80f-40eb-a858-554395bb3e26" path="/var/lib/kubelet/pods/6e3f2a4e-b80f-40eb-a858-554395bb3e26/volumes"
Jul 07 00:05:16.567550 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:16.567513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tj7zj"]
Jul 07 00:05:26.287484 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:26.287448    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zn5qt_dc080633-5808-4a44-a5d2-af5ef81e225e/manager/0.log"
Jul 07 00:05:26.439447 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:26.439417    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7khxz_93828de8-6b47-4a69-bd23-a27e83f802be/manager/0.log"
Jul 07 00:05:26.677515 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:26.677441    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723025-r69s7_c81108fd-d62d-4819-ac6c-6a3a2fe9441a/cleanup/0.log"
Jul 07 00:05:27.073832 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:27.073806    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6ghx9_b4d9026b-36ce-409d-af8b-cdabee7722d2/server/0.log"
Jul 07 00:05:27.200905 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:27.200875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9zkd5_fea166d9-d041-4709-9b27-21a3aae74b66/manager/0.log"
Jul 07 00:05:27.322799 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:27.322768    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d555ff84d-wmpmt_eaa02c61-ffa1-47d8-b2bb-15da4478517e/copy-manifests/0.log"
Jul 07 00:05:27.330652 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:27.330580    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d555ff84d-wmpmt_eaa02c61-ffa1-47d8-b2bb-15da4478517e/manager/0.log"
Jul 07 00:05:29.259148 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:29.259117    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mx6fl_247c46db-b8ba-4c52-a90f-3d357554073a/manager/0.log"
Jul 07 00:05:29.885281 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:29.885248    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tj7zj_59fa0548-6ba3-4f8d-a281-2be435986c67/limitador/0.log"
Jul 07 00:05:30.562788 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:30.562749    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vnjrc_3c19891e-2507-40e3-8fba-7b548ba411ef/discovery/0.log"
Jul 07 00:05:30.803867 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:30.803839    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66bf577d87-d848p_aaad8a68-05f3-4ebc-aa52-93c9639f1d47/kube-auth-proxy/0.log"
Jul 07 00:05:31.930936 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:31.930907    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5jngf_a630ec6a-741a-4378-8b1c-10b2a494ac71/main/0.log"
Jul 07 00:05:37.043923 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.043891    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ttmnp/must-gather-mrffz"]
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044222    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f19a298-8a22-4789-98cf-e8bc85001a19" containerName="maas-api"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044233    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f19a298-8a22-4789-98cf-e8bc85001a19" containerName="maas-api"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044243    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e3f2a4e-b80f-40eb-a858-554395bb3e26" containerName="maas-api"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044252    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e3f2a4e-b80f-40eb-a858-554395bb3e26" containerName="maas-api"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044258    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb1750c-5970-40ab-bc59-ec68e229c02a" containerName="main"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044263    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb1750c-5970-40ab-bc59-ec68e229c02a" containerName="main"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044280    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1aa5b2-319e-4a8e-8960-1f35f160a698" containerName="main"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044285    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1aa5b2-319e-4a8e-8960-1f35f160a698" containerName="main"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044335    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1aa5b2-319e-4a8e-8960-1f35f160a698" containerName="main"
Jul 07 00:05:37.044339 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044343    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f19a298-8a22-4789-98cf-e8bc85001a19" containerName="maas-api"
Jul 07 00:05:37.044641 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044349    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e3f2a4e-b80f-40eb-a858-554395bb3e26" containerName="maas-api"
Jul 07 00:05:37.044641 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.044355    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb1750c-5970-40ab-bc59-ec68e229c02a" containerName="main"
Jul 07 00:05:37.047148 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.047131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ttmnp/must-gather-mrffz"
Jul 07 00:05:37.049498 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.049470    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ttmnp\"/\"kube-root-ca.crt\""
Jul 07 00:05:37.049623 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.049590    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ttmnp\"/\"openshift-service-ca.crt\""
Jul 07 00:05:37.050443 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.050426    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ttmnp\"/\"default-dockercfg-dngpf\""
Jul 07 00:05:37.057111 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.057090    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ttmnp/must-gather-mrffz"]
Jul 07 00:05:37.071069 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.071028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71bc22bc-472b-4614-99e1-5d363c32f6eb-must-gather-output\") pod \"must-gather-mrffz\" (UID: \"71bc22bc-472b-4614-99e1-5d363c32f6eb\") " pod="openshift-must-gather-ttmnp/must-gather-mrffz"
Jul 07 00:05:37.071255 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.071218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp8vz\" (UniqueName: \"kubernetes.io/projected/71bc22bc-472b-4614-99e1-5d363c32f6eb-kube-api-access-dp8vz\") pod \"must-gather-mrffz\" (UID: \"71bc22bc-472b-4614-99e1-5d363c32f6eb\") " pod="openshift-must-gather-ttmnp/must-gather-mrffz"
Jul 07 00:05:37.171733 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.171710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp8vz\" (UniqueName: \"kubernetes.io/projected/71bc22bc-472b-4614-99e1-5d363c32f6eb-kube-api-access-dp8vz\") pod \"must-gather-mrffz\" (UID: \"71bc22bc-472b-4614-99e1-5d363c32f6eb\") " pod="openshift-must-gather-ttmnp/must-gather-mrffz"
Jul 07 00:05:37.171895 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.171759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71bc22bc-472b-4614-99e1-5d363c32f6eb-must-gather-output\") pod \"must-gather-mrffz\" (UID: \"71bc22bc-472b-4614-99e1-5d363c32f6eb\") " pod="openshift-must-gather-ttmnp/must-gather-mrffz"
Jul 07 00:05:37.172173 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.172156    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71bc22bc-472b-4614-99e1-5d363c32f6eb-must-gather-output\") pod \"must-gather-mrffz\" (UID: \"71bc22bc-472b-4614-99e1-5d363c32f6eb\") " pod="openshift-must-gather-ttmnp/must-gather-mrffz"
Jul 07 00:05:37.179527 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.179506    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp8vz\" (UniqueName: \"kubernetes.io/projected/71bc22bc-472b-4614-99e1-5d363c32f6eb-kube-api-access-dp8vz\") pod \"must-gather-mrffz\" (UID: \"71bc22bc-472b-4614-99e1-5d363c32f6eb\") " pod="openshift-must-gather-ttmnp/must-gather-mrffz"
Jul 07 00:05:37.356942 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.356859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ttmnp/must-gather-mrffz"
Jul 07 00:05:37.505088 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.505039    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ttmnp/must-gather-mrffz"]
Jul 07 00:05:37.506790 ip-10-0-138-34 kubenswrapper[2579]: W0707 00:05:37.506766    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71bc22bc_472b_4614_99e1_5d363c32f6eb.slice/crio-b2e79742e571dc890cdff7b76d33470503ae78e9c5f75ac19d781fbc07d02d3d WatchSource:0}: Error finding container b2e79742e571dc890cdff7b76d33470503ae78e9c5f75ac19d781fbc07d02d3d: Status 404 returned error can't find the container with id b2e79742e571dc890cdff7b76d33470503ae78e9c5f75ac19d781fbc07d02d3d
Jul 07 00:05:37.508637 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:37.508620    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:05:38.103408 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:38.103368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ttmnp/must-gather-mrffz" event={"ID":"71bc22bc-472b-4614-99e1-5d363c32f6eb","Type":"ContainerStarted","Data":"b2e79742e571dc890cdff7b76d33470503ae78e9c5f75ac19d781fbc07d02d3d"}
Jul 07 00:05:39.109894 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:39.109856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ttmnp/must-gather-mrffz" event={"ID":"71bc22bc-472b-4614-99e1-5d363c32f6eb","Type":"ContainerStarted","Data":"814da17d1d67e9f500a34a7e2cdeb7df5a59079e9c2e031c45c7118865f1cec8"}
Jul 07 00:05:39.110274 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:39.109908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ttmnp/must-gather-mrffz" event={"ID":"71bc22bc-472b-4614-99e1-5d363c32f6eb","Type":"ContainerStarted","Data":"889ec42ad47c6ca4280787bb8052cf96fdb69e4af1b70a0285430978d3f47336"}
Jul 07 00:05:39.125218 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:39.125157    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ttmnp/must-gather-mrffz" podStartSLOduration=1.309097523 podStartE2EDuration="2.125137017s" totalImagesPullingTime="816.039494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:39.123953626 +0000 UTC m=+2454.257945818" watchObservedRunningTime="2026-07-07 00:05:39.125137017 +0000 UTC m=+2454.259129201"
Jul 07 00:05:39.909533 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:39.909503    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8rjl4_f7371def-54bf-424c-8fe0-3f05a45aed2a/global-pull-secret-syncer/0.log"
Jul 07 00:05:40.053283 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:40.053244    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g9wrh_7e5327b4-02cc-453c-9ccf-73daba79548d/konnectivity-agent/0.log"
Jul 07 00:05:40.127563 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:40.127527    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-34.ec2.internal_8fe81b36c2cc08704a0f6d1ff5e404e0/haproxy/0.log"
Jul 07 00:05:44.853139 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:44.853103    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mx6fl_247c46db-b8ba-4c52-a90f-3d357554073a/manager/0.log"
Jul 07 00:05:45.200665 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:45.200633    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tj7zj_59fa0548-6ba3-4f8d-a281-2be435986c67/limitador/0.log"
Jul 07 00:05:47.208204 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.208170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64b4d64bc9-7272s_8d43d698-d72a-4e86-a212-00dba0560db5/metrics-server/0.log"
Jul 07 00:05:47.279222 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.279193    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hczc_30691658-60ec-4029-a38e-8352b2bd1991/node-exporter/0.log"
Jul 07 00:05:47.306719 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.306691    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hczc_30691658-60ec-4029-a38e-8352b2bd1991/kube-rbac-proxy/0.log"
Jul 07 00:05:47.337079 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.335269    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hczc_30691658-60ec-4029-a38e-8352b2bd1991/init-textfile/0.log"
Jul 07 00:05:47.544825 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.544747    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-t5hlc_e16db94d-2dd5-43de-8c7a-253aaf9460a2/kube-rbac-proxy-main/0.log"
Jul 07 00:05:47.566838 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.566809    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-t5hlc_e16db94d-2dd5-43de-8c7a-253aaf9460a2/kube-rbac-proxy-self/0.log"
Jul 07 00:05:47.590163 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.590125    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-t5hlc_e16db94d-2dd5-43de-8c7a-253aaf9460a2/openshift-state-metrics/0.log"
Jul 07 00:05:47.805114 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.805004    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-brrw4_5e74e837-7021-4871-a9a5-3844d18e7685/prometheus-operator/0.log"
Jul 07 00:05:47.822810 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:47.822777    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-brrw4_5e74e837-7021-4871-a9a5-3844d18e7685/kube-rbac-proxy/0.log"
Jul 07 00:05:50.356877 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.356838    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"]
Jul 07 00:05:50.361392 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.361364    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.370614 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.370029    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"]
Jul 07 00:05:50.406963 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.406562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-proc\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.406963 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.406618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-podres\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.406963 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.406677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tsw\" (UniqueName: \"kubernetes.io/projected/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-kube-api-access-p5tsw\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.406963 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.406703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-sys\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.406963 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.406736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-lib-modules\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507231 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-proc\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507231 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-podres\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507475 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507308    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-proc\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507475 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tsw\" (UniqueName: \"kubernetes.io/projected/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-kube-api-access-p5tsw\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507475 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-sys\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507475 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507383    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-sys\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507475 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-lib-modules\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507475 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507415    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-podres\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.507823 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.507786    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-lib-modules\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.515805 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.515774    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tsw\" (UniqueName: \"kubernetes.io/projected/5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98-kube-api-access-p5tsw\") pod \"perf-node-gather-daemonset-s77gk\" (UID: \"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98\") " pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.678293 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.678191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:50.848841 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:50.848802    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"]
Jul 07 00:05:50.857867 ip-10-0-138-34 kubenswrapper[2579]: W0707 00:05:50.857829    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5f2db0a0_672f_4c0d_a966_8d3f3b4cbf98.slice/crio-1f8ccd535d0f641b81b278ab81742b4c5bb7e0ca280d05ff4174136a2aa75799 WatchSource:0}: Error finding container 1f8ccd535d0f641b81b278ab81742b4c5bb7e0ca280d05ff4174136a2aa75799: Status 404 returned error can't find the container with id 1f8ccd535d0f641b81b278ab81742b4c5bb7e0ca280d05ff4174136a2aa75799
Jul 07 00:05:51.192276 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:51.192192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk" event={"ID":"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98","Type":"ContainerStarted","Data":"3165a485282d124d6f2d45fbe26ce8cd813522e94380ad5afd0c99b4045ace23"}
Jul 07 00:05:51.192276 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:51.192254    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk" event={"ID":"5f2db0a0-672f-4c0d-a966-8d3f3b4cbf98","Type":"ContainerStarted","Data":"1f8ccd535d0f641b81b278ab81742b4c5bb7e0ca280d05ff4174136a2aa75799"}
Jul 07 00:05:51.192524 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:51.192296    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:51.207922 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:51.207852    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk" podStartSLOduration=1.207829577 podStartE2EDuration="1.207829577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:51.206313894 +0000 UTC m=+2466.340306085" watchObservedRunningTime="2026-07-07 00:05:51.207829577 +0000 UTC m=+2466.341821768"
Jul 07 00:05:52.273776 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:52.273749    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gt4hl_d30d0e7e-b72c-455c-9e03-bf6df9d1260b/dns/0.log"
Jul 07 00:05:52.296245 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:52.296215    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gt4hl_d30d0e7e-b72c-455c-9e03-bf6df9d1260b/kube-rbac-proxy/0.log"
Jul 07 00:05:52.373691 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:52.373589    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2zff_f37af222-6916-4949-a335-4f342064f030/dns-node-resolver/0.log"
Jul 07 00:05:53.012415 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:53.012347    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-745d88dd69-wncmt_c38b0b7f-f123-45db-86b0-885051984241/registry/0.log"
Jul 07 00:05:53.093735 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:53.093703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkjpp_86dd081b-d5f7-4eb5-b4f8-e5565742b5da/node-ca/0.log"
Jul 07 00:05:54.221209 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:54.221175    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vnjrc_3c19891e-2507-40e3-8fba-7b548ba411ef/discovery/0.log"
Jul 07 00:05:54.324147 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:54.324110    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66bf577d87-d848p_aaad8a68-05f3-4ebc-aa52-93c9639f1d47/kube-auth-proxy/0.log"
Jul 07 00:05:55.239399 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:55.239367    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ll5q4_33f3d36b-09d8-411b-9775-624efb03a0d5/serve-healthcheck-canary/0.log"
Jul 07 00:05:55.873037 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:55.873009    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ts8ft_d6fff33a-c889-405b-997b-9223296fc04b/kube-rbac-proxy/0.log"
Jul 07 00:05:55.893417 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:55.893395    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ts8ft_d6fff33a-c889-405b-997b-9223296fc04b/exporter/0.log"
Jul 07 00:05:55.914511 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:55.914481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ts8ft_d6fff33a-c889-405b-997b-9223296fc04b/extractor/0.log"
Jul 07 00:05:57.208661 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:57.208625    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ttmnp/perf-node-gather-daemonset-s77gk"
Jul 07 00:05:58.098707 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:58.098677    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zn5qt_dc080633-5808-4a44-a5d2-af5ef81e225e/manager/0.log"
Jul 07 00:05:58.356581 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:58.356478    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7khxz_93828de8-6b47-4a69-bd23-a27e83f802be/manager/0.log"
Jul 07 00:05:58.413866 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:58.413838    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723025-r69s7_c81108fd-d62d-4819-ac6c-6a3a2fe9441a/cleanup/0.log"
Jul 07 00:05:58.553593 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:58.553555    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6ghx9_b4d9026b-36ce-409d-af8b-cdabee7722d2/server/0.log"
Jul 07 00:05:58.653789 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:58.653710    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9zkd5_fea166d9-d041-4709-9b27-21a3aae74b66/manager/0.log"
Jul 07 00:05:58.677990 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:58.677955    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d555ff84d-wmpmt_eaa02c61-ffa1-47d8-b2bb-15da4478517e/manager/0.log"
Jul 07 00:05:58.702253 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:05:58.702220    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d555ff84d-wmpmt_eaa02c61-ffa1-47d8-b2bb-15da4478517e/copy-manifests/0.log"
Jul 07 00:06:00.489930 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:00.489883    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5g22p_32122421-ff30-4ae6-a0e7-b48a2fbf2b7c/openshift-lws-operator/0.log"
Jul 07 00:06:00.873867 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:00.873781    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vnjrc_3c19891e-2507-40e3-8fba-7b548ba411ef/discovery/0.log"
Jul 07 00:06:00.900805 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:00.900772    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66bf577d87-d848p_aaad8a68-05f3-4ebc-aa52-93c9639f1d47/kube-auth-proxy/0.log"
Jul 07 00:06:02.381750 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:02.381662    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vnjrc_3c19891e-2507-40e3-8fba-7b548ba411ef/discovery/0.log"
Jul 07 00:06:02.413118 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:02.413091    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66bf577d87-d848p_aaad8a68-05f3-4ebc-aa52-93c9639f1d47/kube-auth-proxy/0.log"
Jul 07 00:06:07.124738 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.124711    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9lb_8865ded9-58dd-4a10-88d4-dcca74604f2d/kube-multus-additional-cni-plugins/0.log"
Jul 07 00:06:07.145920 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.145892    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9lb_8865ded9-58dd-4a10-88d4-dcca74604f2d/egress-router-binary-copy/0.log"
Jul 07 00:06:07.167343 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.167292    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9lb_8865ded9-58dd-4a10-88d4-dcca74604f2d/cni-plugins/0.log"
Jul 07 00:06:07.188724 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.188699    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9lb_8865ded9-58dd-4a10-88d4-dcca74604f2d/bond-cni-plugin/0.log"
Jul 07 00:06:07.212809 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.212781    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9lb_8865ded9-58dd-4a10-88d4-dcca74604f2d/routeoverride-cni/0.log"
Jul 07 00:06:07.232993 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.232960    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9lb_8865ded9-58dd-4a10-88d4-dcca74604f2d/whereabouts-cni-bincopy/0.log"
Jul 07 00:06:07.254494 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.254470    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x9lb_8865ded9-58dd-4a10-88d4-dcca74604f2d/whereabouts-cni/0.log"
Jul 07 00:06:07.657393 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.657360    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f4p2l_f6fb8599-8562-439b-96bd-082b917bb6cd/kube-multus/0.log"
Jul 07 00:06:07.768180 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.768149    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kqqs9_48700b44-4c22-4932-bc22-aa11fec4c9cc/network-metrics-daemon/0.log"
Jul 07 00:06:07.787269 ip-10-0-138-34 kubenswrapper[2579]: I0707 00:06:07.787240    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kqqs9_48700b44-4c22-4932-bc22-aa11fec4c9cc/kube-rbac-proxy/0.log"