Jul 10 18:15:05.623294 ip-10-0-141-167 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 18:15:05.623304 ip-10-0-141-167 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 18:15:05.623313 ip-10-0-141-167 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 18:15:05.623602 ip-10-0-141-167 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 18:15:15.781464 ip-10-0-141-167 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 18:15:15.781487 ip-10-0-141-167 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5f94e8235c364573b53ade0e4cb7a6bd --
Jul 10 18:17:19.181666 ip-10-0-141-167 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 18:17:19.810724 ip-10-0-141-167 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:17:19.810724 ip-10-0-141-167 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 18:17:19.810724 ip-10-0-141-167 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:17:19.810724 ip-10-0-141-167 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 18:17:19.810724 ip-10-0-141-167 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:17:19.813059 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.812946    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 18:17:19.818960 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818930    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:17:19.818960 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818962    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818967    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818970    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818974    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818977    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818979    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818982    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818988    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818993    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818996    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.818999    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819002    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819005    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819008    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819011    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819015    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819017    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819021    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819024    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819027    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:17:19.819046 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819029    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819034    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819037    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819041    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819044    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819047    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819050    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819053    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819056    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819060    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819063    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819066    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819069    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819072    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819075    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819078    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819080    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819083    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819086    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819089    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:17:19.819559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819091    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819095    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819099    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819102    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819104    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819107    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819110    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819112    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819115    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819118    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819121    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819123    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819126    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819128    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819132    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819137    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819139    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819142    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819145    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:17:19.820111 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819147    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819150    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819153    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819156    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819159    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819162    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819165    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819168    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819171    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819173    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819176    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819179    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819182    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819184    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819187    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819190    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819193    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819196    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819199    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819201    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:17:19.820614 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819204    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819208    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819211    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819213    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819216    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819219    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819222    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819227    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819229    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819232    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819235    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819238    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819241    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819244    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819247    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819249    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819252    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819255    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.819257    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:17:19.821126 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821046    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821056    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821059    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821063    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821066    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821069    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821073    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821076    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821078    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821082    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821085    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821088    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821091    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821094    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821097    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821099    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821102    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821105    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821109    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821113    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:17:19.821642 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821117    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821121    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821123    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821126    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821129    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821132    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821135    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821138    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821141    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821144    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821147    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821150    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821152    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821155    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821158    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821161    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821164    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821167    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821169    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821172    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:17:19.822161 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821175    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821177    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821180    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821183    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821186    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821189    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821192    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821194    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821197    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821200    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821204    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821207    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821211    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821214    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821217    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821219    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821222    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821225    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821227    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821230    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:17:19.822734 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821233    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821235    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821238    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821241    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821243    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821246    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821250    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821252    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821255    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821258    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821261    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821264    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821266    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821269    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821271    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821274    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821277    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821280    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821283    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821285    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:17:19.823249 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821288    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821291    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821293    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821314    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821317    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821320    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821326    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821330    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821334    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821337    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821340    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821343    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821347    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821349    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821352    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821356    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821360    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821363    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821366    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:17:19.823779 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821793    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821798    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821802    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821805    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821808    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821811    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821814    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821818    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821821    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821824    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821827    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821829    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821832    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821835    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821838    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821841    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821844    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821847    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821850    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821853    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:17:19.824414 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821856    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821859    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821861    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821865    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821867    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821870    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821873    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821876    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821878    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821881    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821884    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821887    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821891    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821894    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821897    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821900    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821903    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821906    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821909    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:17:19.825252 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821911    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821914    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821916    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821919    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821922    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821925    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821927    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821930    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821934    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821937    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821939    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821944    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821947    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821951    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821954    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821958    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821961    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821964    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821968    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:17:19.825828 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821970    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821973    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821976    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821979    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821984    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821987    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821991    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821995    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.821998    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822001    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822004    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822007    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822010    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822012    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822015    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822018    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822021    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822023    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822026    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822029    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:17:19.826392 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822031    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822034    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822037    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822040    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822043    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822046    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822048    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822051    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822054    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822057    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822059    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822062    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822065    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822068    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822071    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822073    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822076    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822079    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822082    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822085    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:17:19.827024 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822088    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822181    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822190    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822198    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822203    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822208    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822211    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822216    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822220    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822224    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822227    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822231    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822235    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822243    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822247    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822250    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822254    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822257    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822261    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822265    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822268    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822272    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822275    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822279    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 18:17:19.827558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822283    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822286    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822290    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822310    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822314    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822317    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822322    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822326    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822329    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822340    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822344    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822347    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822350    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822353    2577 flags.go:64] FLAG: --enable-server="true"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822357    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822362    2577 flags.go:64] FLAG: --event-burst="100"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822365    2577 flags.go:64] FLAG: --event-qps="50"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822368    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822372    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822375    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822379    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822384    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822387    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822391    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822394    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 18:17:19.828180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822397    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822401    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822404    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822407    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822410    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822413    2577 flags.go:64] FLAG: --feature-gates=""
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822417    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822420    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822424    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822427    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822430    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822433    2577 flags.go:64] FLAG: --help="false"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822437    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-167.ec2.internal"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822442    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822445    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822448    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822452    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822456    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822459    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822462    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822465    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822468    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822472    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822476    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 18:17:19.828963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822479    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822482    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822485    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822488    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822493    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822496    2577 flags.go:64] FLAG: --lock-file=""
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822499    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822502    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822506    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822512    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822516    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822518    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822522    2577 flags.go:64] FLAG: --logging-format="text"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822525    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822528    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822531    2577 flags.go:64] FLAG: --manifest-url=""
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822535    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822555    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822559    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822568    2577 flags.go:64] FLAG: --max-pods="110"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822571    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822576    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822580    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822583    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822586    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 18:17:19.829616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822589    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822593    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822602    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822606    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822609    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822612    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822615    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822622    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822625    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822628    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822631    2577 flags.go:64] FLAG: --port="10250"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822634    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822639    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac4993302b58539f"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822643    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822646    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822649    2577 flags.go:64] FLAG: --register-node="true"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822652    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822656    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822659    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822663    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822666    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822670    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822673    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822677    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822680    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 18:17:19.830259 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822682    2577 flags.go:64] FLAG: --runonce="false"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822685    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822689    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822694    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822697    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822700    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822703    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822706    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822710    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822714    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822717    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822720    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822723    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822726    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822729    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822732    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822738    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822742    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822745    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822752    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822755    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822758    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822761    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822764    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822767    2577 flags.go:64] FLAG: --v="2"
Jul 10 18:17:19.830937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822772    2577 flags.go:64] FLAG: --version="false"
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822777    2577 flags.go:64] FLAG: --vmodule=""
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822781    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.822784    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822916    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822920    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822924    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822927    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822930    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822933    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822937    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822940    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822943    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822946    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822949    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822952    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822955    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822958    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822961    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822964    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:17:19.831645 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822967    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822969    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822972    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822975    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822977    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822980    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822985    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822988    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822990    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822993    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822996    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.822999    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823002    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823006    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823010    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823015    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823019    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823022    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823025    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:17:19.832175 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823028    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823031    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823034    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823038    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823040    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823043    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823047    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823051    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823054    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823058    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823061    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823064    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823067    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823070    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823073    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823076    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823078    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823081    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823084    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823088    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:17:19.832717 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823091    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823094    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823097    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823100    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823102    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823105    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823108    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823111    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823114    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823116    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823119    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823122    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823124    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823127    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823130    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823134    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823137    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823140    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823143    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:17:19.833278 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823146    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823148    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823151    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823154    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823157    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823161    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823164    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823166    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823169    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823172    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823175    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823177    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823182    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823184    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823187    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823190    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823193    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823195    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823198    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823201    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:17:19.833819 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823203    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823206    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823209    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823212    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.823215    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.823225    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.833140    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.833166    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.834122    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.834133    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834206    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834213    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834217    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834221    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834224    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:17:19.834348 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834241    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834246    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834249    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834252    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834255    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834258    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834262    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834265    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834268    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834271    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834274    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834277    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834280    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834283    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834286    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834288    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834291    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834295    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834299    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834303    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:17:19.834748 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834308    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834312    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834319    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834324    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834328    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834332    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834335    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834339    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834342    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834345    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834348    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834351    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834354    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834357    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834360    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834363    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834366    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834369    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834371    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:17:19.835266 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834374    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834377    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834380    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834383    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834387    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834389    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834392    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834395    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834398    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834401    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834404    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834406    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834409    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834413    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834417    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834420    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834423    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834426    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834428    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:17:19.835771 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834431    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834434    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834437    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834439    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834442    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834445    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834447    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834451    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834453    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834456    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834460    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834464    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834467    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834470    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834473    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834477    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834481    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834485    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834488    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:17:19.836239 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834491    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834493    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834496    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834499    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834502    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834504    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834507    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834510    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834513    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834516    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834519    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834522    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834525    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834528    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834530    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834534    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:17:19.836821 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834536    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.834543    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834677    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834683    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834687    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834691    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834694    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834697    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834702    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834707    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834710    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834713    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834715    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834718    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:17:19.837253 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834723    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834726    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834729    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834732    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834735    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834737    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834740    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834743    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834745    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834748    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834751    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834754    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834757    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834761    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834764    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834766    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834769    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834772    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834775    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834778    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:17:19.837641 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834780    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834783    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834786    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834789    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834791    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834794    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834797    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834799    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834802    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834805    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834808    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834811    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834814    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834817    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834821    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834823    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834827    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834829    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834832    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:17:19.838165 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834835    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834838    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834840    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834844    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834848    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834851    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834856    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834858    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834861    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834864    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834868    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834871    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834874    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834877    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834879    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834882    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834885    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834888    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834890    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834895    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:17:19.838679 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834898    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834901    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834905    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834908    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834911    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834914    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834916    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834921    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834923    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834926    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834929    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834931    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834934    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834937    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834940    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834943    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834945    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834948    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834952    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834954    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:17:19.839202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834958    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834960    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834963    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834967    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834970    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834973    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834975    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:19.834978    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.834984    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.835145    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.837843    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 18:17:19.839736 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.839721    2577 server.go:1019] "Starting client certificate rotation"
Jul 10 18:17:19.840035 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.839840    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:17:19.840035 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.839881    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:17:19.842774 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.842752    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:17:19.845083 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.845061    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:17:19.859129 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.859099    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 10 18:17:19.862263 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.862224    2577 log.go:25] "Validated CRI v1 image API"
Jul 10 18:17:19.863335 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.863311    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 18:17:19.869936 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.869905    2577 fs.go:135] Filesystem UUIDs: map[0693acad-43c9-4db5-8ddc-073e5b9578f0:/dev/nvme0n1p4 3492344a-a442-4576-b505-283193fcccb6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 10 18:17:19.869936 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.869929    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 18:17:19.874897 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.874867    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:17:19.875786 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.875657    2577 manager.go:216] Machine: {Timestamp:2026-07-10 18:17:19.874210722 +0000 UTC m=+0.547126515 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100967 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a2e2b767cdf67b677da47f5d7b256 SystemUUID:ec2a2e2b-767c-df67-b677-da47f5d7b256 BootID:5f94e823-5c36-4573-b53a-de0e4cb7a6bd Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b9:35:99:6a:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b9:35:99:6a:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:c5:da:f9:cc:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 18:17:19.875786 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.875780    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 18:17:19.875929 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.875888    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 18:17:19.877397 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.877362    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 18:17:19.877596 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.877401    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 18:17:19.878979 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.878963    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 18:17:19.879054 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.878988    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 18:17:19.879054 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.879001    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:17:19.879827 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.879813    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:17:19.881391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.881374    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 18:17:19.885230 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885211    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:17:19.885424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885411    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 18:17:19.885487 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885457    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 18:17:19.885487 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885475    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 18:17:19.885576 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885498    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 18:17:19.885576 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885516    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 10 18:17:19.885576 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885532    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 18:17:19.885984 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885968    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:17:19.886052 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.885993    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:17:19.888923 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.888894    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 18:17:19.891257 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.891241    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 18:17:19.891324 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.891275    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 18:17:19.891482 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.891470    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 18:17:19.891534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.891488    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 18:17:19.891534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.891494    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 18:17:19.891534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.891500    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 18:17:19.891534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.891508    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 18:17:19.891534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.891514    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 18:17:19.892306 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.892285    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 18:17:19.892360 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.892309    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 18:17:19.892360 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.892317    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 18:17:19.892360 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.892323    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 18:17:19.892360 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.892332    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 18:17:19.892360 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.892340    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 18:17:19.893263 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.893253    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 18:17:19.893263 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.893263    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 18:17:19.896733 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.896714    2577 server.go:1268] "Started kubelet"
Jul 10 18:17:19.896860 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.896804    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 18:17:19.897484 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.896907    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 18:17:19.897589 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.897512    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 18:17:19.898057 ip-10-0-141-167 systemd[1]: Started Kubernetes Kubelet.
Jul 10 18:17:19.898845 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.898822    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 18:17:19.898948 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.898868    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 18:17:19.899122 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.898942    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 18:17:19.899491 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.899474    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 18:17:19.899718 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.899699    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 18:17:19.903653 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.903630    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 18:17:19.903957 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.902844    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-167.ec2.internal.18c1007752436935  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-167.ec2.internal,UID:ip-10-0-141-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-167.ec2.internal,},FirstTimestamp:2026-07-10 18:17:19.896684853 +0000 UTC m=+0.569600701,LastTimestamp:2026-07-10 18:17:19.896684853 +0000 UTC m=+0.569600701,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-167.ec2.internal,}"
Jul 10 18:17:19.906081 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.906059    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 18:17:19.906081 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.906077    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 18:17:19.906261 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.906230    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:19.907639 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.907615    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 18:17:19.907745 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.907502    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 18:17:19.907745 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.907700    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 18:17:19.908000 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.907982    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 18:17:19.908000 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.908000    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 18:17:19.908839 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.908817    2577 factory.go:55] Registering systemd factory
Jul 10 18:17:19.908839 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.908843    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 10 18:17:19.909111 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.909086    2577 factory.go:153] Registering CRI-O factory
Jul 10 18:17:19.909111 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.909113    2577 factory.go:223] Registration of the crio container factory successfully
Jul 10 18:17:19.909283 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.909184    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 18:17:19.909283 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.909211    2577 factory.go:103] Registering Raw factory
Jul 10 18:17:19.909283 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.909227    2577 manager.go:1196] Started watching for new ooms in manager
Jul 10 18:17:19.910406 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.910375    2577 manager.go:349] Starting recovery of all containers
Jul 10 18:17:19.912463 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.911567    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 18:17:19.912463 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.911607    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 18:17:19.923228 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.923013    2577 manager.go:354] Recovery completed
Jul 10 18:17:19.929188 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.929166    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:17:19.932884 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.932863    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:17:19.932944 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.932902    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:17:19.932944 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.932917    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:17:19.933586 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.933565    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 18:17:19.933586 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.933580    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 18:17:19.933586 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.933583    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:17:19.933759 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.933597    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:17:19.934567 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.934546    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:17:19.934665 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.934584    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:17:19.934665 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.934595    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:17:19.935348 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.935332    2577 policy_none.go:49] "None policy: Start"
Jul 10 18:17:19.935408 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.935355    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 18:17:19.935408 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.935373    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 18:17:19.935502 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.935487    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tlmht"
Jul 10 18:17:19.936793 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.936779    2577 policy_none.go:47] "Start"
Jul 10 18:17:19.944996 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.944966    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tlmht"
Jul 10 18:17:19.945535 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.945462    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-167.ec2.internal.18c10077546bcaab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-167.ec2.internal,UID:ip-10-0-141-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-167.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-167.ec2.internal,},FirstTimestamp:2026-07-10 18:17:19.932885675 +0000 UTC m=+0.605801468,LastTimestamp:2026-07-10 18:17:19.932885675 +0000 UTC m=+0.605801468,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-167.ec2.internal,}"
Jul 10 18:17:19.983118 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.983093    2577 manager.go:337] "Starting Device Plugin manager"
Jul 10 18:17:19.983260 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.983148    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 18:17:19.983260 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.983159    2577 server.go:87] "Starting device plugin registration server"
Jul 10 18:17:19.983524 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.983507    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 18:17:19.983587 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.983527    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 18:17:19.983634 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.983614    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 18:17:19.983719 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.983703    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 18:17:19.983719 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:19.983719    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 18:17:19.984384 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.984361    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 18:17:19.984476 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:19.984428    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.085965 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.085865    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:17:20.087394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.087029    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:17:20.087394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.087067    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:17:20.087394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.087081    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:17:20.087394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.087110    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.098166 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.098135    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.098166 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.098171    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-167.ec2.internal\": node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.124914 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.124870    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 18:17:20.126239 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.126215    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 18:17:20.126346 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.126260    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 18:17:20.126346 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.126288    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 18:17:20.126456 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.126354    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 18:17:20.129834 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.129808    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:17:20.131189 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.131170    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.226897 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.226850    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"]
Jul 10 18:17:20.227007 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.226954    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:17:20.228827 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.228810    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:17:20.228920 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.228841    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:17:20.228920 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.228852    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:17:20.231337 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.231308    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.231457 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.231366    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:17:20.231503 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.231479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.231543 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.231514    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:17:20.232351 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.232334    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:17:20.232448 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.232360    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:17:20.232448 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.232371    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:17:20.232448 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.232384    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:17:20.232448 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.232408    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:17:20.232448 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.232421    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:17:20.234057 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.234042    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.234115 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.234073    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:17:20.234855 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.234840    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:17:20.234935 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.234869    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:17:20.234935 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.234884    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:17:20.258622 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.258595    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-167.ec2.internal\" not found" node="ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.263574 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.263555    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-167.ec2.internal\" not found" node="ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.309868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.309834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c50dc436f615212845a6d6b895b3210b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-167.ec2.internal\" (UID: \"c50dc436f615212845a6d6b895b3210b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.309868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.309870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72cb18cb3fb4068aeb8f6193b76687d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal\" (UID: \"72cb18cb3fb4068aeb8f6193b76687d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.310029 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.309890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72cb18cb3fb4068aeb8f6193b76687d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal\" (UID: \"72cb18cb3fb4068aeb8f6193b76687d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.332237 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.332194    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.411171 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.411080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c50dc436f615212845a6d6b895b3210b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-167.ec2.internal\" (UID: \"c50dc436f615212845a6d6b895b3210b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.411171 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.411135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72cb18cb3fb4068aeb8f6193b76687d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal\" (UID: \"72cb18cb3fb4068aeb8f6193b76687d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.411171 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.411152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72cb18cb3fb4068aeb8f6193b76687d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal\" (UID: \"72cb18cb3fb4068aeb8f6193b76687d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.411350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.411197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72cb18cb3fb4068aeb8f6193b76687d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal\" (UID: \"72cb18cb3fb4068aeb8f6193b76687d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.411350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.411200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c50dc436f615212845a6d6b895b3210b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-167.ec2.internal\" (UID: \"c50dc436f615212845a6d6b895b3210b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.411350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.411215    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72cb18cb3fb4068aeb8f6193b76687d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal\" (UID: \"72cb18cb3fb4068aeb8f6193b76687d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.433217 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.433182    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.534269 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.534238    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.562540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.562495    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.568293 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.568273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:20.635388 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.635336    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.737119 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.737029    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.838631 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.838598    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.838631 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.838599    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 18:17:20.839177 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.838792    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:17:20.894537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.894503    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:17:20.939103 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:20.939065    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:20.948943 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.948908    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:12:20 +0000 UTC" deadline="2028-02-19 15:40:18.135209044 +0000 UTC"
Jul 10 18:17:20.948943 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:20.948938    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14133h22m57.186274283s"
Jul 10 18:17:21.016710 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.016620    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:17:21.018311 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.018294    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:17:21.018407 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.018328    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:17:21.018407 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.018343    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:17:21.039954 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:21.039917    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:21.140341 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:21.140298    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:21.240504 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:21.240455    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:21.302728 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:21.302687    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50dc436f615212845a6d6b895b3210b.slice/crio-34118ca4059f27995e0bad3f15b7079858e8ea56cfad3ee6611145b416a0d3e4 WatchSource:0}: Error finding container 34118ca4059f27995e0bad3f15b7079858e8ea56cfad3ee6611145b416a0d3e4: Status 404 returned error can't find the container with id 34118ca4059f27995e0bad3f15b7079858e8ea56cfad3ee6611145b416a0d3e4
Jul 10 18:17:21.302996 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:21.302972    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cb18cb3fb4068aeb8f6193b76687d6.slice/crio-6ae62d22736ddf96f825520ccca761901d5fbcbdc419a234cea3fb0cc507f51f WatchSource:0}: Error finding container 6ae62d22736ddf96f825520ccca761901d5fbcbdc419a234cea3fb0cc507f51f: Status 404 returned error can't find the container with id 6ae62d22736ddf96f825520ccca761901d5fbcbdc419a234cea3fb0cc507f51f
Jul 10 18:17:21.309683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.309661    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:17:21.340705 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:21.340661    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:21.442769 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:21.442723    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-167.ec2.internal\" not found"
Jul 10 18:17:21.445221 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.445198    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:17:21.499121 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.499088    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:17:21.506936 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.506908    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:21.518178 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.518144    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:17:21.519385 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.519368    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal"
Jul 10 18:17:21.532345 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.532315    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:17:21.881537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.881436    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:17:21.887709 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.887680    2577 apiserver.go:52] "Watching apiserver"
Jul 10 18:17:21.897200 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.896874    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 18:17:21.897892 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.897499    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-87j8b","openshift-dns/node-resolver-n4575","openshift-image-registry/node-ca-vwl86","openshift-multus/multus-additional-cni-plugins-9pbn8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal","openshift-multus/multus-x48np","openshift-multus/network-metrics-daemon-t2rtq","openshift-network-diagnostics/network-check-target-gb9lp","openshift-network-operator/iptables-alerter-bdcd7","openshift-ovn-kubernetes/ovnkube-node-d8kmc","kube-system/global-pull-secret-syncer-qsjnf","kube-system/konnectivity-agent-kfpbd","kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"]
Jul 10 18:17:21.899727 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.899520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:21.899727 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:21.899627    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:21.901428 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.901403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:21.904600 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.904225    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lw2wh\""
Jul 10 18:17:21.904600 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.904431    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 18:17:21.904796 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.904637    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:21.905388 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.904974    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 18:17:21.905388 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.905225    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.908828 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.907694    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 18:17:21.908828 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.908052    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ps8n2\""
Jul 10 18:17:21.908828 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.908419    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g5z8r\""
Jul 10 18:17:21.908828 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.908681    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 18:17:21.909118 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.908976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 18:17:21.909118 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.908983    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 18:17:21.909118 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.909108    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 18:17:21.909267 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.909207    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 18:17:21.909654 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.909634    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 18:17:21.909858 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.909839    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 18:17:21.911831 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.910098    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 18:17:21.911831 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.910180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.913111 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.912994    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 18:17:21.913629 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.913474    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z7qt9\""
Jul 10 18:17:21.913629 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.913555    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:17:21.914761 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.914506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.917824 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.917798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-var-lib-kubelet\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.917934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.917840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-system-cni-dir\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.917934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.917848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:21.917934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.917871    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.917934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.917900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.917934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.917928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a794efb7-7e64-40b6-b1be-856faac833b5-etc-tuned\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.917952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-cni-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.917976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-socket-dir-parent\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-cni-bin\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18fc4602-515d-4c27-b186-0c8bceceaafa-agent-certs\") pod \"konnectivity-agent-kfpbd\" (UID: \"18fc4602-515d-4c27-b186-0c8bceceaafa\") " pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-registration-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-device-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-system-cni-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-netns\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysconfig\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-os-release\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/944fcc76-fdc1-4f50-ab8f-2ebc13791397-cni-binary-copy\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-k8s-cni-cncf-io\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-conf-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4kmh\" (UniqueName: \"kubernetes.io/projected/944fcc76-fdc1-4f50-ab8f-2ebc13791397-kube-api-access-z4kmh\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb4k2\" (UniqueName: \"kubernetes.io/projected/e807e592-0662-4cde-b84b-741274d7b296-kube-api-access-cb4k2\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-modprobe-d\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-lib-modules\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-cnibin\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918546    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-kubelet\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-daemon-config\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-systemd\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-host\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.918714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-cni-multus\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-socket-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysctl-conf\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx2ck\" (UniqueName: \"kubernetes.io/projected/a794efb7-7e64-40b6-b1be-856faac833b5-kube-api-access-dx2ck\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-multus-certs\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4gc\" (UniqueName: \"kubernetes.io/projected/cc8a66fc-7990-49ff-8620-e6f3214b96ce-kube-api-access-rf4gc\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-sys-fs\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-run\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a794efb7-7e64-40b6-b1be-856faac833b5-tmp\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918892    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-hostroot\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-etc-kubernetes\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-kubernetes\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysctl-d\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.918999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nxd\" (UniqueName: \"kubernetes.io/projected/be0ac423-184e-4f33-91fa-1a82b7562109-kube-api-access-k6nxd\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.919037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18fc4602-515d-4c27-b186-0c8bceceaafa-konnectivity-ca\") pod \"konnectivity-agent-kfpbd\" (UID: \"18fc4602-515d-4c27-b186-0c8bceceaafa\") " pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:21.919537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.919062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-cnibin\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.920289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.919089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-os-release\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:21.920289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.919113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-sys\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:21.920289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.919467    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 18:17:21.920289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.919783    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t95gg\""
Jul 10 18:17:21.920502 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.920346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:21.920502 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:21.920415    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:21.921152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.920655    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:17:21.921152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.920918    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 18:17:21.921152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.921015    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 18:17:21.921152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.921136    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v2zrk\""
Jul 10 18:17:21.922662 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.922545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:21.924506 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.924072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:21.926187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.926165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:21.926284 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:21.926258    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:21.928264 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.928241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:21.928868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.928849    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k2b72\""
Jul 10 18:17:21.928966 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.928931    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 18:17:21.929092 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.929075    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-49tkz\""
Jul 10 18:17:21.929382 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.929282    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 18:17:21.929474 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.928852    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 18:17:21.929474 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.929116    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 18:17:21.929601 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.929265    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 18:17:21.930166 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.930150    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 18:17:21.930648 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.930365    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 18:17:21.935222 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.935013    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 18:17:21.937296 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.935670    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 18:17:21.937296 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.936094    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 18:17:21.937296 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.936230    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 18:17:21.939171 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.938958    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cp2qn\""
Jul 10 18:17:21.939171 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.939096    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:17:21.956476 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.956444    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sv9zv"
Jul 10 18:17:21.963171 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:21.963145    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sv9zv"
Jul 10 18:17:22.009544 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.009508    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4gc\" (UniqueName: \"kubernetes.io/projected/cc8a66fc-7990-49ff-8620-e6f3214b96ce-kube-api-access-rf4gc\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-sys-fs\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-run\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a794efb7-7e64-40b6-b1be-856faac833b5-tmp\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-hostroot\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-dbus\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cccs2\" (UniqueName: \"kubernetes.io/projected/af29cd1b-dd41-4581-b5f4-062b07cce95d-kube-api-access-cccs2\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a794efb7-7e64-40b6-b1be-856faac833b5-etc-tuned\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-cni-bin\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nxd\" (UniqueName: \"kubernetes.io/projected/be0ac423-184e-4f33-91fa-1a82b7562109-kube-api-access-k6nxd\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18fc4602-515d-4c27-b186-0c8bceceaafa-konnectivity-ca\") pod \"konnectivity-agent-kfpbd\" (UID: \"18fc4602-515d-4c27-b186-0c8bceceaafa\") " pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-os-release\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-sys\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-host-slash\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-system-cni-dir\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.021683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-device-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.019998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-system-cni-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020018    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-systemd-units\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-iptables-alerter-script\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysconfig\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-os-release\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-k8s-cni-cncf-io\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4kmh\" (UniqueName: \"kubernetes.io/projected/944fcc76-fdc1-4f50-ab8f-2ebc13791397-kube-api-access-z4kmh\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-run-ovn-kubernetes\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-modprobe-d\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-lib-modules\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-kubelet\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-ovn\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.022769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovn-node-metrics-cert\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovnkube-script-lib\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-host\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-k8s-cni-cncf-io\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-cni-multus\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-socket-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.020489    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysctl-conf\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-device-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx2ck\" (UniqueName: \"kubernetes.io/projected/a794efb7-7e64-40b6-b1be-856faac833b5-kube-api-access-dx2ck\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.020586    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs podName:cc8a66fc-7990-49ff-8620-e6f3214b96ce nodeName:}" failed. No retries permitted until 2026-07-10 18:17:22.52055664 +0000 UTC m=+3.193472424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs") pod "network-metrics-daemon-t2rtq" (UID: "cc8a66fc-7990-49ff-8620-e6f3214b96ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-env-overrides\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpswj\" (UniqueName: \"kubernetes.io/projected/5545911c-2885-4a2f-8a1c-9c96070e1ede-kube-api-access-dpswj\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqncx\" (UniqueName: \"kubernetes.io/projected/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-kube-api-access-cqncx\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-etc-kubernetes\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-host\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-cni-multus\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.023640 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysctl-conf\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-host\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-sys-fs\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-node-log\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.020986    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysconfig\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021007    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-run\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-kubernetes\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-kubernetes\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-cni-bin\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021085    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021141    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-var-lib-kubelet\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021198    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-etc-kubernetes\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021256    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-socket-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021351    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-os-release\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021369    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-system-cni-dir\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-sys\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysctl-d\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.024571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-cnibin\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-modprobe-d\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021493    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-os-release\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-var-lib-kubelet\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021539    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-var-lib-kubelet\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021560    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e807e592-0662-4cde-b84b-741274d7b296-cnibin\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-cni-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-system-cni-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18fc4602-515d-4c27-b186-0c8bceceaafa-konnectivity-ca\") pod \"konnectivity-agent-kfpbd\" (UID: \"18fc4602-515d-4c27-b186-0c8bceceaafa\") " pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-socket-dir-parent\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-cni-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021902    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-hostroot\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-sysctl-d\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-socket-dir-parent\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.025637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-lib-modules\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18fc4602-515d-4c27-b186-0c8bceceaafa-agent-certs\") pod \"konnectivity-agent-kfpbd\" (UID: \"18fc4602-515d-4c27-b186-0c8bceceaafa\") " pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-registration-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.021994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-netns\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be0ac423-184e-4f33-91fa-1a82b7562109-registration-dir\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-conf-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-netns\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-slash\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-conf-dir\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovnkube-config\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022419    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/944fcc76-fdc1-4f50-ab8f-2ebc13791397-cni-binary-copy\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zldxh\" (UniqueName: \"kubernetes.io/projected/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-kube-api-access-zldxh\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-systemd\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-cni-bin\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.026644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-cni-netd\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-kubelet-config\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb4k2\" (UniqueName: \"kubernetes.io/projected/e807e592-0662-4cde-b84b-741274d7b296-kube-api-access-cb4k2\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-cnibin\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-daemon-config\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-cnibin\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-var-lib-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af29cd1b-dd41-4581-b5f4-062b07cce95d-hosts-file\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.022989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-systemd\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/944fcc76-fdc1-4f50-ab8f-2ebc13791397-cni-binary-copy\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-run-netns\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023047    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a794efb7-7e64-40b6-b1be-856faac833b5-etc-systemd\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-log-socket\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af29cd1b-dd41-4581-b5f4-062b07cce95d-tmp-dir\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-multus-certs\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.027554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-serviceca\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-kubelet\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023348    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/944fcc76-fdc1-4f50-ab8f-2ebc13791397-multus-daemon-config\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/944fcc76-fdc1-4f50-ab8f-2ebc13791397-host-run-multus-certs\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-etc-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.023681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e807e592-0662-4cde-b84b-741274d7b296-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.025913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a794efb7-7e64-40b6-b1be-856faac833b5-etc-tuned\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.026185    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18fc4602-515d-4c27-b186-0c8bceceaafa-agent-certs\") pod \"konnectivity-agent-kfpbd\" (UID: \"18fc4602-515d-4c27-b186-0c8bceceaafa\") " pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:22.028424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.028121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a794efb7-7e64-40b6-b1be-856faac833b5-tmp\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.039878 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.039796    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4gc\" (UniqueName: \"kubernetes.io/projected/cc8a66fc-7990-49ff-8620-e6f3214b96ce-kube-api-access-rf4gc\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:22.040179 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.039901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4kmh\" (UniqueName: \"kubernetes.io/projected/944fcc76-fdc1-4f50-ab8f-2ebc13791397-kube-api-access-z4kmh\") pod \"multus-x48np\" (UID: \"944fcc76-fdc1-4f50-ab8f-2ebc13791397\") " pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.040179 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.040157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx2ck\" (UniqueName: \"kubernetes.io/projected/a794efb7-7e64-40b6-b1be-856faac833b5-kube-api-access-dx2ck\") pod \"tuned-87j8b\" (UID: \"a794efb7-7e64-40b6-b1be-856faac833b5\") " pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.040972 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.040568    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nxd\" (UniqueName: \"kubernetes.io/projected/be0ac423-184e-4f33-91fa-1a82b7562109-kube-api-access-k6nxd\") pod \"aws-ebs-csi-driver-node-kbtbj\" (UID: \"be0ac423-184e-4f33-91fa-1a82b7562109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.040972 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.040881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb4k2\" (UniqueName: \"kubernetes.io/projected/e807e592-0662-4cde-b84b-741274d7b296-kube-api-access-cb4k2\") pod \"multus-additional-cni-plugins-9pbn8\" (UID: \"e807e592-0662-4cde-b84b-741274d7b296\") " pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.124248 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-host-slash\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-systemd-units\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-host-slash\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-iptables-alerter-script\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-run-ovn-kubernetes\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124385    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-systemd-units\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-ovn\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovn-node-metrics-cert\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-run-ovn-kubernetes\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovnkube-script-lib\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-env-overrides\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpswj\" (UniqueName: \"kubernetes.io/projected/5545911c-2885-4a2f-8a1c-9c96070e1ede-kube-api-access-dpswj\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqncx\" (UniqueName: \"kubernetes.io/projected/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-kube-api-access-cqncx\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-host\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-node-log\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-slash\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovnkube-config\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124739    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zldxh\" (UniqueName: \"kubernetes.io/projected/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-kube-api-access-zldxh\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-systemd\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-ovn\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-cni-bin\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-cni-netd\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-node-log\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-slash\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.124954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.124948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-iptables-alerter-script\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-host\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125103    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-run-systemd\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-kubelet-config\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-var-lib-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af29cd1b-dd41-4581-b5f4-062b07cce95d-hosts-file\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-run-netns\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-log-socket\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-cni-bin\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af29cd1b-dd41-4581-b5f4-062b07cce95d-tmp-dir\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-env-overrides\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.125413    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af29cd1b-dd41-4581-b5f4-062b07cce95d-hosts-file\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-var-lib-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-cni-netd\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126008 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.125602    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret podName:c85a26b2-a7d3-4a3b-8e1b-6256359a5227 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:22.625584348 +0000 UTC m=+3.298500143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret") pod "global-pull-secret-syncer-qsjnf" (UID: "c85a26b2-a7d3-4a3b-8e1b-6256359a5227") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-serviceca\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovnkube-config\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125620    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-kubelet-config\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-kubelet\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-run-netns\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125662    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovnkube-script-lib\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-etc-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125703    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-log-socket\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125708    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af29cd1b-dd41-4581-b5f4-062b07cce95d-tmp-dir\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-kubelet\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-etc-openvswitch\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125762    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5545911c-2885-4a2f-8a1c-9c96070e1ede-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-dbus\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cccs2\" (UniqueName: \"kubernetes.io/projected/af29cd1b-dd41-4581-b5f4-062b07cce95d-kube-api-access-cccs2\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-serviceca\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.126937 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.125920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-dbus\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.128634 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.128607    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5545911c-2885-4a2f-8a1c-9c96070e1ede-ovn-node-metrics-cert\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.133542 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.133469    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:17:22.133542 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.133500    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:17:22.133542 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.133516    2577 projected.go:196] Error preparing data for projected volume kube-api-access-lj7cj for pod openshift-network-diagnostics/network-check-target-gb9lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:22.133871 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.133597    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj podName:63c71215-6a85-4af9-a0b5-29f1d2c0b4b4 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:22.633563993 +0000 UTC m=+3.306479771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lj7cj" (UniqueName: "kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj") pod "network-check-target-gb9lp" (UID: "63c71215-6a85-4af9-a0b5-29f1d2c0b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:22.134091 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.134012    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal" event={"ID":"c50dc436f615212845a6d6b895b3210b","Type":"ContainerStarted","Data":"34118ca4059f27995e0bad3f15b7079858e8ea56cfad3ee6611145b416a0d3e4"}
Jul 10 18:17:22.135637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.135608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal" event={"ID":"72cb18cb3fb4068aeb8f6193b76687d6","Type":"ContainerStarted","Data":"6ae62d22736ddf96f825520ccca761901d5fbcbdc419a234cea3fb0cc507f51f"}
Jul 10 18:17:22.136722 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.136698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zldxh\" (UniqueName: \"kubernetes.io/projected/c853e25f-65cb-4393-b0bf-af5f3a2b83d9-kube-api-access-zldxh\") pod \"node-ca-vwl86\" (UID: \"c853e25f-65cb-4393-b0bf-af5f3a2b83d9\") " pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.137156 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.137132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cccs2\" (UniqueName: \"kubernetes.io/projected/af29cd1b-dd41-4581-b5f4-062b07cce95d-kube-api-access-cccs2\") pod \"node-resolver-n4575\" (UID: \"af29cd1b-dd41-4581-b5f4-062b07cce95d\") " pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.138120 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.138094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqncx\" (UniqueName: \"kubernetes.io/projected/bfa90976-1ac3-4836-a33e-c34fdc2ae7d5-kube-api-access-cqncx\") pod \"iptables-alerter-bdcd7\" (UID: \"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5\") " pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.139338 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.139316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpswj\" (UniqueName: \"kubernetes.io/projected/5545911c-2885-4a2f-8a1c-9c96070e1ede-kube-api-access-dpswj\") pod \"ovnkube-node-d8kmc\" (UID: \"5545911c-2885-4a2f-8a1c-9c96070e1ede\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.218530 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.218492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:22.227602 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.227564    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18fc4602_515d_4c27_b186_0c8bceceaafa.slice/crio-a67a433df2f7231d4f3eabd0bb24a3050a3b00f51929462ef55deb4e1f213baf WatchSource:0}: Error finding container a67a433df2f7231d4f3eabd0bb24a3050a3b00f51929462ef55deb4e1f213baf: Status 404 returned error can't find the container with id a67a433df2f7231d4f3eabd0bb24a3050a3b00f51929462ef55deb4e1f213baf
Jul 10 18:17:22.228473 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.228444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj"
Jul 10 18:17:22.237593 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.237547    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0ac423_184e_4f33_91fa_1a82b7562109.slice/crio-f1969e784436fd40f8faab1694d52952bae0dd81ab0519435fae912b37548b57 WatchSource:0}: Error finding container f1969e784436fd40f8faab1694d52952bae0dd81ab0519435fae912b37548b57: Status 404 returned error can't find the container with id f1969e784436fd40f8faab1694d52952bae0dd81ab0519435fae912b37548b57
Jul 10 18:17:22.239667 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.239649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9pbn8"
Jul 10 18:17:22.247340 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.247313    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87j8b"
Jul 10 18:17:22.249701 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.249667    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode807e592_0662_4cde_b84b_741274d7b296.slice/crio-cb329bb7f8e5d856872467c631ea3ff726bfc45d17ca9ec2098110d82a76335d WatchSource:0}: Error finding container cb329bb7f8e5d856872467c631ea3ff726bfc45d17ca9ec2098110d82a76335d: Status 404 returned error can't find the container with id cb329bb7f8e5d856872467c631ea3ff726bfc45d17ca9ec2098110d82a76335d
Jul 10 18:17:22.257258 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.257210    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda794efb7_7e64_40b6_b1be_856faac833b5.slice/crio-a628f5544fb48eae3f18d2631d36a6550cb7151115c1913157939ab74e120d5e WatchSource:0}: Error finding container a628f5544fb48eae3f18d2631d36a6550cb7151115c1913157939ab74e120d5e: Status 404 returned error can't find the container with id a628f5544fb48eae3f18d2631d36a6550cb7151115c1913157939ab74e120d5e
Jul 10 18:17:22.258144 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.258123    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x48np"
Jul 10 18:17:22.268238 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.268187    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bdcd7"
Jul 10 18:17:22.268613 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.268568    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944fcc76_fdc1_4f50_ab8f_2ebc13791397.slice/crio-c6652038cd9d9a0ab16ab595e34730de9835ab9717fd51b6b81c9a533f42cdff WatchSource:0}: Error finding container c6652038cd9d9a0ab16ab595e34730de9835ab9717fd51b6b81c9a533f42cdff: Status 404 returned error can't find the container with id c6652038cd9d9a0ab16ab595e34730de9835ab9717fd51b6b81c9a533f42cdff
Jul 10 18:17:22.278877 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.278661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n4575"
Jul 10 18:17:22.280440 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.280407    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa90976_1ac3_4836_a33e_c34fdc2ae7d5.slice/crio-3dee97add10c3af8fb9dc8316f4bcec42e19e414a9ed516319116d18e2e946f5 WatchSource:0}: Error finding container 3dee97add10c3af8fb9dc8316f4bcec42e19e414a9ed516319116d18e2e946f5: Status 404 returned error can't find the container with id 3dee97add10c3af8fb9dc8316f4bcec42e19e414a9ed516319116d18e2e946f5
Jul 10 18:17:22.287502 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.287464    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:22.290464 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.290436    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf29cd1b_dd41_4581_b5f4_062b07cce95d.slice/crio-b0270b28697ddc1ab14ea242deaa5d79f96cf9ba0a85776a6963cb72457c5da3 WatchSource:0}: Error finding container b0270b28697ddc1ab14ea242deaa5d79f96cf9ba0a85776a6963cb72457c5da3: Status 404 returned error can't find the container with id b0270b28697ddc1ab14ea242deaa5d79f96cf9ba0a85776a6963cb72457c5da3
Jul 10 18:17:22.294924 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.294706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vwl86"
Jul 10 18:17:22.300759 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.300728    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5545911c_2885_4a2f_8a1c_9c96070e1ede.slice/crio-b54572e001c68a027b5fffc8dae511fe8479d11e38c6eb6dd1214486201d12c2 WatchSource:0}: Error finding container b54572e001c68a027b5fffc8dae511fe8479d11e38c6eb6dd1214486201d12c2: Status 404 returned error can't find the container with id b54572e001c68a027b5fffc8dae511fe8479d11e38c6eb6dd1214486201d12c2
Jul 10 18:17:22.310058 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:22.310022    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc853e25f_65cb_4393_b0bf_af5f3a2b83d9.slice/crio-b1e72c0bd721f686c147786e44ec2ca89043d0616f91f981e64186777fe2bfd7 WatchSource:0}: Error finding container b1e72c0bd721f686c147786e44ec2ca89043d0616f91f981e64186777fe2bfd7: Status 404 returned error can't find the container with id b1e72c0bd721f686c147786e44ec2ca89043d0616f91f981e64186777fe2bfd7
Jul 10 18:17:22.530250 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.530209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:22.530576 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.530426    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:22.530576 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.530509    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs podName:cc8a66fc-7990-49ff-8620-e6f3214b96ce nodeName:}" failed. No retries permitted until 2026-07-10 18:17:23.5304852 +0000 UTC m=+4.203400995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs") pod "network-metrics-daemon-t2rtq" (UID: "cc8a66fc-7990-49ff-8620-e6f3214b96ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:22.630788 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.630750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:22.630982 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.630915    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:22.630982 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.630979    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret podName:c85a26b2-a7d3-4a3b-8e1b-6256359a5227 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:23.630965095 +0000 UTC m=+4.303880878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret") pod "global-pull-secret-syncer-qsjnf" (UID: "c85a26b2-a7d3-4a3b-8e1b-6256359a5227") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:22.731642 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.731604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:22.731817 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.731792    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:17:22.731861 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.731822    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:17:22.731861 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.731833    2577 projected.go:196] Error preparing data for projected volume kube-api-access-lj7cj for pod openshift-network-diagnostics/network-check-target-gb9lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:22.731927 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:22.731890    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj podName:63c71215-6a85-4af9-a0b5-29f1d2c0b4b4 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:23.73187388 +0000 UTC m=+4.404789660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lj7cj" (UniqueName: "kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj") pod "network-check-target-gb9lp" (UID: "63c71215-6a85-4af9-a0b5-29f1d2c0b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:22.965757 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.965671    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:12:22 +0000 UTC" deadline="2028-02-27 17:34:46.938163132 +0000 UTC"
Jul 10 18:17:22.965757 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:22.965753    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14327h17m23.972414689s"
Jul 10 18:17:23.140891 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.140742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bdcd7" event={"ID":"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5","Type":"ContainerStarted","Data":"3dee97add10c3af8fb9dc8316f4bcec42e19e414a9ed516319116d18e2e946f5"}
Jul 10 18:17:23.143687 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.143647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87j8b" event={"ID":"a794efb7-7e64-40b6-b1be-856faac833b5","Type":"ContainerStarted","Data":"a628f5544fb48eae3f18d2631d36a6550cb7151115c1913157939ab74e120d5e"}
Jul 10 18:17:23.149180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.149134    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" event={"ID":"e807e592-0662-4cde-b84b-741274d7b296","Type":"ContainerStarted","Data":"cb329bb7f8e5d856872467c631ea3ff726bfc45d17ca9ec2098110d82a76335d"}
Jul 10 18:17:23.154978 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.154889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj" event={"ID":"be0ac423-184e-4f33-91fa-1a82b7562109","Type":"ContainerStarted","Data":"f1969e784436fd40f8faab1694d52952bae0dd81ab0519435fae912b37548b57"}
Jul 10 18:17:23.160831 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.160792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfpbd" event={"ID":"18fc4602-515d-4c27-b186-0c8bceceaafa","Type":"ContainerStarted","Data":"a67a433df2f7231d4f3eabd0bb24a3050a3b00f51929462ef55deb4e1f213baf"}
Jul 10 18:17:23.164181 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.164140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vwl86" event={"ID":"c853e25f-65cb-4393-b0bf-af5f3a2b83d9","Type":"ContainerStarted","Data":"b1e72c0bd721f686c147786e44ec2ca89043d0616f91f981e64186777fe2bfd7"}
Jul 10 18:17:23.171083 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.170959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"b54572e001c68a027b5fffc8dae511fe8479d11e38c6eb6dd1214486201d12c2"}
Jul 10 18:17:23.172761 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.172726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n4575" event={"ID":"af29cd1b-dd41-4581-b5f4-062b07cce95d","Type":"ContainerStarted","Data":"b0270b28697ddc1ab14ea242deaa5d79f96cf9ba0a85776a6963cb72457c5da3"}
Jul 10 18:17:23.177864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.177829    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x48np" event={"ID":"944fcc76-fdc1-4f50-ab8f-2ebc13791397","Type":"ContainerStarted","Data":"c6652038cd9d9a0ab16ab595e34730de9835ab9717fd51b6b81c9a533f42cdff"}
Jul 10 18:17:23.539561 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.539420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:23.539788 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:23.539606    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:23.539788 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:23.539693    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs podName:cc8a66fc-7990-49ff-8620-e6f3214b96ce nodeName:}" failed. No retries permitted until 2026-07-10 18:17:25.539670553 +0000 UTC m=+6.212586333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs") pod "network-metrics-daemon-t2rtq" (UID: "cc8a66fc-7990-49ff-8620-e6f3214b96ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:23.640730 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.640628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:23.640932 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:23.640803    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:23.640932 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:23.640877    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret podName:c85a26b2-a7d3-4a3b-8e1b-6256359a5227 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:25.640853586 +0000 UTC m=+6.313769458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret") pod "global-pull-secret-syncer-qsjnf" (UID: "c85a26b2-a7d3-4a3b-8e1b-6256359a5227") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:23.741708 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.741663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:23.741916 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:23.741890    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:17:23.742018 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:23.741919    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:17:23.742018 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:23.741933    2577 projected.go:196] Error preparing data for projected volume kube-api-access-lj7cj for pod openshift-network-diagnostics/network-check-target-gb9lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:23.742018 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:23.741996    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj podName:63c71215-6a85-4af9-a0b5-29f1d2c0b4b4 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:25.741977085 +0000 UTC m=+6.414893128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lj7cj" (UniqueName: "kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj") pod "network-check-target-gb9lp" (UID: "63c71215-6a85-4af9-a0b5-29f1d2c0b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:23.966043 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.965946    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:12:22 +0000 UTC" deadline="2028-02-24 12:36:00.733391874 +0000 UTC"
Jul 10 18:17:23.966043 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:23.965992    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14250h18m36.76740656s"
Jul 10 18:17:24.128477 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:24.128441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:24.128705 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:24.128589    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:24.129083 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:24.129057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:24.129206 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:24.129184    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:24.129289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:24.129261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:24.129463 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:24.129430    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:25.206147 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:25.205042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal" event={"ID":"c50dc436f615212845a6d6b895b3210b","Type":"ContainerStarted","Data":"71c6e1decb0bbe2301cc021389d167c06c165442b5626d633deb7be51732663e"}
Jul 10 18:17:25.560491 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:25.560449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:25.560658 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:25.560642    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:25.560735 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:25.560728    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs podName:cc8a66fc-7990-49ff-8620-e6f3214b96ce nodeName:}" failed. No retries permitted until 2026-07-10 18:17:29.560707345 +0000 UTC m=+10.233623139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs") pod "network-metrics-daemon-t2rtq" (UID: "cc8a66fc-7990-49ff-8620-e6f3214b96ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:25.662547 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:25.661921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:25.662547 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:25.662084    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:25.662547 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:25.662151    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret podName:c85a26b2-a7d3-4a3b-8e1b-6256359a5227 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:29.662131631 +0000 UTC m=+10.335047431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret") pod "global-pull-secret-syncer-qsjnf" (UID: "c85a26b2-a7d3-4a3b-8e1b-6256359a5227") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:25.763167 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:25.763071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:25.763371 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:25.763335    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:17:25.763371 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:25.763361    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:17:25.763490 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:25.763376    2577 projected.go:196] Error preparing data for projected volume kube-api-access-lj7cj for pod openshift-network-diagnostics/network-check-target-gb9lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:25.763490 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:25.763441    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj podName:63c71215-6a85-4af9-a0b5-29f1d2c0b4b4 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:29.763419685 +0000 UTC m=+10.436335468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lj7cj" (UniqueName: "kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj") pod "network-check-target-gb9lp" (UID: "63c71215-6a85-4af9-a0b5-29f1d2c0b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:26.129956 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:26.128914    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:26.129956 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:26.129055    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:26.129956 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:26.129482    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:26.129956 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:26.129590    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:26.129956 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:26.129686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:26.129956 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:26.129773    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:26.212376 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:26.211948    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal" event={"ID":"72cb18cb3fb4068aeb8f6193b76687d6","Type":"ContainerStarted","Data":"3a592cbf08fd4c7fc761d23438d0fd2ebcc0c4b57e233b50b05e4221b85caaf4"}
Jul 10 18:17:26.229319 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:26.228759    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-167.ec2.internal" podStartSLOduration=5.228733724 podStartE2EDuration="5.228733724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:25.223711498 +0000 UTC m=+5.896627304" watchObservedRunningTime="2026-07-10 18:17:26.228733724 +0000 UTC m=+6.901649529"
Jul 10 18:17:27.217279 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:27.216866    2577 generic.go:356] "Generic (PLEG): container finished" podID="72cb18cb3fb4068aeb8f6193b76687d6" containerID="3a592cbf08fd4c7fc761d23438d0fd2ebcc0c4b57e233b50b05e4221b85caaf4" exitCode=0
Jul 10 18:17:27.217279 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:27.216917    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal" event={"ID":"72cb18cb3fb4068aeb8f6193b76687d6","Type":"ContainerDied","Data":"3a592cbf08fd4c7fc761d23438d0fd2ebcc0c4b57e233b50b05e4221b85caaf4"}
Jul 10 18:17:28.126625 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:28.126589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:28.126846 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:28.126646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:28.126846 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:28.126731    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:28.126846 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:28.126828    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:28.127057 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:28.126897    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:28.127057 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:28.126977    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:29.598623 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:29.598581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:29.599074 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:29.598756    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:29.599074 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:29.598835    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs podName:cc8a66fc-7990-49ff-8620-e6f3214b96ce nodeName:}" failed. No retries permitted until 2026-07-10 18:17:37.598813075 +0000 UTC m=+18.271728857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs") pod "network-metrics-daemon-t2rtq" (UID: "cc8a66fc-7990-49ff-8620-e6f3214b96ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:29.699308 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:29.699272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:29.699486 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:29.699399    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:29.699486 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:29.699461    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret podName:c85a26b2-a7d3-4a3b-8e1b-6256359a5227 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:37.699441405 +0000 UTC m=+18.372357182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret") pod "global-pull-secret-syncer-qsjnf" (UID: "c85a26b2-a7d3-4a3b-8e1b-6256359a5227") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:29.800443 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:29.800373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:29.800634 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:29.800518    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:17:29.800634 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:29.800540    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:17:29.800634 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:29.800552    2577 projected.go:196] Error preparing data for projected volume kube-api-access-lj7cj for pod openshift-network-diagnostics/network-check-target-gb9lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:29.800634 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:29.800614    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj podName:63c71215-6a85-4af9-a0b5-29f1d2c0b4b4 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:37.800597046 +0000 UTC m=+18.473512841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lj7cj" (UniqueName: "kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj") pod "network-check-target-gb9lp" (UID: "63c71215-6a85-4af9-a0b5-29f1d2c0b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:30.128701 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:30.128274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:30.128701 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:30.128367    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:30.128701 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:30.128434    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:30.128701 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:30.128543    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:30.128701 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:30.128609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:30.129097 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:30.128727    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:32.130627 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:32.130552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:32.130627 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:32.130575    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:32.130627 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:32.130552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:32.131259 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:32.130681    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:32.131259 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:32.130791    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:32.131259 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:32.130897    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:34.126783 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:34.126742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:34.127211 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:34.126743    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:34.127211 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:34.126894    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:34.127211 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:34.126757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:34.127211 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:34.126967    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:34.127211 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:34.127058    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:36.126724 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:36.126651    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:36.126724 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:36.126666    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:36.127315 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:36.126795    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:36.127315 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:36.126881    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:36.127315 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:36.126909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:36.127315 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:36.126994    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:37.658765 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:37.658726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:37.659158 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:37.658878    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:37.659158 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:37.658942    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs podName:cc8a66fc-7990-49ff-8620-e6f3214b96ce nodeName:}" failed. No retries permitted until 2026-07-10 18:17:53.658925229 +0000 UTC m=+34.331841008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs") pod "network-metrics-daemon-t2rtq" (UID: "cc8a66fc-7990-49ff-8620-e6f3214b96ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:37.759832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:37.759780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:37.760008 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:37.759940    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:37.760008 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:37.760000    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret podName:c85a26b2-a7d3-4a3b-8e1b-6256359a5227 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:53.75998243 +0000 UTC m=+34.432898207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret") pod "global-pull-secret-syncer-qsjnf" (UID: "c85a26b2-a7d3-4a3b-8e1b-6256359a5227") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:37.860634 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:37.860594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:37.860824 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:37.860794    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:17:37.860824 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:37.860824    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:17:37.860906 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:37.860840    2577 projected.go:196] Error preparing data for projected volume kube-api-access-lj7cj for pod openshift-network-diagnostics/network-check-target-gb9lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:37.860946 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:37.860905    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj podName:63c71215-6a85-4af9-a0b5-29f1d2c0b4b4 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:53.860881821 +0000 UTC m=+34.533797599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lj7cj" (UniqueName: "kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj") pod "network-check-target-gb9lp" (UID: "63c71215-6a85-4af9-a0b5-29f1d2c0b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:38.129912 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:38.129885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:38.129912 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:38.129898    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:38.129912 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:38.129893    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:38.130252 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:38.130011    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:38.130252 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:38.130061    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:38.130252 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:38.130155    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:40.128002 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:40.127962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:40.128548 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:40.128093    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:40.128548 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:40.128125    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:40.128548 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:40.128275    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:40.128548 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:40.128366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:40.128548 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:40.128447    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:42.126788 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:42.126753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:42.126788 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:42.126789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:42.127298 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:42.126762    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:42.127298 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:42.126881    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:42.127298 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:42.126937    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:42.127298 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:42.127007    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:43.252790 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.252391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal" event={"ID":"72cb18cb3fb4068aeb8f6193b76687d6","Type":"ContainerStarted","Data":"4d553de92d294fb7951311a28e3d56e0d0d745edeb6c2ef169d8b092895f5428"}
Jul 10 18:17:43.253972 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.253948    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87j8b" event={"ID":"a794efb7-7e64-40b6-b1be-856faac833b5","Type":"ContainerStarted","Data":"82f8170235aeaed859a6062ccc2f965cc8b9ae1472b10175ffe8bb388cc118e3"}
Jul 10 18:17:43.255386 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.255358    2577 generic.go:356] "Generic (PLEG): container finished" podID="e807e592-0662-4cde-b84b-741274d7b296" containerID="a033752509cb126044a8044268d06c7699b284fe49cf061ea4c4b0880fb1cdb7" exitCode=0
Jul 10 18:17:43.255491 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.255442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" event={"ID":"e807e592-0662-4cde-b84b-741274d7b296","Type":"ContainerDied","Data":"a033752509cb126044a8044268d06c7699b284fe49cf061ea4c4b0880fb1cdb7"}
Jul 10 18:17:43.257108 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.257080    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj" event={"ID":"be0ac423-184e-4f33-91fa-1a82b7562109","Type":"ContainerStarted","Data":"1fb4099332a59820ad8ce512041660c0f10af4c888420ab5e75d79ab3e835e70"}
Jul 10 18:17:43.258608 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.258587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfpbd" event={"ID":"18fc4602-515d-4c27-b186-0c8bceceaafa","Type":"ContainerStarted","Data":"aa65895d04b6e35ab1d9221e03811dc90b50091a205b9b1a9c7308410da3faf2"}
Jul 10 18:17:43.259940 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.259911    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vwl86" event={"ID":"c853e25f-65cb-4393-b0bf-af5f3a2b83d9","Type":"ContainerStarted","Data":"c15e024d6afa6c4f9e0ae945c3713c7ef0eb6f95c574a605c397ac1008f5588f"}
Jul 10 18:17:43.262701 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.262678    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:17:43.262988 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.262965    2577 generic.go:356] "Generic (PLEG): container finished" podID="5545911c-2885-4a2f-8a1c-9c96070e1ede" containerID="0e8ca4bc17d8e8fa01981c2d2d2b01071fe4f86a4f2cfcca10137d21e3118156" exitCode=1
Jul 10 18:17:43.263096 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.262996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"912f191bd358e80487a385a95890e32c8905aba602f023d0bcd5055d68a9201b"}
Jul 10 18:17:43.263096 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.263075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"dd9edcc4609f50611a0a157e11fcbde3b3446900b9e3415ad5a1b145a59ee046"}
Jul 10 18:17:43.263190 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.263121    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"51b56eee28b2459951b69482d73e5867b11dbe53de533a60a1ee2bbbd01c0679"}
Jul 10 18:17:43.263190 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.263164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"4295f28532d4454ebe0b72a82c80bc558ea46558a43bc1fb180c2b924660b587"}
Jul 10 18:17:43.263288 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.263209    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerDied","Data":"0e8ca4bc17d8e8fa01981c2d2d2b01071fe4f86a4f2cfcca10137d21e3118156"}
Jul 10 18:17:43.263288 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.263281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"eefece8fe4563adcea1bed879beca4cdbc4b31802aa96ad1d2b0a7c959f38cce"}
Jul 10 18:17:43.264367 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.264341    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n4575" event={"ID":"af29cd1b-dd41-4581-b5f4-062b07cce95d","Type":"ContainerStarted","Data":"abfa081af3154e45f8868b75f914333a0a6e23682cb519228b370d682159adc7"}
Jul 10 18:17:43.265740 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.265717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x48np" event={"ID":"944fcc76-fdc1-4f50-ab8f-2ebc13791397","Type":"ContainerStarted","Data":"3136340ffef1107d3f771daa7bd7b120aa642c778eca318b21e09f70144b3bdb"}
Jul 10 18:17:43.268709 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.268663    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-167.ec2.internal" podStartSLOduration=22.268650186 podStartE2EDuration="22.268650186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:43.267838585 +0000 UTC m=+23.940754384" watchObservedRunningTime="2026-07-10 18:17:43.268650186 +0000 UTC m=+23.941565986"
Jul 10 18:17:43.283930 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.283878    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kfpbd" podStartSLOduration=3.341601643 podStartE2EDuration="23.283859796s" totalImagesPullingTime="19.942258153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:43.283196805 +0000 UTC m=+23.956112603" watchObservedRunningTime="2026-07-10 18:17:43.283859796 +0000 UTC m=+23.956775594"
Jul 10 18:17:43.304661 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.304609    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x48np" podStartSLOduration=3.202777016 podStartE2EDuration="23.304593054s" totalImagesPullingTime="20.101816038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:43.304140154 +0000 UTC m=+23.977055970" watchObservedRunningTime="2026-07-10 18:17:43.304593054 +0000 UTC m=+23.977508852"
Jul 10 18:17:43.319877 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.319829    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n4575" podStartSLOduration=3.441578985 podStartE2EDuration="23.31981353s" totalImagesPullingTime="19.878234545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:43.319556582 +0000 UTC m=+23.992472382" watchObservedRunningTime="2026-07-10 18:17:43.31981353 +0000 UTC m=+23.992729330"
Jul 10 18:17:43.361509 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.361460    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-87j8b" podStartSLOduration=3.447133705 podStartE2EDuration="23.36143498s" totalImagesPullingTime="19.914301275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:43.361189625 +0000 UTC m=+24.034105439" watchObservedRunningTime="2026-07-10 18:17:43.36143498 +0000 UTC m=+24.034350778"
Jul 10 18:17:43.378512 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.378461    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vwl86" podStartSLOduration=2.516894074 podStartE2EDuration="22.378445507s" totalImagesPullingTime="19.861551433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:43.377982159 +0000 UTC m=+24.050897976" watchObservedRunningTime="2026-07-10 18:17:43.378445507 +0000 UTC m=+24.051361305"
Jul 10 18:17:43.556421 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:43.556393    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 18:17:44.001177 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.001005    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:17:43.556412385Z","UUID":"00ee02b6-9eed-451b-aea6-30acb3a15860","Handler":null,"Name":"","Endpoint":""}
Jul 10 18:17:44.002803 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.002779    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 18:17:44.002971 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.002821    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 18:17:44.126908 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.126874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:44.126908 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.126873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:44.127160 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.127060    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:44.127160 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:44.127073    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:44.127285 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:44.127155    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:44.127285 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:44.127241    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:44.270295 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.270172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj" event={"ID":"be0ac423-184e-4f33-91fa-1a82b7562109","Type":"ContainerStarted","Data":"f7e7b9bab1198b3928c2cba615d3ce64ff4fd19c69c0f9d419d022e38be45622"}
Jul 10 18:17:44.271831 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.271773    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bdcd7" event={"ID":"bfa90976-1ac3-4836-a33e-c34fdc2ae7d5","Type":"ContainerStarted","Data":"1b50a71668f94621d9acefdefbf4243b52b7b5182b6a99bd74ed12a2e1b75769"}
Jul 10 18:17:44.288725 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:44.288658    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bdcd7" podStartSLOduration=4.401688487 podStartE2EDuration="24.288635845s" totalImagesPullingTime="19.886947358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:44.288087131 +0000 UTC m=+24.961002922" watchObservedRunningTime="2026-07-10 18:17:44.288635845 +0000 UTC m=+24.961551650"
Jul 10 18:17:45.276121 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:45.275830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj" event={"ID":"be0ac423-184e-4f33-91fa-1a82b7562109","Type":"ContainerStarted","Data":"b57fa8afe3d154c953abdeace56f105472a40bfb6099cd04b357bd5ec6f49145"}
Jul 10 18:17:45.278851 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:45.278831    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:17:45.279261 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:45.279236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"d87ddd71080fc50d922e7da83eff697585f7f8271d74d648d0ccad03b4713625"}
Jul 10 18:17:45.294953 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:45.294901    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbtbj" podStartSLOduration=3.257062266 podStartE2EDuration="25.294883463s" totalImagesPullingTime="22.037821197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:45.294396961 +0000 UTC m=+25.967312772" watchObservedRunningTime="2026-07-10 18:17:45.294883463 +0000 UTC m=+25.967799259"
Jul 10 18:17:45.397355 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:45.397320    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:45.398044 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:45.398029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:46.126656 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:46.126612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:46.126656 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:46.126635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:46.127013 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:46.126794    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:46.127013 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:46.126834    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:46.127013 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:46.126930    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:46.127013 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:46.127001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:46.281537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:46.281501    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:46.282031 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:46.281973    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kfpbd"
Jul 10 18:17:48.127385 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:48.127102    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:48.128052 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:48.127114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:48.128052 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:48.127485    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:48.128052 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:48.127135    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:48.128052 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:48.127531    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:48.128052 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:48.127624    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:48.288148 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:48.288057    2577 generic.go:356] "Generic (PLEG): container finished" podID="e807e592-0662-4cde-b84b-741274d7b296" containerID="f299b9e68859c0d65de1b3ac7fcef679b12bf4b7325f78d7be3057405e4dcd8a" exitCode=0
Jul 10 18:17:48.288148 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:48.288109    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" event={"ID":"e807e592-0662-4cde-b84b-741274d7b296","Type":"ContainerDied","Data":"f299b9e68859c0d65de1b3ac7fcef679b12bf4b7325f78d7be3057405e4dcd8a"}
Jul 10 18:17:48.291864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:48.291845    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:17:48.292242 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:48.292201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"6f7f0de7ec6140484311d7cc6e0bd12b256a54e236bd5cf91e635c465fe96131"}
Jul 10 18:17:48.292650 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:48.292631    2577 scope.go:117] "RemoveContainer" containerID="0e8ca4bc17d8e8fa01981c2d2d2b01071fe4f86a4f2cfcca10137d21e3118156"
Jul 10 18:17:49.298950 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.298913    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:17:49.299625 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.299314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" event={"ID":"5545911c-2885-4a2f-8a1c-9c96070e1ede","Type":"ContainerStarted","Data":"23c16a9330ece6fb14123d73cf42caddade803e6cdd49fe464e88768167c5b36"}
Jul 10 18:17:49.299625 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.299577    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:49.299740 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.299638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:49.299740 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.299678    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:49.315777 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.315754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:49.315983 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.315967    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:17:49.326742 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.326692    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc" podStartSLOduration=9.403924523 podStartE2EDuration="29.326676352s" totalImagesPullingTime="19.922751829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:49.326215559 +0000 UTC m=+29.999131358" watchObservedRunningTime="2026-07-10 18:17:49.326676352 +0000 UTC m=+29.999592150"
Jul 10 18:17:49.981285 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.981248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qsjnf"]
Jul 10 18:17:49.981439 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.981371    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:49.981491 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:49.981466    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:49.985234 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.985179    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gb9lp"]
Jul 10 18:17:49.985370 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.985316    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:49.985451 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:49.985426    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:49.985803 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.985778    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t2rtq"]
Jul 10 18:17:49.985898 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:49.985884    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:49.986017 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:49.985996    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:50.304050 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:50.303954    2577 generic.go:356] "Generic (PLEG): container finished" podID="e807e592-0662-4cde-b84b-741274d7b296" containerID="ad263a4c4a1a2d04ea72c7fb8e86c9be95624b90c6d334e5b2e0654032be691a" exitCode=0
Jul 10 18:17:50.304050 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:50.304031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" event={"ID":"e807e592-0662-4cde-b84b-741274d7b296","Type":"ContainerDied","Data":"ad263a4c4a1a2d04ea72c7fb8e86c9be95624b90c6d334e5b2e0654032be691a"}
Jul 10 18:17:52.130389 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:52.130298    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:52.130966 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:52.130298    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:52.130966 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:52.130407    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:52.130966 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:52.130479    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:52.130966 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:52.130312    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:52.130966 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:52.130565    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:52.310335 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:52.310304    2577 generic.go:356] "Generic (PLEG): container finished" podID="e807e592-0662-4cde-b84b-741274d7b296" containerID="15b3d9fc5b10b5957e12824caff2c9f4dd19b0523d0095ac430f9b77679bd254" exitCode=0
Jul 10 18:17:52.310490 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:52.310355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" event={"ID":"e807e592-0662-4cde-b84b-741274d7b296","Type":"ContainerDied","Data":"15b3d9fc5b10b5957e12824caff2c9f4dd19b0523d0095ac430f9b77679bd254"}
Jul 10 18:17:53.689195 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:53.689158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:53.689802 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:53.689348    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:53.689802 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:53.689421    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs podName:cc8a66fc-7990-49ff-8620-e6f3214b96ce nodeName:}" failed. No retries permitted until 2026-07-10 18:18:25.689401683 +0000 UTC m=+66.362317460 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs") pod "network-metrics-daemon-t2rtq" (UID: "cc8a66fc-7990-49ff-8620-e6f3214b96ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:17:53.790513 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:53.790470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:53.790716 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:53.790655    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:53.790781 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:53.790732    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret podName:c85a26b2-a7d3-4a3b-8e1b-6256359a5227 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:25.790712718 +0000 UTC m=+66.463628495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret") pod "global-pull-secret-syncer-qsjnf" (UID: "c85a26b2-a7d3-4a3b-8e1b-6256359a5227") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:17:53.891097 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:53.891018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:53.891272 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:53.891165    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:17:53.891272 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:53.891181    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:17:53.891272 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:53.891190    2577 projected.go:196] Error preparing data for projected volume kube-api-access-lj7cj for pod openshift-network-diagnostics/network-check-target-gb9lp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:53.891272 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:53.891261    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj podName:63c71215-6a85-4af9-a0b5-29f1d2c0b4b4 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:25.891243731 +0000 UTC m=+66.564159516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lj7cj" (UniqueName: "kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj") pod "network-check-target-gb9lp" (UID: "63c71215-6a85-4af9-a0b5-29f1d2c0b4b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:17:54.131041 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:54.130965    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:54.131246 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:54.131092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:54.131246 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:54.131097    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gb9lp" podUID="63c71215-6a85-4af9-a0b5-29f1d2c0b4b4"
Jul 10 18:17:54.131246 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:54.131128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:54.131246 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:54.131239    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsjnf" podUID="c85a26b2-a7d3-4a3b-8e1b-6256359a5227"
Jul 10 18:17:54.131441 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:54.131343    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2rtq" podUID="cc8a66fc-7990-49ff-8620-e6f3214b96ce"
Jul 10 18:17:55.002919 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.002888    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-167.ec2.internal" event="NodeReady"
Jul 10 18:17:55.003409 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.003030    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 18:17:55.074175 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.074093    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d967fff95-kghwz"]
Jul 10 18:17:55.076505 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.076477    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.079332 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.079302    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 18:17:55.079456 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.079414    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6v2rr\""
Jul 10 18:17:55.079867 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.079697    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 18:17:55.079942 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.079892    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 18:17:55.087013 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.086985    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 18:17:55.088931 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.088906    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pn9wr"]
Jul 10 18:17:55.091119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.091096    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pn9wr"
Jul 10 18:17:55.093764 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.093735    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 18:17:55.093764 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.093752    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lzjfw\""
Jul 10 18:17:55.093936 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.093917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 18:17:55.094070 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.094050    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 18:17:55.095742 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.095721    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jrgzz"]
Jul 10 18:17:55.098397 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.097999    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.100209 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.100184    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p5qqq\""
Jul 10 18:17:55.100521 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.100500    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d967fff95-kghwz"]
Jul 10 18:17:55.100663 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.100649    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 18:17:55.101119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.101105    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 18:17:55.110022 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.109995    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pn9wr"]
Jul 10 18:17:55.113740 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.113706    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jrgzz"]
Jul 10 18:17:55.202529 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-tmp-dir\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.202529 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202534    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtg5j\" (UniqueName: \"kubernetes.io/projected/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-kube-api-access-rtg5j\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.202772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.202772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13ab2f4d-9269-4e8f-988c-78773639bbf9-ca-trust-extracted\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.202772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-certificates\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.202772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-config-volume\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.202772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzx7l\" (UniqueName: \"kubernetes.io/projected/54ea2926-1c78-4aac-b6ac-e1df01ddcdaa-kube-api-access-tzx7l\") pod \"ingress-canary-pn9wr\" (UID: \"54ea2926-1c78-4aac-b6ac-e1df01ddcdaa\") " pod="openshift-ingress-canary/ingress-canary-pn9wr"
Jul 10 18:17:55.202772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.202985 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-trusted-ca\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.202985 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-installation-pull-secrets\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.202985 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54ea2926-1c78-4aac-b6ac-e1df01ddcdaa-cert\") pod \"ingress-canary-pn9wr\" (UID: \"54ea2926-1c78-4aac-b6ac-e1df01ddcdaa\") " pod="openshift-ingress-canary/ingress-canary-pn9wr"
Jul 10 18:17:55.202985 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-bound-sa-token\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.202985 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjmc\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-kube-api-access-pjjmc\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.202985 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.202917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-image-registry-private-configuration\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.303842 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.303796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-bound-sa-token\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.303842 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.303846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjmc\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-kube-api-access-pjjmc\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.304061 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.303951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-image-registry-private-configuration\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.304183 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-tmp-dir\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.304354 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtg5j\" (UniqueName: \"kubernetes.io/projected/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-kube-api-access-rtg5j\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.304354 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.304470 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.304359    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:17:55.304470 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13ab2f4d-9269-4e8f-988c-78773639bbf9-ca-trust-extracted\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.304470 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-certificates\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.304470 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.304421    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls podName:0ead3efb-54c3-461f-af60-dcf7c3e54d7e nodeName:}" failed. No retries permitted until 2026-07-10 18:17:55.804399634 +0000 UTC m=+36.477315414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls") pod "dns-default-jrgzz" (UID: "0ead3efb-54c3-461f-af60-dcf7c3e54d7e") : secret "dns-default-metrics-tls" not found
Jul 10 18:17:55.304655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-config-volume\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.304655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzx7l\" (UniqueName: \"kubernetes.io/projected/54ea2926-1c78-4aac-b6ac-e1df01ddcdaa-kube-api-access-tzx7l\") pod \"ingress-canary-pn9wr\" (UID: \"54ea2926-1c78-4aac-b6ac-e1df01ddcdaa\") " pod="openshift-ingress-canary/ingress-canary-pn9wr"
Jul 10 18:17:55.304655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.304655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-trusted-ca\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.304655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-installation-pull-secrets\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.304886 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54ea2926-1c78-4aac-b6ac-e1df01ddcdaa-cert\") pod \"ingress-canary-pn9wr\" (UID: \"54ea2926-1c78-4aac-b6ac-e1df01ddcdaa\") " pod="openshift-ingress-canary/ingress-canary-pn9wr"
Jul 10 18:17:55.304886 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.304700    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:17:55.304886 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.304714    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d967fff95-kghwz: secret "image-registry-tls" not found
Jul 10 18:17:55.304886 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.304761    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls podName:13ab2f4d-9269-4e8f-988c-78773639bbf9 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:55.804743402 +0000 UTC m=+36.477659180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls") pod "image-registry-5d967fff95-kghwz" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9") : secret "image-registry-tls" not found
Jul 10 18:17:55.304886 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.304774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13ab2f4d-9269-4e8f-988c-78773639bbf9-ca-trust-extracted\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.305262 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.305196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-certificates\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.305262 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.305244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-tmp-dir\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.305597 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.305567    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-config-volume\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.305890 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.305831    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-trusted-ca\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.309691 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.309513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-installation-pull-secrets\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.309836 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.309515    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54ea2926-1c78-4aac-b6ac-e1df01ddcdaa-cert\") pod \"ingress-canary-pn9wr\" (UID: \"54ea2926-1c78-4aac-b6ac-e1df01ddcdaa\") " pod="openshift-ingress-canary/ingress-canary-pn9wr"
Jul 10 18:17:55.310016 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.309996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-image-registry-private-configuration\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.315648 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.315615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-bound-sa-token\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.315648 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.315635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtg5j\" (UniqueName: \"kubernetes.io/projected/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-kube-api-access-rtg5j\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.315886 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.315689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjmc\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-kube-api-access-pjjmc\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.316918 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.316854    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzx7l\" (UniqueName: \"kubernetes.io/projected/54ea2926-1c78-4aac-b6ac-e1df01ddcdaa-kube-api-access-tzx7l\") pod \"ingress-canary-pn9wr\" (UID: \"54ea2926-1c78-4aac-b6ac-e1df01ddcdaa\") " pod="openshift-ingress-canary/ingress-canary-pn9wr"
Jul 10 18:17:55.402433 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.402343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pn9wr"
Jul 10 18:17:55.809391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.809351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:55.809583 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.809437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:55.809583 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.809509    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:17:55.809583 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.809560    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:17:55.809583 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.809574    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d967fff95-kghwz: secret "image-registry-tls" not found
Jul 10 18:17:55.809791 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.809596    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls podName:0ead3efb-54c3-461f-af60-dcf7c3e54d7e nodeName:}" failed. No retries permitted until 2026-07-10 18:17:56.809575077 +0000 UTC m=+37.482490860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls") pod "dns-default-jrgzz" (UID: "0ead3efb-54c3-461f-af60-dcf7c3e54d7e") : secret "dns-default-metrics-tls" not found
Jul 10 18:17:55.809791 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:55.809613    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls podName:13ab2f4d-9269-4e8f-988c-78773639bbf9 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:56.809604398 +0000 UTC m=+37.482520178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls") pod "image-registry-5d967fff95-kghwz" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9") : secret "image-registry-tls" not found
Jul 10 18:17:55.819245 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.819111    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"]
Jul 10 18:17:55.821584 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.821560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:55.824133 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.824099    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 10 18:17:55.824281 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.824100    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ckcdx\""
Jul 10 18:17:55.824895 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.824869    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 10 18:17:55.833812 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.833784    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"]
Jul 10 18:17:55.910541 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.910507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b743100-ee27-469c-a38c-44c18163ae46-nginx-conf\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:55.910743 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:55.910562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:56.011271 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.011232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b743100-ee27-469c-a38c-44c18163ae46-nginx-conf\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:56.011769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.011413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:56.011769 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.011556    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 18:17:56.011769 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.011623    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert podName:2b743100-ee27-469c-a38c-44c18163ae46 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:56.511602174 +0000 UTC m=+37.184517999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-6jxtl" (UID: "2b743100-ee27-469c-a38c-44c18163ae46") : secret "networking-console-plugin-cert" not found
Jul 10 18:17:56.012079 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.012049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b743100-ee27-469c-a38c-44c18163ae46-nginx-conf\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:56.126708 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.126600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:17:56.126708 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.126602    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:17:56.126927 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.126749    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:17:56.129698 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.129659    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xs98z\""
Jul 10 18:17:56.129698 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.129694    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:17:56.129890 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.129822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:17:56.129890 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.129878    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:17:56.129994 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.129971    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nsh8q\""
Jul 10 18:17:56.130046 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.129992    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:17:56.516546 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.516509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:56.516726 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.516683    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 18:17:56.516786 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.516766    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert podName:2b743100-ee27-469c-a38c-44c18163ae46 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:57.516744044 +0000 UTC m=+38.189659835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-6jxtl" (UID: "2b743100-ee27-469c-a38c-44c18163ae46") : secret "networking-console-plugin-cert" not found
Jul 10 18:17:56.814540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.814505    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pn9wr"]
Jul 10 18:17:56.818897 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.818869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:56.818999 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:56.818931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:56.819053 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.819020    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:17:56.819053 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.819038    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d967fff95-kghwz: secret "image-registry-tls" not found
Jul 10 18:17:56.819053 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.819044    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:17:56.819207 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.819089    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls podName:13ab2f4d-9269-4e8f-988c-78773639bbf9 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:58.819074661 +0000 UTC m=+39.491990438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls") pod "image-registry-5d967fff95-kghwz" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9") : secret "image-registry-tls" not found
Jul 10 18:17:56.819207 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:56.819104    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls podName:0ead3efb-54c3-461f-af60-dcf7c3e54d7e nodeName:}" failed. No retries permitted until 2026-07-10 18:17:58.819096165 +0000 UTC m=+39.492011943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls") pod "dns-default-jrgzz" (UID: "0ead3efb-54c3-461f-af60-dcf7c3e54d7e") : secret "dns-default-metrics-tls" not found
Jul 10 18:17:56.819207 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:17:56.819159    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ea2926_1c78_4aac_b6ac_e1df01ddcdaa.slice/crio-7a2e230e9d6b038b73479b8b8e6ec735678326812c861f471d3865a68da3f347 WatchSource:0}: Error finding container 7a2e230e9d6b038b73479b8b8e6ec735678326812c861f471d3865a68da3f347: Status 404 returned error can't find the container with id 7a2e230e9d6b038b73479b8b8e6ec735678326812c861f471d3865a68da3f347
Jul 10 18:17:57.326822 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:57.326786    2577 generic.go:356] "Generic (PLEG): container finished" podID="e807e592-0662-4cde-b84b-741274d7b296" containerID="4538a8e78f6715c13431df00f84c29b63d234a62601effd0f0ac7735d997291c" exitCode=0
Jul 10 18:17:57.327324 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:57.326878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" event={"ID":"e807e592-0662-4cde-b84b-741274d7b296","Type":"ContainerDied","Data":"4538a8e78f6715c13431df00f84c29b63d234a62601effd0f0ac7735d997291c"}
Jul 10 18:17:57.328031 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:57.328011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pn9wr" event={"ID":"54ea2926-1c78-4aac-b6ac-e1df01ddcdaa","Type":"ContainerStarted","Data":"7a2e230e9d6b038b73479b8b8e6ec735678326812c861f471d3865a68da3f347"}
Jul 10 18:17:57.523266 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:57.523215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:57.523433 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:57.523364    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 18:17:57.523499 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:57.523448    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert podName:2b743100-ee27-469c-a38c-44c18163ae46 nodeName:}" failed. No retries permitted until 2026-07-10 18:17:59.523425954 +0000 UTC m=+40.196341735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-6jxtl" (UID: "2b743100-ee27-469c-a38c-44c18163ae46") : secret "networking-console-plugin-cert" not found
Jul 10 18:17:58.334727 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:58.334497    2577 generic.go:356] "Generic (PLEG): container finished" podID="e807e592-0662-4cde-b84b-741274d7b296" containerID="cb3a6bd2d3ed066f49f9c9ed44900a99152018f7fa799c599851fa553f810678" exitCode=0
Jul 10 18:17:58.335119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:58.334605    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" event={"ID":"e807e592-0662-4cde-b84b-741274d7b296","Type":"ContainerDied","Data":"cb3a6bd2d3ed066f49f9c9ed44900a99152018f7fa799c599851fa553f810678"}
Jul 10 18:17:58.835537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:58.835495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:17:58.835714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:58.835609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:17:58.835714 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:58.835637    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:17:58.835837 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:58.835718    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls podName:0ead3efb-54c3-461f-af60-dcf7c3e54d7e nodeName:}" failed. No retries permitted until 2026-07-10 18:18:02.835694975 +0000 UTC m=+43.508610757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls") pod "dns-default-jrgzz" (UID: "0ead3efb-54c3-461f-af60-dcf7c3e54d7e") : secret "dns-default-metrics-tls" not found
Jul 10 18:17:58.835837 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:58.835805    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:17:58.835837 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:58.835830    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d967fff95-kghwz: secret "image-registry-tls" not found
Jul 10 18:17:58.835958 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:58.835914    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls podName:13ab2f4d-9269-4e8f-988c-78773639bbf9 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:02.83589692 +0000 UTC m=+43.508812714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls") pod "image-registry-5d967fff95-kghwz" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9") : secret "image-registry-tls" not found
Jul 10 18:17:59.342318 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:59.342248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" event={"ID":"e807e592-0662-4cde-b84b-741274d7b296","Type":"ContainerStarted","Data":"79ce4a8c2b2aaee525e7d359ee8b5ed53b714d0c93a20f7c103c68a1338befc7"}
Jul 10 18:17:59.367939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:59.367879    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9pbn8" podStartSLOduration=8.057801087 podStartE2EDuration="39.367861111s" totalImagesPullingTime="31.310060024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:17:59.367751075 +0000 UTC m=+40.040666881" watchObservedRunningTime="2026-07-10 18:17:59.367861111 +0000 UTC m=+40.040776920"
Jul 10 18:17:59.540723 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:17:59.540683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:17:59.540880 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:59.540844    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 18:17:59.540928 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:17:59.540912    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert podName:2b743100-ee27-469c-a38c-44c18163ae46 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:03.540896712 +0000 UTC m=+44.213812492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-6jxtl" (UID: "2b743100-ee27-469c-a38c-44c18163ae46") : secret "networking-console-plugin-cert" not found
Jul 10 18:18:00.346423 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:00.346385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pn9wr" event={"ID":"54ea2926-1c78-4aac-b6ac-e1df01ddcdaa","Type":"ContainerStarted","Data":"ca6540a8b7cfb7e13b656a341468e2c443c6ad425a24c8bacf805ec7ec49b24a"}
Jul 10 18:18:02.867155 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:02.867103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:18:02.867594 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:02.867185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:02.867594 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:02.867291    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:18:02.867594 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:02.867370    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls podName:0ead3efb-54c3-461f-af60-dcf7c3e54d7e nodeName:}" failed. No retries permitted until 2026-07-10 18:18:10.867353897 +0000 UTC m=+51.540269674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls") pod "dns-default-jrgzz" (UID: "0ead3efb-54c3-461f-af60-dcf7c3e54d7e") : secret "dns-default-metrics-tls" not found
Jul 10 18:18:02.867594 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:02.867302    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:18:02.867594 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:02.867400    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d967fff95-kghwz: secret "image-registry-tls" not found
Jul 10 18:18:02.867594 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:02.867440    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls podName:13ab2f4d-9269-4e8f-988c-78773639bbf9 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:10.867429176 +0000 UTC m=+51.540344952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls") pod "image-registry-5d967fff95-kghwz" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9") : secret "image-registry-tls" not found
Jul 10 18:18:03.572849 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:03.572808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:18:03.573042 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:03.572933    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 18:18:03.573042 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:03.572987    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert podName:2b743100-ee27-469c-a38c-44c18163ae46 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:11.572974106 +0000 UTC m=+52.245889882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-6jxtl" (UID: "2b743100-ee27-469c-a38c-44c18163ae46") : secret "networking-console-plugin-cert" not found
Jul 10 18:18:05.368993 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.368929    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pn9wr" podStartSLOduration=7.511631428 podStartE2EDuration="10.368905858s" totalImagesPullingTime="2.85727443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:00.364421957 +0000 UTC m=+41.037337756" watchObservedRunningTime="2026-07-10 18:18:05.368905858 +0000 UTC m=+46.041821657"
Jul 10 18:18:05.369821 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.369789    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f5kn7"]
Jul 10 18:18:05.403447 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.403413    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f5kn7"]
Jul 10 18:18:05.403615 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.403548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.405797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.405772    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 18:18:05.406861 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.406841    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 18:18:05.406861 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.406853    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qtcxd\""
Jul 10 18:18:05.406861 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.406850    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 18:18:05.407056 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.406847    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 18:18:05.489063 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.489028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5794e824-336e-4d71-82ff-f11af6174ee6-crio-socket\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.489261 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.489070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5794e824-336e-4d71-82ff-f11af6174ee6-data-volume\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.489261 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.489094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwt99\" (UniqueName: \"kubernetes.io/projected/5794e824-336e-4d71-82ff-f11af6174ee6-kube-api-access-jwt99\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.489261 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.489148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.489261 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.489190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.589624 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.589589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.589825 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.589667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5794e824-336e-4d71-82ff-f11af6174ee6-crio-socket\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.589825 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.589695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5794e824-336e-4d71-82ff-f11af6174ee6-data-volume\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.589825 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.589714    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwt99\" (UniqueName: \"kubernetes.io/projected/5794e824-336e-4d71-82ff-f11af6174ee6-kube-api-access-jwt99\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.589825 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.589737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.589825 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:05.589746    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:05.589825 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:05.589818    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:06.089798588 +0000 UTC m=+46.762714387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:05.590175 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:05.589851    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:18:05.590175 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:05.589909    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:06.089894785 +0000 UTC m=+46.762810561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : configmap "kube-rbac-proxy" not found
Jul 10 18:18:05.590175 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.589909    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5794e824-336e-4d71-82ff-f11af6174ee6-crio-socket\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.590175 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.590060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5794e824-336e-4d71-82ff-f11af6174ee6-data-volume\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:05.600343 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:05.600314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwt99\" (UniqueName: \"kubernetes.io/projected/5794e824-336e-4d71-82ff-f11af6174ee6-kube-api-access-jwt99\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:06.093735 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:06.093682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:06.093917 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:06.093754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:06.093917 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:06.093828    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:18:06.093917 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:06.093858    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:06.093917 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:06.093898    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:07.093881913 +0000 UTC m=+47.766797691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : configmap "kube-rbac-proxy" not found
Jul 10 18:18:06.093917 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:06.093913    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:07.093906309 +0000 UTC m=+47.766822086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:07.101688 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:07.101643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:07.102075 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:07.101707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:07.102075 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:07.101774    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:18:07.102075 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:07.101804    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:07.102075 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:07.101842    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:09.101825938 +0000 UTC m=+49.774741714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : configmap "kube-rbac-proxy" not found
Jul 10 18:18:07.102075 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:07.101856    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:09.101850344 +0000 UTC m=+49.774766121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:07.557467 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:07.557434    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n4575_af29cd1b-dd41-4581-b5f4-062b07cce95d/dns-node-resolver/0.log"
Jul 10 18:18:08.557256 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.557211    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vwl86_c853e25f-65cb-4393-b0bf-af5f3a2b83d9/node-ca/0.log"
Jul 10 18:18:08.691830 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.691797    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f94dx"]
Jul 10 18:18:08.714729 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.714695    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f94dx"]
Jul 10 18:18:08.714918 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.714800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.717447 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.717425    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 10 18:18:08.717447 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.717429    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m242t\""
Jul 10 18:18:08.717650 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.717431    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 10 18:18:08.718380 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.718363    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 10 18:18:08.718380 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.718366    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 10 18:18:08.812531 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.812433    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrsbz\" (UniqueName: \"kubernetes.io/projected/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-kube-api-access-jrsbz\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.812531 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.812486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-signing-cabundle\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.812732 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.812567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-signing-key\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.912926 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.912888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrsbz\" (UniqueName: \"kubernetes.io/projected/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-kube-api-access-jrsbz\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.912926 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.912935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-signing-cabundle\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.913165 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.913046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-signing-key\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.913665 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.913646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-signing-cabundle\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.915430 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.915406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-signing-key\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:08.921192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:08.921167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrsbz\" (UniqueName: \"kubernetes.io/projected/496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f-kube-api-access-jrsbz\") pod \"service-ca-79f68b9f4f-f94dx\" (UID: \"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:09.023959 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:09.023922    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx"
Jul 10 18:18:09.115050 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:09.115017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:09.115253 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:09.115080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:09.115253 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:09.115164    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:18:09.115373 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:09.115264    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:13.115240106 +0000 UTC m=+53.788155886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : configmap "kube-rbac-proxy" not found
Jul 10 18:18:09.115373 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:09.115286    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:09.115373 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:09.115350    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:13.115328307 +0000 UTC m=+53.788244085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:09.179368 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:09.179335    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f94dx"]
Jul 10 18:18:09.182781 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:09.182744    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496ccdb5_d71e_4b09_a9b7_fbdce1c42f4f.slice/crio-32fd6451518ee4109a3b933e6f4db7a4ee2f4f2c4174d9fca24a33a876ca671b WatchSource:0}: Error finding container 32fd6451518ee4109a3b933e6f4db7a4ee2f4f2c4174d9fca24a33a876ca671b: Status 404 returned error can't find the container with id 32fd6451518ee4109a3b933e6f4db7a4ee2f4f2c4174d9fca24a33a876ca671b
Jul 10 18:18:09.357134 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:09.357051    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pn9wr_54ea2926-1c78-4aac-b6ac-e1df01ddcdaa/serve-healthcheck-canary/0.log"
Jul 10 18:18:09.369185 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:09.369144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx" event={"ID":"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f","Type":"ContainerStarted","Data":"32fd6451518ee4109a3b933e6f4db7a4ee2f4f2c4174d9fca24a33a876ca671b"}
Jul 10 18:18:10.931828 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:10.931791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:10.932187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:10.931875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:18:10.932187 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:10.931952    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:18:10.932187 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:10.931969    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d967fff95-kghwz: secret "image-registry-tls" not found
Jul 10 18:18:10.932187 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:10.932026    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls podName:13ab2f4d-9269-4e8f-988c-78773639bbf9 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:26.932011274 +0000 UTC m=+67.604927059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls") pod "image-registry-5d967fff95-kghwz" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9") : secret "image-registry-tls" not found
Jul 10 18:18:10.932187 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:10.932040    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:18:10.932187 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:10.932097    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls podName:0ead3efb-54c3-461f-af60-dcf7c3e54d7e nodeName:}" failed. No retries permitted until 2026-07-10 18:18:26.932080137 +0000 UTC m=+67.604995916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls") pod "dns-default-jrgzz" (UID: "0ead3efb-54c3-461f-af60-dcf7c3e54d7e") : secret "dns-default-metrics-tls" not found
Jul 10 18:18:11.638536 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:11.638480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:18:11.638744 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:11.638650    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 18:18:11.638744 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:11.638732    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert podName:2b743100-ee27-469c-a38c-44c18163ae46 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:27.638711009 +0000 UTC m=+68.311626806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-6jxtl" (UID: "2b743100-ee27-469c-a38c-44c18163ae46") : secret "networking-console-plugin-cert" not found
Jul 10 18:18:12.377955 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:12.377862    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx" event={"ID":"496ccdb5-d71e-4b09-a9b7-fbdce1c42f4f","Type":"ContainerStarted","Data":"d608e61edee2ad6835b3277d554d0e32bb7022452882f4e25a36264c500a00ac"}
Jul 10 18:18:12.395824 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:12.395773    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-f94dx" podStartSLOduration=1.51338769 podStartE2EDuration="4.395755307s" totalImagesPullingTime="2.882367617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:12.394897599 +0000 UTC m=+53.067813421" watchObservedRunningTime="2026-07-10 18:18:12.395755307 +0000 UTC m=+53.068671105"
Jul 10 18:18:13.151520 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:13.151438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:13.151698 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:13.151559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:13.151698 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:13.151688    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:13.151768 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:13.151758    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls podName:5794e824-336e-4d71-82ff-f11af6174ee6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:21.151738305 +0000 UTC m=+61.824654099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5kn7" (UID: "5794e824-336e-4d71-82ff-f11af6174ee6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:18:13.152127 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:13.152106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5794e824-336e-4d71-82ff-f11af6174ee6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:21.217305 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:21.217263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:21.219680 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:21.219656    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5794e824-336e-4d71-82ff-f11af6174ee6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5kn7\" (UID: \"5794e824-336e-4d71-82ff-f11af6174ee6\") " pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:21.315916 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:21.315885    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qtcxd\""
Jul 10 18:18:21.323817 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:21.323781    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f5kn7"
Jul 10 18:18:21.324266 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:21.324249    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8kmc"
Jul 10 18:18:21.483467 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:21.483381    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f5kn7"]
Jul 10 18:18:21.486202 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:21.486173    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5794e824_336e_4d71_82ff_f11af6174ee6.slice/crio-b416f97bf6bf7fd7a54b5297630af187a29ce6545777e4279a770814ee747617 WatchSource:0}: Error finding container b416f97bf6bf7fd7a54b5297630af187a29ce6545777e4279a770814ee747617: Status 404 returned error can't find the container with id b416f97bf6bf7fd7a54b5297630af187a29ce6545777e4279a770814ee747617
Jul 10 18:18:22.410817 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:22.410770    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5kn7" event={"ID":"5794e824-336e-4d71-82ff-f11af6174ee6","Type":"ContainerStarted","Data":"b416f97bf6bf7fd7a54b5297630af187a29ce6545777e4279a770814ee747617"}
Jul 10 18:18:25.420339 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.420307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5kn7" event={"ID":"5794e824-336e-4d71-82ff-f11af6174ee6","Type":"ContainerStarted","Data":"2d07291d1e6f919004b9126ca164e5653cba9c1bce01a35c8e763792d6e4f0b5"}
Jul 10 18:18:25.756207 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.756166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:18:25.758846 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.758820    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:18:25.769488 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.769455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8a66fc-7990-49ff-8620-e6f3214b96ce-metrics-certs\") pod \"network-metrics-daemon-t2rtq\" (UID: \"cc8a66fc-7990-49ff-8620-e6f3214b96ce\") " pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:18:25.849398 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.849360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xs98z\""
Jul 10 18:18:25.857482 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.857451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2rtq"
Jul 10 18:18:25.857679 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.857658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:18:25.860098 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.860077    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:18:25.870775 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.870741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85a26b2-a7d3-4a3b-8e1b-6256359a5227-original-pull-secret\") pod \"global-pull-secret-syncer-qsjnf\" (UID: \"c85a26b2-a7d3-4a3b-8e1b-6256359a5227\") " pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:18:25.958154 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.958120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:18:25.960679 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.960647    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:18:25.971128 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.971094    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:18:25.982257 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:25.981931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj7cj\" (UniqueName: \"kubernetes.io/projected/63c71215-6a85-4af9-a0b5-29f1d2c0b4b4-kube-api-access-lj7cj\") pod \"network-check-target-gb9lp\" (UID: \"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4\") " pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:18:26.050287 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.050192    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t2rtq"]
Jul 10 18:18:26.053601 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:26.053572    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8a66fc_7990_49ff_8620_e6f3214b96ce.slice/crio-485de58eb4813ded4fc446dacf7cfe5020530a0b04229737bd5689a833025785 WatchSource:0}: Error finding container 485de58eb4813ded4fc446dacf7cfe5020530a0b04229737bd5689a833025785: Status 404 returned error can't find the container with id 485de58eb4813ded4fc446dacf7cfe5020530a0b04229737bd5689a833025785
Jul 10 18:18:26.141999 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.141973    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nsh8q\""
Jul 10 18:18:26.150005 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.149978    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:18:26.153184 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.153162    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsjnf"
Jul 10 18:18:26.286698 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.286668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gb9lp"]
Jul 10 18:18:26.290180 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:26.290147    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c71215_6a85_4af9_a0b5_29f1d2c0b4b4.slice/crio-60bc6c5ea904e2221ccddc2022f1566c34d7497db8023d53c3b2ca34ce4337e9 WatchSource:0}: Error finding container 60bc6c5ea904e2221ccddc2022f1566c34d7497db8023d53c3b2ca34ce4337e9: Status 404 returned error can't find the container with id 60bc6c5ea904e2221ccddc2022f1566c34d7497db8023d53c3b2ca34ce4337e9
Jul 10 18:18:26.298745 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.298718    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qsjnf"]
Jul 10 18:18:26.302109 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:26.302037    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85a26b2_a7d3_4a3b_8e1b_6256359a5227.slice/crio-1b4d650f399ce9bf083498598d62891069c8df1d8b8a940ba711295c49fc0b21 WatchSource:0}: Error finding container 1b4d650f399ce9bf083498598d62891069c8df1d8b8a940ba711295c49fc0b21: Status 404 returned error can't find the container with id 1b4d650f399ce9bf083498598d62891069c8df1d8b8a940ba711295c49fc0b21
Jul 10 18:18:26.424863 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.424826    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5kn7" event={"ID":"5794e824-336e-4d71-82ff-f11af6174ee6","Type":"ContainerStarted","Data":"d2db776748ffb460b11ee1d059898262e0a7f405933f529d2c6b0ea2f73a521c"}
Jul 10 18:18:26.425960 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.425928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qsjnf" event={"ID":"c85a26b2-a7d3-4a3b-8e1b-6256359a5227","Type":"ContainerStarted","Data":"1b4d650f399ce9bf083498598d62891069c8df1d8b8a940ba711295c49fc0b21"}
Jul 10 18:18:26.426974 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.426954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t2rtq" event={"ID":"cc8a66fc-7990-49ff-8620-e6f3214b96ce","Type":"ContainerStarted","Data":"485de58eb4813ded4fc446dacf7cfe5020530a0b04229737bd5689a833025785"}
Jul 10 18:18:26.427980 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.427960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gb9lp" event={"ID":"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4","Type":"ContainerStarted","Data":"60bc6c5ea904e2221ccddc2022f1566c34d7497db8023d53c3b2ca34ce4337e9"}
Jul 10 18:18:26.969463 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.968530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:26.969463 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.968622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:18:26.973753 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.973689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"image-registry-5d967fff95-kghwz\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") " pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:26.975100 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:26.975045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ead3efb-54c3-461f-af60-dcf7c3e54d7e-metrics-tls\") pod \"dns-default-jrgzz\" (UID: \"0ead3efb-54c3-461f-af60-dcf7c3e54d7e\") " pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:18:27.192476 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.192212    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6v2rr\""
Jul 10 18:18:27.200327 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.200289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:27.216179 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.213794    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p5qqq\""
Jul 10 18:18:27.222308 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.222141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:18:27.399162 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.398943    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d967fff95-kghwz"]
Jul 10 18:18:27.406131 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:27.406083    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ab2f4d_9269_4e8f_988c_78773639bbf9.slice/crio-7edd75bdbb06590405294792b1fa658367cdff0bc095c09c41dac6bf0d33537d WatchSource:0}: Error finding container 7edd75bdbb06590405294792b1fa658367cdff0bc095c09c41dac6bf0d33537d: Status 404 returned error can't find the container with id 7edd75bdbb06590405294792b1fa658367cdff0bc095c09c41dac6bf0d33537d
Jul 10 18:18:27.431609 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.431417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jrgzz"]
Jul 10 18:18:27.435559 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:27.435522    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ead3efb_54c3_461f_af60_dcf7c3e54d7e.slice/crio-da6064dbaf1b3b73bf4e056aab074d894c6a0f880f427d70a489b8d6c6b7ac07 WatchSource:0}: Error finding container da6064dbaf1b3b73bf4e056aab074d894c6a0f880f427d70a489b8d6c6b7ac07: Status 404 returned error can't find the container with id da6064dbaf1b3b73bf4e056aab074d894c6a0f880f427d70a489b8d6c6b7ac07
Jul 10 18:18:27.441067 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.437747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t2rtq" event={"ID":"cc8a66fc-7990-49ff-8620-e6f3214b96ce","Type":"ContainerStarted","Data":"ee672ae079c32150e83c5cb5c5c5ce7feabfe9eaf67afee1ca82015ed9255af8"}
Jul 10 18:18:27.441067 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.440442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d967fff95-kghwz" event={"ID":"13ab2f4d-9269-4e8f-988c-78773639bbf9","Type":"ContainerStarted","Data":"7edd75bdbb06590405294792b1fa658367cdff0bc095c09c41dac6bf0d33537d"}
Jul 10 18:18:27.674360 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.674205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:18:27.678172 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.678034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2b743100-ee27-469c-a38c-44c18163ae46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-6jxtl\" (UID: \"2b743100-ee27-469c-a38c-44c18163ae46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:18:27.936247 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.936093    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ckcdx\""
Jul 10 18:18:27.943632 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:27.943592    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"
Jul 10 18:18:28.450244 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:28.450193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t2rtq" event={"ID":"cc8a66fc-7990-49ff-8620-e6f3214b96ce","Type":"ContainerStarted","Data":"106bd04eef6ddf2d59bd0a6536adbf0194de48b7f3fd8ea2152ac4dbc178d8b5"}
Jul 10 18:18:28.453263 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:28.453212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d967fff95-kghwz" event={"ID":"13ab2f4d-9269-4e8f-988c-78773639bbf9","Type":"ContainerStarted","Data":"8d2cbb2261312c96b7a97f8de374805ce12cd2b1b7adc8d4bdc8ad42cb27caa9"}
Jul 10 18:18:28.453544 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:28.453520    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:28.456495 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:28.456458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jrgzz" event={"ID":"0ead3efb-54c3-461f-af60-dcf7c3e54d7e","Type":"ContainerStarted","Data":"da6064dbaf1b3b73bf4e056aab074d894c6a0f880f427d70a489b8d6c6b7ac07"}
Jul 10 18:18:28.469176 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:28.467730    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t2rtq" podStartSLOduration=67.359694423 podStartE2EDuration="1m8.46770032s" totalImagesPullingTime="1.108005897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:28.465442723 +0000 UTC m=+69.138358535" watchObservedRunningTime="2026-07-10 18:18:28.46770032 +0000 UTC m=+69.140616120"
Jul 10 18:18:28.485012 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:28.483807    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d967fff95-kghwz" podStartSLOduration=52.483785865 podStartE2EDuration="52.483785865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:28.483627135 +0000 UTC m=+69.156542934" watchObservedRunningTime="2026-07-10 18:18:28.483785865 +0000 UTC m=+69.156701665"
Jul 10 18:18:29.403558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.403502    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d967fff95-kghwz"]
Jul 10 18:18:29.404543 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.404346    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"]
Jul 10 18:18:29.441678 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.441575    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"]
Jul 10 18:18:29.441678 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.441677    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.445213 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.445183    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 18:18:29.445629 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.445487    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 18:18:29.450255 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.450172    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 18:18:29.450255 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.450176    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 10 18:18:29.490955 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.490914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhckp\" (UniqueName: \"kubernetes.io/projected/834fc68b-a3ad-4e8e-a414-245d31647a22-kube-api-access-rhckp\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.491135 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.490968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/834fc68b-a3ad-4e8e-a414-245d31647a22-tmp\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.491135 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.490994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/834fc68b-a3ad-4e8e-a414-245d31647a22-klusterlet-config\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.521833 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.521794    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c5898f476-4rd2c"]
Jul 10 18:18:29.542612 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.542577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.546125 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.546094    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c5898f476-4rd2c"]
Jul 10 18:18:29.591813 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.591774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-ca-trust-extracted\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.591813 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.591817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-trusted-ca\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.592046 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.591956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/834fc68b-a3ad-4e8e-a414-245d31647a22-tmp\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.592046 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-registry-tls\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.592138 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-registry-certificates\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.592138 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-bound-sa-token\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.592270 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/834fc68b-a3ad-4e8e-a414-245d31647a22-klusterlet-config\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.592270 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-installation-pull-secrets\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.592381 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-image-registry-private-configuration\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.592781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhckp\" (UniqueName: \"kubernetes.io/projected/834fc68b-a3ad-4e8e-a414-245d31647a22-kube-api-access-rhckp\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.592781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qn9w\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-kube-api-access-8qn9w\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.592781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.592525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/834fc68b-a3ad-4e8e-a414-245d31647a22-tmp\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.595982 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.595931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/834fc68b-a3ad-4e8e-a414-245d31647a22-klusterlet-config\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.606728 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.606694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhckp\" (UniqueName: \"kubernetes.io/projected/834fc68b-a3ad-4e8e-a414-245d31647a22-kube-api-access-rhckp\") pod \"klusterlet-addon-workmgr-64574474c8-99pc5\" (UID: \"834fc68b-a3ad-4e8e-a414-245d31647a22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.693864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.693763    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-image-registry-private-configuration\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.693864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.693821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qn9w\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-kube-api-access-8qn9w\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.694111 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.693962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-ca-trust-extracted\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.694111 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.694014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-trusted-ca\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.694111 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.694081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-registry-tls\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.694245 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.694108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-registry-certificates\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.694245 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.694141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-bound-sa-token\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.694245 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.694178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-installation-pull-secrets\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.695170 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.695137    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-ca-trust-extracted\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.695503 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.695476    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-registry-certificates\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.695637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.695518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-trusted-ca\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.696960 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.696939    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-registry-tls\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.697211 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.697186    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-image-registry-private-configuration\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.697712 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.697688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-installation-pull-secrets\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.711187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.711152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-bound-sa-token\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.712070 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.712018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qn9w\" (UniqueName: \"kubernetes.io/projected/136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2-kube-api-access-8qn9w\") pod \"image-registry-c5898f476-4rd2c\" (UID: \"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2\") " pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:29.755430 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.755390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:29.852442 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:29.852398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:32.765572 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:32.765483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-6jxtl"]
Jul 10 18:18:32.772008 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:32.771962    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b743100_ee27_469c_a38c_44c18163ae46.slice/crio-8e3f079bc184b96cd8b3f3f4248998f5e3461d80d00f1ac8824db89662eb57a7 WatchSource:0}: Error finding container 8e3f079bc184b96cd8b3f3f4248998f5e3461d80d00f1ac8824db89662eb57a7: Status 404 returned error can't find the container with id 8e3f079bc184b96cd8b3f3f4248998f5e3461d80d00f1ac8824db89662eb57a7
Jul 10 18:18:32.784656 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:32.784618    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"]
Jul 10 18:18:32.791084 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:32.791045    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834fc68b_a3ad_4e8e_a414_245d31647a22.slice/crio-617bcdb2bd92905fbe6c0e05e8eefb01e3362bc3ba5bace5758fd879d5f44c77 WatchSource:0}: Error finding container 617bcdb2bd92905fbe6c0e05e8eefb01e3362bc3ba5bace5758fd879d5f44c77: Status 404 returned error can't find the container with id 617bcdb2bd92905fbe6c0e05e8eefb01e3362bc3ba5bace5758fd879d5f44c77
Jul 10 18:18:32.792300 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:32.792271    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c5898f476-4rd2c"]
Jul 10 18:18:32.795489 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:32.795457    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136e0966_bf1b_4f9c_bf9b_ba9d4f17bab2.slice/crio-3b412ff7f710eaa8ecca017b607bee3a3933e111565cd8d83f07215d99952327 WatchSource:0}: Error finding container 3b412ff7f710eaa8ecca017b607bee3a3933e111565cd8d83f07215d99952327: Status 404 returned error can't find the container with id 3b412ff7f710eaa8ecca017b607bee3a3933e111565cd8d83f07215d99952327
Jul 10 18:18:33.477578 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.477516    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gb9lp" event={"ID":"63c71215-6a85-4af9-a0b5-29f1d2c0b4b4","Type":"ContainerStarted","Data":"4f9a50487a352281eb9263b8d6dc0d8a11069d7998403be70f8dcd2399a5410d"}
Jul 10 18:18:33.477782 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.477639    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:18:33.479549 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.479513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jrgzz" event={"ID":"0ead3efb-54c3-461f-af60-dcf7c3e54d7e","Type":"ContainerStarted","Data":"583c553119379a8e42c971a6716c9f51680197c0f2d3f903e370f36a7bed62d3"}
Jul 10 18:18:33.479714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.479566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jrgzz" event={"ID":"0ead3efb-54c3-461f-af60-dcf7c3e54d7e","Type":"ContainerStarted","Data":"4f5b912279c576947625f307acf0de594940e6a0d16d56ce7dae756e5df305ad"}
Jul 10 18:18:33.479714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.479600    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:18:33.481566 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.481514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5898f476-4rd2c" event={"ID":"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2","Type":"ContainerStarted","Data":"82e92234b42924357d6c6baeb04ef04a6b8db44ee09715df292f7cdc377d9dfe"}
Jul 10 18:18:33.481708 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.481577    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5898f476-4rd2c" event={"ID":"136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2","Type":"ContainerStarted","Data":"3b412ff7f710eaa8ecca017b607bee3a3933e111565cd8d83f07215d99952327"}
Jul 10 18:18:33.481708 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.481604    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:33.483993 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.483952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5kn7" event={"ID":"5794e824-336e-4d71-82ff-f11af6174ee6","Type":"ContainerStarted","Data":"2e1f7460c6a3ebebc466eae3c4e3c737f3bd06fd18c595e4b09219a161386172"}
Jul 10 18:18:33.485577 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.485543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qsjnf" event={"ID":"c85a26b2-a7d3-4a3b-8e1b-6256359a5227","Type":"ContainerStarted","Data":"22796777c46a12f976800a7c2b4e49f6da88f1e28377d6ad371f487fa521af0c"}
Jul 10 18:18:33.486835 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.486809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5" event={"ID":"834fc68b-a3ad-4e8e-a414-245d31647a22","Type":"ContainerStarted","Data":"617bcdb2bd92905fbe6c0e05e8eefb01e3362bc3ba5bace5758fd879d5f44c77"}
Jul 10 18:18:33.488120 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.488098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl" event={"ID":"2b743100-ee27-469c-a38c-44c18163ae46","Type":"ContainerStarted","Data":"8e3f079bc184b96cd8b3f3f4248998f5e3461d80d00f1ac8824db89662eb57a7"}
Jul 10 18:18:33.516669 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.516606    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gb9lp" podStartSLOduration=67.229145843 podStartE2EDuration="1m13.516581217s" totalImagesPullingTime="6.287435374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:33.515052558 +0000 UTC m=+74.187968374" watchObservedRunningTime="2026-07-10 18:18:33.516581217 +0000 UTC m=+74.189496997"
Jul 10 18:18:33.575521 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.575468    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f5kn7" podStartSLOduration=17.598986702 podStartE2EDuration="28.57544494s" totalImagesPullingTime="10.976458238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:18:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:33.574137486 +0000 UTC m=+74.247053311" watchObservedRunningTime="2026-07-10 18:18:33.57544494 +0000 UTC m=+74.248360740"
Jul 10 18:18:33.575715 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.575652    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qsjnf" podStartSLOduration=67.279776764 podStartE2EDuration="1m13.575645018s" totalImagesPullingTime="6.295868254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:33.55518069 +0000 UTC m=+74.228096489" watchObservedRunningTime="2026-07-10 18:18:33.575645018 +0000 UTC m=+74.248560816"
Jul 10 18:18:33.596351 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.596296    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jrgzz" podStartSLOduration=33.458394618 podStartE2EDuration="38.59627798s" totalImagesPullingTime="5.137883362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:33.594137825 +0000 UTC m=+74.267053635" watchObservedRunningTime="2026-07-10 18:18:33.59627798 +0000 UTC m=+74.269193780"
Jul 10 18:18:33.618346 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.618308    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"]
Jul 10 18:18:33.622353 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.621548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"
Jul 10 18:18:33.622353 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.621699    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c5898f476-4rd2c" podStartSLOduration=4.621680186 podStartE2EDuration="4.621680186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:33.6208541 +0000 UTC m=+74.293769918" watchObservedRunningTime="2026-07-10 18:18:33.621680186 +0000 UTC m=+74.294595966"
Jul 10 18:18:33.625590 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.624725    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 10 18:18:33.630307 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.629355    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tjpnf\""
Jul 10 18:18:33.643829 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.643797    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"]
Jul 10 18:18:33.725736 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.725650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/be8dab2f-38fe-406b-b760-204f8c366875-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6pgl\" (UID: \"be8dab2f-38fe-406b-b760-204f8c366875\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"
Jul 10 18:18:33.827308 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:33.827197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/be8dab2f-38fe-406b-b760-204f8c366875-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6pgl\" (UID: \"be8dab2f-38fe-406b-b760-204f8c366875\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"
Jul 10 18:18:33.828363 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:33.827402    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 10 18:18:33.828363 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:33.828013    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8dab2f-38fe-406b-b760-204f8c366875-tls-certificates podName:be8dab2f-38fe-406b-b760-204f8c366875 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:34.327985316 +0000 UTC m=+75.000901113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/be8dab2f-38fe-406b-b760-204f8c366875-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-b6pgl" (UID: "be8dab2f-38fe-406b-b760-204f8c366875") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 10 18:18:34.332725 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:34.332670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/be8dab2f-38fe-406b-b760-204f8c366875-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6pgl\" (UID: \"be8dab2f-38fe-406b-b760-204f8c366875\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"
Jul 10 18:18:34.336026 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:34.335966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/be8dab2f-38fe-406b-b760-204f8c366875-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6pgl\" (UID: \"be8dab2f-38fe-406b-b760-204f8c366875\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"
Jul 10 18:18:34.545316 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:34.545283    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"
Jul 10 18:18:35.315622 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:35.315551    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"]
Jul 10 18:18:35.321059 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:35.321015    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8dab2f_38fe_406b_b760_204f8c366875.slice/crio-d3ef8af2c9a61765097c331b985dbb3f652e0e4c4a0930d7949f09b4045d0d8d WatchSource:0}: Error finding container d3ef8af2c9a61765097c331b985dbb3f652e0e4c4a0930d7949f09b4045d0d8d: Status 404 returned error can't find the container with id d3ef8af2c9a61765097c331b985dbb3f652e0e4c4a0930d7949f09b4045d0d8d
Jul 10 18:18:35.498877 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:35.498776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl" event={"ID":"2b743100-ee27-469c-a38c-44c18163ae46","Type":"ContainerStarted","Data":"399c6e2d6b869db746dd5d795f2746909a7e7697f3e45ded80bf01bf361c3c0b"}
Jul 10 18:18:35.500142 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:35.500112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl" event={"ID":"be8dab2f-38fe-406b-b760-204f8c366875","Type":"ContainerStarted","Data":"d3ef8af2c9a61765097c331b985dbb3f652e0e4c4a0930d7949f09b4045d0d8d"}
Jul 10 18:18:35.513456 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:35.513399    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-6jxtl" podStartSLOduration=38.123468106 podStartE2EDuration="40.513374252s" totalImagesPullingTime="2.389906146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:35.512536331 +0000 UTC m=+76.185452130" watchObservedRunningTime="2026-07-10 18:18:35.513374252 +0000 UTC m=+76.186290076"
Jul 10 18:18:37.510742 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.510701    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5" event={"ID":"834fc68b-a3ad-4e8e-a414-245d31647a22","Type":"ContainerStarted","Data":"6fdfeff25ff2355406dfc2c3895d2f7fa4651acc41fafccc10f6971589a79471"}
Jul 10 18:18:37.511525 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.511346    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:37.513025 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.513004    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5"
Jul 10 18:18:37.513443 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.513418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl" event={"ID":"be8dab2f-38fe-406b-b760-204f8c366875","Type":"ContainerStarted","Data":"65e0186c78b578e1cbaa484f198aac8784bd9c16f5038ca77931d48f3958ea4c"}
Jul 10 18:18:37.513567 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.513551    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"
Jul 10 18:18:37.518017 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.517993    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl"
Jul 10 18:18:37.530069 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.530015    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64574474c8-99pc5" podStartSLOduration=4.711395085 podStartE2EDuration="8.52999995s" totalImagesPullingTime="3.818604865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:37.528483062 +0000 UTC m=+78.201398864" watchObservedRunningTime="2026-07-10 18:18:37.52999995 +0000 UTC m=+78.202915749"
Jul 10 18:18:37.560675 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.560568    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6pgl" podStartSLOduration=2.580683156 podStartE2EDuration="4.560549366s" totalImagesPullingTime="1.97986621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:37.560171416 +0000 UTC m=+78.233087215" watchObservedRunningTime="2026-07-10 18:18:37.560549366 +0000 UTC m=+78.233465165"
Jul 10 18:18:37.692939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.692902    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p5vwp"]
Jul 10 18:18:37.695546 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.695526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.698906 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.698880    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 18:18:37.699086 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.699064    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 18:18:37.699086 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.699078    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bqfqc\""
Jul 10 18:18:37.699262 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.699153    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 18:18:37.699809 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.699790    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 18:18:37.699897 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.699796    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 18:18:37.709755 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.709725    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p5vwp"]
Jul 10 18:18:37.759024 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.758990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.759024 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.759034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mwnc\" (UniqueName: \"kubernetes.io/projected/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-kube-api-access-6mwnc\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.759297 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.759081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.759297 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.759105    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.860524 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.860431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mwnc\" (UniqueName: \"kubernetes.io/projected/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-kube-api-access-6mwnc\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.860524 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.860487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.860524 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.860509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.860797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.860543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.860797 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:37.860657    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 10 18:18:37.860797 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:37.860737    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-tls podName:f21f9cdb-59a6-4abe-a010-f29ff7aebda6 nodeName:}" failed. No retries permitted until 2026-07-10 18:18:38.360713149 +0000 UTC m=+79.033628930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-tls") pod "prometheus-operator-64785b6675-p5vwp" (UID: "f21f9cdb-59a6-4abe-a010-f29ff7aebda6") : secret "prometheus-operator-tls" not found
Jul 10 18:18:37.861211 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.861189    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.862926 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.862904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:37.871100 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:37.871075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mwnc\" (UniqueName: \"kubernetes.io/projected/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-kube-api-access-6mwnc\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:38.364947 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:38.364907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:38.367317 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:38.367298    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f21f9cdb-59a6-4abe-a010-f29ff7aebda6-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p5vwp\" (UID: \"f21f9cdb-59a6-4abe-a010-f29ff7aebda6\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:38.604849 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:38.604792    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp"
Jul 10 18:18:38.742079 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:38.742041    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p5vwp"]
Jul 10 18:18:38.746599 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:38.746572    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21f9cdb_59a6_4abe_a010_f29ff7aebda6.slice/crio-0cafb4fc37eda3c6838d6451e05580e66b338752ce80a729b009bab335137521 WatchSource:0}: Error finding container 0cafb4fc37eda3c6838d6451e05580e66b338752ce80a729b009bab335137521: Status 404 returned error can't find the container with id 0cafb4fc37eda3c6838d6451e05580e66b338752ce80a729b009bab335137521
Jul 10 18:18:39.522163 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:39.522118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp" event={"ID":"f21f9cdb-59a6-4abe-a010-f29ff7aebda6","Type":"ContainerStarted","Data":"0cafb4fc37eda3c6838d6451e05580e66b338752ce80a729b009bab335137521"}
Jul 10 18:18:40.527450 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:40.527409    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp" event={"ID":"f21f9cdb-59a6-4abe-a010-f29ff7aebda6","Type":"ContainerStarted","Data":"abc7f9774a3769b4a8d61a16c71fb1b4ada88960509e333aa790d3ff718e5c2a"}
Jul 10 18:18:40.527830 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:40.527476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp" event={"ID":"f21f9cdb-59a6-4abe-a010-f29ff7aebda6","Type":"ContainerStarted","Data":"3bdd54488aa4728897f1a292230a4d622ad4180fc43ab48256eecaacdb8daa8a"}
Jul 10 18:18:40.545096 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:40.545042    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-p5vwp" podStartSLOduration=2.298890526 podStartE2EDuration="3.545025557s" totalImagesPullingTime="1.246135031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:40.543978454 +0000 UTC m=+81.216894257" watchObservedRunningTime="2026-07-10 18:18:40.545025557 +0000 UTC m=+81.217941363"
Jul 10 18:18:42.049853 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.049811    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"]
Jul 10 18:18:42.054683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.054659    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.057312 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.057284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5v255\""
Jul 10 18:18:42.057471 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.057284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 10 18:18:42.057471 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.057426    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 10 18:18:42.066140 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.066110    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"]
Jul 10 18:18:42.087837 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.087798    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lmndv"]
Jul 10 18:18:42.091841 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.091813    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.094336 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.094303    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 18:18:42.094336 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.094333    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 18:18:42.094573 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.094495    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 18:18:42.094638 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.094625    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zjc65\""
Jul 10 18:18:42.199143 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.199143 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-wtmp\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.199404 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.199404 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kg42\" (UniqueName: \"kubernetes.io/projected/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-kube-api-access-6kg42\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.199404 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-root\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.199404 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-textfile\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.199592 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/927bc1d4-2766-41a4-9dad-e6f619035370-metrics-client-ca\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.199592 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mrp\" (UniqueName: \"kubernetes.io/projected/927bc1d4-2766-41a4-9dad-e6f619035370-kube-api-access-z6mrp\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.199592 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.199592 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-sys\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.199592 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-tls\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.199592 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.199759 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.199593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.300836 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.300735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.300836 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.300782    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.300836 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.300826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.300854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-wtmp\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.300882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.300918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kg42\" (UniqueName: \"kubernetes.io/projected/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-kube-api-access-6kg42\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.300964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-root\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.300990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-textfile\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.301023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/927bc1d4-2766-41a4-9dad-e6f619035370-metrics-client-ca\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.301046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mrp\" (UniqueName: \"kubernetes.io/projected/927bc1d4-2766-41a4-9dad-e6f619035370-kube-api-access-z6mrp\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.301077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.301119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.301111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-sys\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.301636 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.301133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-tls\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.302337 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.302312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/927bc1d4-2766-41a4-9dad-e6f619035370-metrics-client-ca\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.303120 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.302506    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-root\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.303269 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.302638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.303571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.302782    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-textfile\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.303661 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.303051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.303735 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:42.303125    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 10 18:18:42.303942 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.303320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-sys\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.304031 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.303676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-wtmp\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.304107 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:18:42.303961    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-tls podName:60e590d6-2bf0-4f75-9bb3-c55898aa43ed nodeName:}" failed. No retries permitted until 2026-07-10 18:18:42.803828269 +0000 UTC m=+83.476744060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-kgw9x" (UID: "60e590d6-2bf0-4f75-9bb3-c55898aa43ed") : secret "openshift-state-metrics-tls" not found
Jul 10 18:18:42.304192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.304097    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-tls\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.305638 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.305614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/927bc1d4-2766-41a4-9dad-e6f619035370-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.306475 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.306440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.310901 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.310871    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kg42\" (UniqueName: \"kubernetes.io/projected/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-kube-api-access-6kg42\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.314525 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.314492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mrp\" (UniqueName: \"kubernetes.io/projected/927bc1d4-2766-41a4-9dad-e6f619035370-kube-api-access-z6mrp\") pod \"node-exporter-lmndv\" (UID: \"927bc1d4-2766-41a4-9dad-e6f619035370\") " pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.401953 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.401920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lmndv"
Jul 10 18:18:42.417616 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:42.417580    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927bc1d4_2766_41a4_9dad_e6f619035370.slice/crio-11015dc31d76f3cd019558476fdc9b4fe2206c1931410f2b56afa66d0e258c09 WatchSource:0}: Error finding container 11015dc31d76f3cd019558476fdc9b4fe2206c1931410f2b56afa66d0e258c09: Status 404 returned error can't find the container with id 11015dc31d76f3cd019558476fdc9b4fe2206c1931410f2b56afa66d0e258c09
Jul 10 18:18:42.536117 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.536084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmndv" event={"ID":"927bc1d4-2766-41a4-9dad-e6f619035370","Type":"ContainerStarted","Data":"11015dc31d76f3cd019558476fdc9b4fe2206c1931410f2b56afa66d0e258c09"}
Jul 10 18:18:42.805367 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.805330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.807758 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.807729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e590d6-2bf0-4f75-9bb3-c55898aa43ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kgw9x\" (UID: \"60e590d6-2bf0-4f75-9bb3-c55898aa43ed\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:42.967519 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:42.967480    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"
Jul 10 18:18:43.132004 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:43.131773    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x"]
Jul 10 18:18:43.140109 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:43.140068    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e590d6_2bf0_4f75_9bb3_c55898aa43ed.slice/crio-c02f95c17a7802ae5e50b2599274aae31ba215ac98cf85fc56b39b5a79e24a0f WatchSource:0}: Error finding container c02f95c17a7802ae5e50b2599274aae31ba215ac98cf85fc56b39b5a79e24a0f: Status 404 returned error can't find the container with id c02f95c17a7802ae5e50b2599274aae31ba215ac98cf85fc56b39b5a79e24a0f
Jul 10 18:18:43.495279 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:43.495256    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jrgzz"
Jul 10 18:18:43.542020 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:43.541978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmndv" event={"ID":"927bc1d4-2766-41a4-9dad-e6f619035370","Type":"ContainerStarted","Data":"7cb487d6fa30af1f17147fa0a9aa0e0b964d13175e548240410446b419707582"}
Jul 10 18:18:43.544022 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:43.543991    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x" event={"ID":"60e590d6-2bf0-4f75-9bb3-c55898aa43ed","Type":"ContainerStarted","Data":"3210c3d085944f175401a75d59679befa64321dd4409d7e5a7a40b419c3dd79c"}
Jul 10 18:18:43.544169 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:43.544046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x" event={"ID":"60e590d6-2bf0-4f75-9bb3-c55898aa43ed","Type":"ContainerStarted","Data":"e766682fdcf93c1ac13ed9ad888d27d663d40fb0a487264fe098f6f7d911ed48"}
Jul 10 18:18:43.544169 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:43.544066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x" event={"ID":"60e590d6-2bf0-4f75-9bb3-c55898aa43ed","Type":"ContainerStarted","Data":"c02f95c17a7802ae5e50b2599274aae31ba215ac98cf85fc56b39b5a79e24a0f"}
Jul 10 18:18:44.549456 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:44.549423    2577 generic.go:356] "Generic (PLEG): container finished" podID="927bc1d4-2766-41a4-9dad-e6f619035370" containerID="7cb487d6fa30af1f17147fa0a9aa0e0b964d13175e548240410446b419707582" exitCode=0
Jul 10 18:18:44.549878 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:44.549481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmndv" event={"ID":"927bc1d4-2766-41a4-9dad-e6f619035370","Type":"ContainerDied","Data":"7cb487d6fa30af1f17147fa0a9aa0e0b964d13175e548240410446b419707582"}
Jul 10 18:18:45.042022 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.041981    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-668699c488-hhq6b"]
Jul 10 18:18:45.045689 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.045664    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.048324 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.048264    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 10 18:18:45.048324 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.048286    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 10 18:18:45.048324 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.048314    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1spc9b83s52r4\""
Jul 10 18:18:45.048630 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.048573    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 10 18:18:45.048630 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.048595    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9rczz\""
Jul 10 18:18:45.048831 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.048806    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 10 18:18:45.048947 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.048849    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 10 18:18:45.060768 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.060738    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-668699c488-hhq6b"]
Jul 10 18:18:45.126534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.126491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.126711 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.126547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ffa9634-85ff-4824-aebb-1338da485765-metrics-client-ca\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.126711 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.126572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97rm\" (UniqueName: \"kubernetes.io/projected/2ffa9634-85ff-4824-aebb-1338da485765-kube-api-access-l97rm\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.126711 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.126602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.126711 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.126629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.126711 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.126683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-tls\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.126900 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.126727    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.126900 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.126748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-grpc-tls\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.227798 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.227755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.227993 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.227811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.227993 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.227866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-tls\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.227993 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.227921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.227993 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.227955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-grpc-tls\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.228181 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.228018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.228181 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.228046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ffa9634-85ff-4824-aebb-1338da485765-metrics-client-ca\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.228181 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.228082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97rm\" (UniqueName: \"kubernetes.io/projected/2ffa9634-85ff-4824-aebb-1338da485765-kube-api-access-l97rm\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.232688 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.232635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.232863 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.232775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ffa9634-85ff-4824-aebb-1338da485765-metrics-client-ca\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.234675 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.234622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.234836 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.234809    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-grpc-tls\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.234917 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.234895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.234987 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.234940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-tls\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.235139 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.235123    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2ffa9634-85ff-4824-aebb-1338da485765-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.236319 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.236300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97rm\" (UniqueName: \"kubernetes.io/projected/2ffa9634-85ff-4824-aebb-1338da485765-kube-api-access-l97rm\") pod \"thanos-querier-668699c488-hhq6b\" (UID: \"2ffa9634-85ff-4824-aebb-1338da485765\") " pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.357271 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.357141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:45.499383 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.499350    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-668699c488-hhq6b"]
Jul 10 18:18:45.502419 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:45.502392    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ffa9634_85ff_4824_aebb_1338da485765.slice/crio-84c85959f1ac4f50622d7d3eee3366cd3e94b35f9d040c9037635bfa7c60110a WatchSource:0}: Error finding container 84c85959f1ac4f50622d7d3eee3366cd3e94b35f9d040c9037635bfa7c60110a: Status 404 returned error can't find the container with id 84c85959f1ac4f50622d7d3eee3366cd3e94b35f9d040c9037635bfa7c60110a
Jul 10 18:18:45.555497 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.555453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmndv" event={"ID":"927bc1d4-2766-41a4-9dad-e6f619035370","Type":"ContainerStarted","Data":"8a2d5e914a676784e7041782955da17a9040833f9109be47792ec448b7715f37"}
Jul 10 18:18:45.555934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.555532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmndv" event={"ID":"927bc1d4-2766-41a4-9dad-e6f619035370","Type":"ContainerStarted","Data":"f989713288d0d9d30c641591b3c3dc149b267233dcf346b6b78d5e42ff558d74"}
Jul 10 18:18:45.557781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.557752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x" event={"ID":"60e590d6-2bf0-4f75-9bb3-c55898aa43ed","Type":"ContainerStarted","Data":"e83d39c8fff2c4a3073fc7be51dc94ec6e9b8374dcc46b39bdaa936b6a317050"}
Jul 10 18:18:45.559029 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.559005    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b" event={"ID":"2ffa9634-85ff-4824-aebb-1338da485765","Type":"ContainerStarted","Data":"84c85959f1ac4f50622d7d3eee3366cd3e94b35f9d040c9037635bfa7c60110a"}
Jul 10 18:18:45.574906 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.574847    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lmndv" podStartSLOduration=2.49609859 podStartE2EDuration="3.574832586s" totalImagesPullingTime="1.00459994s" totalInitContainerRuntime="74.134056ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:45.573752317 +0000 UTC m=+86.246668119" watchObservedRunningTime="2026-07-10 18:18:45.574832586 +0000 UTC m=+86.247748386"
Jul 10 18:18:45.590823 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:45.590772    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kgw9x" podStartSLOduration=2.475443915 podStartE2EDuration="3.590753972s" totalImagesPullingTime="1.115310057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:45.590554418 +0000 UTC m=+86.263470218" watchObservedRunningTime="2026-07-10 18:18:45.590753972 +0000 UTC m=+86.263669811"
Jul 10 18:18:46.367021 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.366987    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"]
Jul 10 18:18:46.371135 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.371100    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.376784 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.376599    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4okdnku07a7ha\""
Jul 10 18:18:46.376784 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.376649    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 10 18:18:46.376784 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.376597    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 10 18:18:46.376784 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.376652    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 10 18:18:46.377118 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.376759    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sh47l\""
Jul 10 18:18:46.377118 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.376909    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 18:18:46.382480 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.382448    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"]
Jul 10 18:18:46.539400 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.539356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vm8\" (UniqueName: \"kubernetes.io/projected/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-kube-api-access-z5vm8\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.539400 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.539398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-secret-metrics-server-tls\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.539682 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.539542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-secret-metrics-server-client-certs\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.539682 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.539587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-audit-log\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.539682 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.539627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.539682 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.539664    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-metrics-server-audit-profiles\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.539827 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.539711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-client-ca-bundle\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.640835 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.640740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.640835 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.640778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-metrics-server-audit-profiles\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.640835 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.640798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-client-ca-bundle\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.640835 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.640830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vm8\" (UniqueName: \"kubernetes.io/projected/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-kube-api-access-z5vm8\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.641495 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.640892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-secret-metrics-server-tls\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.641495 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.641016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-secret-metrics-server-client-certs\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.641495 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.641056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-audit-log\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.641616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.641535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-audit-log\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.641797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.641773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.642174 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.642146    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-metrics-server-audit-profiles\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.643835 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.643812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-secret-metrics-server-tls\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.643962 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.643937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-secret-metrics-server-client-certs\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.644285 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.644268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-client-ca-bundle\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.653651 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.653616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vm8\" (UniqueName: \"kubernetes.io/projected/618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6-kube-api-access-z5vm8\") pod \"metrics-server-6bf447c8f6-lkb9j\" (UID: \"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6\") " pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.684477 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.684438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:18:46.866410 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:46.866272    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"]
Jul 10 18:18:46.869957 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:18:46.869915    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618cbc90_2e0d_45e2_9bfe_69bf5e6d08b6.slice/crio-aea199027980f87ef5525ae5391d1870d4764219ae3093821538311fb3b430eb WatchSource:0}: Error finding container aea199027980f87ef5525ae5391d1870d4764219ae3093821538311fb3b430eb: Status 404 returned error can't find the container with id aea199027980f87ef5525ae5391d1870d4764219ae3093821538311fb3b430eb
Jul 10 18:18:47.570590 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:47.570542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j" event={"ID":"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6","Type":"ContainerStarted","Data":"aea199027980f87ef5525ae5391d1870d4764219ae3093821538311fb3b430eb"}
Jul 10 18:18:48.579040 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:48.578999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b" event={"ID":"2ffa9634-85ff-4824-aebb-1338da485765","Type":"ContainerStarted","Data":"a1d6dd3465af2d783a37eb3e681a8a42a50406090d5e0839b4b0d9b83570c53b"}
Jul 10 18:18:48.579511 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:48.579072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b" event={"ID":"2ffa9634-85ff-4824-aebb-1338da485765","Type":"ContainerStarted","Data":"8147f3a1bd9dc249cd19a370e39adf11a05eba03e74a95d4b873b5a2960148e5"}
Jul 10 18:18:48.579511 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:48.579096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b" event={"ID":"2ffa9634-85ff-4824-aebb-1338da485765","Type":"ContainerStarted","Data":"96277d99f3f18a15ea71ed1b99ec166b721ff15f9dfd72cf9c9e2689ac41b7bc"}
Jul 10 18:18:49.586693 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:49.586654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b" event={"ID":"2ffa9634-85ff-4824-aebb-1338da485765","Type":"ContainerStarted","Data":"94e4b48011188a7a618d52572c3d4e52c4329d3473e3bc249e4846a7c429ae65"}
Jul 10 18:18:49.587190 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:49.586740    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b" event={"ID":"2ffa9634-85ff-4824-aebb-1338da485765","Type":"ContainerStarted","Data":"f7aa1d10322f182820cc8f384a5a6ed343de0055678b2c9f2b11a5193bc193ef"}
Jul 10 18:18:49.587190 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:49.586779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b" event={"ID":"2ffa9634-85ff-4824-aebb-1338da485765","Type":"ContainerStarted","Data":"fe8d23fcc889fe9492fe4fb415fc4d61af1ceaaac40630597ab159e207f000fc"}
Jul 10 18:18:49.587190 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:49.586829    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:49.588282 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:49.588255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j" event={"ID":"618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6","Type":"ContainerStarted","Data":"037c7c2275bc23746fcdf59d19a936f43c3efd2db9faaef3771ccf92a56b6abc"}
Jul 10 18:18:49.613793 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:49.613726    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b" podStartSLOduration=1.211859512 podStartE2EDuration="4.613699834s" totalImagesPullingTime="3.401840322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:18:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:49.610956485 +0000 UTC m=+90.283872295" watchObservedRunningTime="2026-07-10 18:18:49.613699834 +0000 UTC m=+90.286615635"
Jul 10 18:18:49.627655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:49.627600    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j" podStartSLOduration=1.388965288 podStartE2EDuration="3.627584026s" totalImagesPullingTime="2.238618738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:18:49.62668573 +0000 UTC m=+90.299601551" watchObservedRunningTime="2026-07-10 18:18:49.627584026 +0000 UTC m=+90.300499824"
Jul 10 18:18:50.469768 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:50.469737    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:54.498430 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:54.498398    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c5898f476-4rd2c"
Jul 10 18:18:55.487596 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.487525    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d967fff95-kghwz" podUID="13ab2f4d-9269-4e8f-988c-78773639bbf9" containerName="registry" containerID="cri-o://8d2cbb2261312c96b7a97f8de374805ce12cd2b1b7adc8d4bdc8ad42cb27caa9" gracePeriod=30
Jul 10 18:18:55.598662 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.598630    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-668699c488-hhq6b"
Jul 10 18:18:55.614323 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.614289    2577 generic.go:356] "Generic (PLEG): container finished" podID="13ab2f4d-9269-4e8f-988c-78773639bbf9" containerID="8d2cbb2261312c96b7a97f8de374805ce12cd2b1b7adc8d4bdc8ad42cb27caa9" exitCode=0
Jul 10 18:18:55.614472 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.614355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d967fff95-kghwz" event={"ID":"13ab2f4d-9269-4e8f-988c-78773639bbf9","Type":"ContainerDied","Data":"8d2cbb2261312c96b7a97f8de374805ce12cd2b1b7adc8d4bdc8ad42cb27caa9"}
Jul 10 18:18:55.749950 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.749882    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:55.916318 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916278    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-image-registry-private-configuration\") pod \"13ab2f4d-9269-4e8f-988c-78773639bbf9\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") "
Jul 10 18:18:55.916528 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916329    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjjmc\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-kube-api-access-pjjmc\") pod \"13ab2f4d-9269-4e8f-988c-78773639bbf9\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") "
Jul 10 18:18:55.916528 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916367    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-trusted-ca\") pod \"13ab2f4d-9269-4e8f-988c-78773639bbf9\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") "
Jul 10 18:18:55.916528 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916473    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-bound-sa-token\") pod \"13ab2f4d-9269-4e8f-988c-78773639bbf9\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") "
Jul 10 18:18:55.916688 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916528    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-installation-pull-secrets\") pod \"13ab2f4d-9269-4e8f-988c-78773639bbf9\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") "
Jul 10 18:18:55.916688 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916557    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13ab2f4d-9269-4e8f-988c-78773639bbf9-ca-trust-extracted\") pod \"13ab2f4d-9269-4e8f-988c-78773639bbf9\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") "
Jul 10 18:18:55.916688 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916578    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-certificates\") pod \"13ab2f4d-9269-4e8f-988c-78773639bbf9\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") "
Jul 10 18:18:55.916688 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916596    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") pod \"13ab2f4d-9269-4e8f-988c-78773639bbf9\" (UID: \"13ab2f4d-9269-4e8f-988c-78773639bbf9\") "
Jul 10 18:18:55.916926 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916903    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "13ab2f4d-9269-4e8f-988c-78773639bbf9" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:18:55.916999 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.916975    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "13ab2f4d-9269-4e8f-988c-78773639bbf9" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:18:55.919214 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.919166    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "13ab2f4d-9269-4e8f-988c-78773639bbf9" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:18:55.919214 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.919183    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "13ab2f4d-9269-4e8f-988c-78773639bbf9" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:18:55.919437 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.919264    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-kube-api-access-pjjmc" (OuterVolumeSpecName: "kube-api-access-pjjmc") pod "13ab2f4d-9269-4e8f-988c-78773639bbf9" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9"). InnerVolumeSpecName "kube-api-access-pjjmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:18:55.919437 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.919323    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "13ab2f4d-9269-4e8f-988c-78773639bbf9" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:18:55.919687 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.919670    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "13ab2f4d-9269-4e8f-988c-78773639bbf9" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:18:55.928156 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:55.928117    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ab2f4d-9269-4e8f-988c-78773639bbf9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "13ab2f4d-9269-4e8f-988c-78773639bbf9" (UID: "13ab2f4d-9269-4e8f-988c-78773639bbf9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:18:56.017721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.017622    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-installation-pull-secrets\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:18:56.017721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.017666    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13ab2f4d-9269-4e8f-988c-78773639bbf9-ca-trust-extracted\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:18:56.017721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.017676    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-certificates\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:18:56.017721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.017687    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-registry-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:18:56.017721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.017697    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13ab2f4d-9269-4e8f-988c-78773639bbf9-image-registry-private-configuration\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:18:56.017721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.017706    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjjmc\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-kube-api-access-pjjmc\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:18:56.017721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.017714    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13ab2f4d-9269-4e8f-988c-78773639bbf9-trusted-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:18:56.017721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.017722    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13ab2f4d-9269-4e8f-988c-78773639bbf9-bound-sa-token\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:18:56.620717 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.620687    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d967fff95-kghwz"
Jul 10 18:18:56.620717 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.620712    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d967fff95-kghwz" event={"ID":"13ab2f4d-9269-4e8f-988c-78773639bbf9","Type":"ContainerDied","Data":"7edd75bdbb06590405294792b1fa658367cdff0bc095c09c41dac6bf0d33537d"}
Jul 10 18:18:56.621158 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.620765    2577 scope.go:117] "RemoveContainer" containerID="8d2cbb2261312c96b7a97f8de374805ce12cd2b1b7adc8d4bdc8ad42cb27caa9"
Jul 10 18:18:56.638157 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.638122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d967fff95-kghwz"]
Jul 10 18:18:56.641915 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:56.641888    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d967fff95-kghwz"]
Jul 10 18:18:58.132381 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:18:58.132340    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13ab2f4d-9269-4e8f-988c-78773639bbf9" path="/var/lib/kubelet/pods/13ab2f4d-9269-4e8f-988c-78773639bbf9/volumes"
Jul 10 18:19:03.022257 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.022203    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-8xnbd"]
Jul 10 18:19:03.022649 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.022553    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ab2f4d-9269-4e8f-988c-78773639bbf9" containerName="registry"
Jul 10 18:19:03.022649 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.022564    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ab2f4d-9269-4e8f-988c-78773639bbf9" containerName="registry"
Jul 10 18:19:03.022649 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.022616    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ab2f4d-9269-4e8f-988c-78773639bbf9" containerName="registry"
Jul 10 18:19:03.231741 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.231707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-8xnbd"]
Jul 10 18:19:03.231883 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.231787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-8xnbd"
Jul 10 18:19:03.234514 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.234489    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 18:19:03.234657 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.234643    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qqnhf\""
Jul 10 18:19:03.234839 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.234822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 18:19:03.274963 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.274866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2chj\" (UniqueName: \"kubernetes.io/projected/2664d308-ba4b-417b-872f-59c0e3c27e48-kube-api-access-v2chj\") pod \"downloads-68c9cbb497-8xnbd\" (UID: \"2664d308-ba4b-417b-872f-59c0e3c27e48\") " pod="openshift-console/downloads-68c9cbb497-8xnbd"
Jul 10 18:19:03.375462 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.375419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2chj\" (UniqueName: \"kubernetes.io/projected/2664d308-ba4b-417b-872f-59c0e3c27e48-kube-api-access-v2chj\") pod \"downloads-68c9cbb497-8xnbd\" (UID: \"2664d308-ba4b-417b-872f-59c0e3c27e48\") " pod="openshift-console/downloads-68c9cbb497-8xnbd"
Jul 10 18:19:03.387330 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.387300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2chj\" (UniqueName: \"kubernetes.io/projected/2664d308-ba4b-417b-872f-59c0e3c27e48-kube-api-access-v2chj\") pod \"downloads-68c9cbb497-8xnbd\" (UID: \"2664d308-ba4b-417b-872f-59c0e3c27e48\") " pod="openshift-console/downloads-68c9cbb497-8xnbd"
Jul 10 18:19:03.541211 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.541118    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-8xnbd"
Jul 10 18:19:03.697764 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:03.697732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-8xnbd"]
Jul 10 18:19:03.701354 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:19:03.701326    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2664d308_ba4b_417b_872f_59c0e3c27e48.slice/crio-eb51950b6bed01277a970e2c1106605662ff35ac15f2235a7aee0303aec8aaad WatchSource:0}: Error finding container eb51950b6bed01277a970e2c1106605662ff35ac15f2235a7aee0303aec8aaad: Status 404 returned error can't find the container with id eb51950b6bed01277a970e2c1106605662ff35ac15f2235a7aee0303aec8aaad
Jul 10 18:19:04.496341 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:04.496314    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gb9lp"
Jul 10 18:19:04.654797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:04.654759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-8xnbd" event={"ID":"2664d308-ba4b-417b-872f-59c0e3c27e48","Type":"ContainerStarted","Data":"eb51950b6bed01277a970e2c1106605662ff35ac15f2235a7aee0303aec8aaad"}
Jul 10 18:19:06.685103 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:06.685074    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:19:06.685600 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:06.685136    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:19:13.349114 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.349079    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d56c64857-nrbwl"]
Jul 10 18:19:13.351986 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.351960    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.354572 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.354547    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 18:19:13.354572 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.354562    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 18:19:13.355526 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.355503    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 18:19:13.355638 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.355583    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 18:19:13.355706 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.355637    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j4rhd\""
Jul 10 18:19:13.355897 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.355877    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 18:19:13.363922 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.363849    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d56c64857-nrbwl"]
Jul 10 18:19:13.468291 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.468255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-serving-cert\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.468291 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.468292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-service-ca\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.468547 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.468378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-oauth-serving-cert\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.468547 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.468407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8lhf\" (UniqueName: \"kubernetes.io/projected/c2895780-fe77-493e-a9d8-564a2343e675-kube-api-access-c8lhf\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.468547 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.468434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-console-config\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.468547 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.468468    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-oauth-config\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.569305 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.569268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-oauth-config\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.569506 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.569337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-serving-cert\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.569506 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.569361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-service-ca\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.569506 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.569420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-oauth-serving-cert\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.569794 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.569759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8lhf\" (UniqueName: \"kubernetes.io/projected/c2895780-fe77-493e-a9d8-564a2343e675-kube-api-access-c8lhf\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.569944 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.569810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-console-config\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.570305 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.570276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-service-ca\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.570409 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.570284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-oauth-serving-cert\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.570468 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.570424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-console-config\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.572178 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.572155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-serving-cert\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.572371 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.572347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-oauth-config\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.578852 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.578821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8lhf\" (UniqueName: \"kubernetes.io/projected/c2895780-fe77-493e-a9d8-564a2343e675-kube-api-access-c8lhf\") pod \"console-6d56c64857-nrbwl\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") " pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.663949 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.663913    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:13.817155 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:13.817109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d56c64857-nrbwl"]
Jul 10 18:19:13.821848 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:19:13.821816    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2895780_fe77_493e_a9d8_564a2343e675.slice/crio-9a581424d6946ff12762cef9d6b82d47d2447332fc734cb0f982dea00bf92137 WatchSource:0}: Error finding container 9a581424d6946ff12762cef9d6b82d47d2447332fc734cb0f982dea00bf92137: Status 404 returned error can't find the container with id 9a581424d6946ff12762cef9d6b82d47d2447332fc734cb0f982dea00bf92137
Jul 10 18:19:14.697136 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:14.697100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d56c64857-nrbwl" event={"ID":"c2895780-fe77-493e-a9d8-564a2343e675","Type":"ContainerStarted","Data":"9a581424d6946ff12762cef9d6b82d47d2447332fc734cb0f982dea00bf92137"}
Jul 10 18:19:20.929084 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:20.929050    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9c44d9dc-jhfv7"]
Jul 10 18:19:20.932323 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:20.932295    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:20.940938 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:20.940913    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 18:19:20.945040 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:20.945013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c44d9dc-jhfv7"]
Jul 10 18:19:21.036972 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.036930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-service-ca\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.037143 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.036988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-oauth-serving-cert\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.037143 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.037089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-config\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.037143 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.037126    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-trusted-ca-bundle\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.037336 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.037181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-oauth-config\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.037336 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.037266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-serving-cert\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.037417 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.037358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb9d9\" (UniqueName: \"kubernetes.io/projected/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-kube-api-access-xb9d9\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138007 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.137966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-oauth-serving-cert\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138284 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-config\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138284 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-trusted-ca-bundle\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138284 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-oauth-config\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138284 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-serving-cert\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138284 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9d9\" (UniqueName: \"kubernetes.io/projected/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-kube-api-access-xb9d9\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138284 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-service-ca\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138892 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-oauth-serving-cert\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138998 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138944    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-service-ca\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.138998 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.138958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-config\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.139368 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.139351    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-trusted-ca-bundle\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.140785 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.140765    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-oauth-config\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.140928 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.140904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-serving-cert\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.146848 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.146818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb9d9\" (UniqueName: \"kubernetes.io/projected/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-kube-api-access-xb9d9\") pod \"console-9c44d9dc-jhfv7\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") " pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:21.245021 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:21.244932    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:23.090666 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.090608    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c44d9dc-jhfv7"]
Jul 10 18:19:23.095179 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:19:23.095139    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fdd1fe_00a3_4b45_8fbe_2ff63d7d23a2.slice/crio-f48833acdd98bef37bf11a676c7ef8f72902d435297e04c01cda988c4e2b7a0a WatchSource:0}: Error finding container f48833acdd98bef37bf11a676c7ef8f72902d435297e04c01cda988c4e2b7a0a: Status 404 returned error can't find the container with id f48833acdd98bef37bf11a676c7ef8f72902d435297e04c01cda988c4e2b7a0a
Jul 10 18:19:23.739316 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.739280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-8xnbd" event={"ID":"2664d308-ba4b-417b-872f-59c0e3c27e48","Type":"ContainerStarted","Data":"ae5f248047b658e89a165c173cd1d049a9f8a2da0739827773f54d144891dd40"}
Jul 10 18:19:23.739531 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.739458    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-8xnbd"
Jul 10 18:19:23.741580 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.741546    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d56c64857-nrbwl" event={"ID":"c2895780-fe77-493e-a9d8-564a2343e675","Type":"ContainerStarted","Data":"0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734"}
Jul 10 18:19:23.743291 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.743262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c44d9dc-jhfv7" event={"ID":"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2","Type":"ContainerStarted","Data":"f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54"}
Jul 10 18:19:23.743410 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.743310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c44d9dc-jhfv7" event={"ID":"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2","Type":"ContainerStarted","Data":"f48833acdd98bef37bf11a676c7ef8f72902d435297e04c01cda988c4e2b7a0a"}
Jul 10 18:19:23.757410 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.757367    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-8xnbd"
Jul 10 18:19:23.758582 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.758524    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-8xnbd" podStartSLOduration=2.471623694 podStartE2EDuration="21.758507979s" totalImagesPullingTime="19.286884285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:19:23.757014527 +0000 UTC m=+124.429930327" watchObservedRunningTime="2026-07-10 18:19:23.758507979 +0000 UTC m=+124.431423778"
Jul 10 18:19:23.775350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.775289    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d56c64857-nrbwl" podStartSLOduration=1.654594756 podStartE2EDuration="10.775264844s" totalImagesPullingTime="9.120670088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:19:23.773140027 +0000 UTC m=+124.446055877" watchObservedRunningTime="2026-07-10 18:19:23.775264844 +0000 UTC m=+124.448180644"
Jul 10 18:19:23.792540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:23.792477    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9c44d9dc-jhfv7" podStartSLOduration=3.792453611 podStartE2EDuration="3.792453611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:19:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:19:23.791453353 +0000 UTC m=+124.464369153" watchObservedRunningTime="2026-07-10 18:19:23.792453611 +0000 UTC m=+124.465369410"
Jul 10 18:19:26.691394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:26.691358    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:19:26.696142 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:26.696108    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6bf447c8f6-lkb9j"
Jul 10 18:19:31.245605 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:31.245564    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:31.246052 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:31.245648    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:31.251267 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:31.251217    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:31.786924 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:31.786890    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:19:31.829871 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:31.829826    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d56c64857-nrbwl"]
Jul 10 18:19:33.664499 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:33.664454    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:56.863203 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:56.863137    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d56c64857-nrbwl" podUID="c2895780-fe77-493e-a9d8-564a2343e675" containerName="console" containerID="cri-o://0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734" gracePeriod=15
Jul 10 18:19:57.154444 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.154410    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:57.262934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.262896    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-oauth-config\") pod \"c2895780-fe77-493e-a9d8-564a2343e675\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") "
Jul 10 18:19:57.262934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.262937    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-oauth-serving-cert\") pod \"c2895780-fe77-493e-a9d8-564a2343e675\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") "
Jul 10 18:19:57.263186 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.262954    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-serving-cert\") pod \"c2895780-fe77-493e-a9d8-564a2343e675\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") "
Jul 10 18:19:57.263186 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.262995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8lhf\" (UniqueName: \"kubernetes.io/projected/c2895780-fe77-493e-a9d8-564a2343e675-kube-api-access-c8lhf\") pod \"c2895780-fe77-493e-a9d8-564a2343e675\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") "
Jul 10 18:19:57.263186 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.263036    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-service-ca\") pod \"c2895780-fe77-493e-a9d8-564a2343e675\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") "
Jul 10 18:19:57.263186 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.263059    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-console-config\") pod \"c2895780-fe77-493e-a9d8-564a2343e675\" (UID: \"c2895780-fe77-493e-a9d8-564a2343e675\") "
Jul 10 18:19:57.263537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.263505    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2895780-fe77-493e-a9d8-564a2343e675" (UID: "c2895780-fe77-493e-a9d8-564a2343e675"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:19:57.263537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.263517    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2895780-fe77-493e-a9d8-564a2343e675" (UID: "c2895780-fe77-493e-a9d8-564a2343e675"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:19:57.263683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.263573    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-console-config" (OuterVolumeSpecName: "console-config") pod "c2895780-fe77-493e-a9d8-564a2343e675" (UID: "c2895780-fe77-493e-a9d8-564a2343e675"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:19:57.265482 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.265452    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2895780-fe77-493e-a9d8-564a2343e675" (UID: "c2895780-fe77-493e-a9d8-564a2343e675"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:19:57.265694 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.265663    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2895780-fe77-493e-a9d8-564a2343e675" (UID: "c2895780-fe77-493e-a9d8-564a2343e675"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:19:57.265694 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.265685    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2895780-fe77-493e-a9d8-564a2343e675-kube-api-access-c8lhf" (OuterVolumeSpecName: "kube-api-access-c8lhf") pod "c2895780-fe77-493e-a9d8-564a2343e675" (UID: "c2895780-fe77-493e-a9d8-564a2343e675"). InnerVolumeSpecName "kube-api-access-c8lhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:19:57.364145 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.364103    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:19:57.364145 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.364139    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-console-config\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:19:57.364145 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.364149    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-oauth-config\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:19:57.364145 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.364159    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2895780-fe77-493e-a9d8-564a2343e675-oauth-serving-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:19:57.364438 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.364168    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2895780-fe77-493e-a9d8-564a2343e675-console-serving-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:19:57.364438 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.364176    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8lhf\" (UniqueName: \"kubernetes.io/projected/c2895780-fe77-493e-a9d8-564a2343e675-kube-api-access-c8lhf\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:19:57.881174 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.881141    2577 generic.go:356] "Generic (PLEG): container finished" podID="c2895780-fe77-493e-a9d8-564a2343e675" containerID="0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734" exitCode=0
Jul 10 18:19:57.881613 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.881189    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d56c64857-nrbwl"
Jul 10 18:19:57.881613 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.881239    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d56c64857-nrbwl" event={"ID":"c2895780-fe77-493e-a9d8-564a2343e675","Type":"ContainerDied","Data":"0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734"}
Jul 10 18:19:57.881613 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.881297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d56c64857-nrbwl" event={"ID":"c2895780-fe77-493e-a9d8-564a2343e675","Type":"ContainerDied","Data":"9a581424d6946ff12762cef9d6b82d47d2447332fc734cb0f982dea00bf92137"}
Jul 10 18:19:57.881613 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.881325    2577 scope.go:117] "RemoveContainer" containerID="0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734"
Jul 10 18:19:57.890162 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.890144    2577 scope.go:117] "RemoveContainer" containerID="0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734"
Jul 10 18:19:57.890495 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:19:57.890475    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734\": container with ID starting with 0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734 not found: ID does not exist" containerID="0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734"
Jul 10 18:19:57.890559 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.890503    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734"} err="failed to get container status \"0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734\": rpc error: code = NotFound desc = could not find container \"0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734\": container with ID starting with 0fa5391df70e1f31d8093d74b526a0a39e5e4d7948e6c6143b1e0f8eef4af734 not found: ID does not exist"
Jul 10 18:19:57.905186 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.905150    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d56c64857-nrbwl"]
Jul 10 18:19:57.914742 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:57.914710    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d56c64857-nrbwl"]
Jul 10 18:19:58.132047 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:19:58.131960    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2895780-fe77-493e-a9d8-564a2343e675" path="/var/lib/kubelet/pods/c2895780-fe77-493e-a9d8-564a2343e675/volumes"
Jul 10 18:20:11.086501 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.086422    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-564db4447c-8mhpt"]
Jul 10 18:20:11.086939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.086751    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2895780-fe77-493e-a9d8-564a2343e675" containerName="console"
Jul 10 18:20:11.086939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.086763    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2895780-fe77-493e-a9d8-564a2343e675" containerName="console"
Jul 10 18:20:11.086939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.086815    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2895780-fe77-493e-a9d8-564a2343e675" containerName="console"
Jul 10 18:20:11.088931 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.088908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.100807 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.100779    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564db4447c-8mhpt"]
Jul 10 18:20:11.184749 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.184699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-trusted-ca-bundle\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.184749 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.184757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54fg8\" (UniqueName: \"kubernetes.io/projected/7afa0bbe-cc25-4190-aa1b-39463505d153-kube-api-access-54fg8\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.185014 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.184782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-oauth-config\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.185014 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.184804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-console-config\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.185014 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.184838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-serving-cert\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.185014 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.184860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-oauth-serving-cert\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.185172 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.185088    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-service-ca\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.286557 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.286508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-service-ca\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.286781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.286572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-trusted-ca-bundle\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.286781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.286645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54fg8\" (UniqueName: \"kubernetes.io/projected/7afa0bbe-cc25-4190-aa1b-39463505d153-kube-api-access-54fg8\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.286781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.286692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-oauth-config\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.286781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.286712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-console-config\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.286781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.286741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-serving-cert\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.286781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.286766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-oauth-serving-cert\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.287522 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.287494    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-service-ca\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.287632 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.287530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-oauth-serving-cert\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.287632 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.287501    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-console-config\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.287721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.287646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-trusted-ca-bundle\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.289930 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.289903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-oauth-config\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.290034 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.289931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-serving-cert\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.295664 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.295634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54fg8\" (UniqueName: \"kubernetes.io/projected/7afa0bbe-cc25-4190-aa1b-39463505d153-kube-api-access-54fg8\") pod \"console-564db4447c-8mhpt\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") " pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.398551 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.398447    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:11.544825 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.544798    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564db4447c-8mhpt"]
Jul 10 18:20:11.547461 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:20:11.547433    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afa0bbe_cc25_4190_aa1b_39463505d153.slice/crio-d2571716df97ed84dcbe96c6dea54cbded475fea1aa0891d05c91b7cc255a679 WatchSource:0}: Error finding container d2571716df97ed84dcbe96c6dea54cbded475fea1aa0891d05c91b7cc255a679: Status 404 returned error can't find the container with id d2571716df97ed84dcbe96c6dea54cbded475fea1aa0891d05c91b7cc255a679
Jul 10 18:20:11.939350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.939311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564db4447c-8mhpt" event={"ID":"7afa0bbe-cc25-4190-aa1b-39463505d153","Type":"ContainerStarted","Data":"0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39"}
Jul 10 18:20:11.939551 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.939373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564db4447c-8mhpt" event={"ID":"7afa0bbe-cc25-4190-aa1b-39463505d153","Type":"ContainerStarted","Data":"d2571716df97ed84dcbe96c6dea54cbded475fea1aa0891d05c91b7cc255a679"}
Jul 10 18:20:11.963034 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:11.962983    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-564db4447c-8mhpt" podStartSLOduration=0.962964007 podStartE2EDuration="962.964007ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:20:11.961815363 +0000 UTC m=+172.634731163" watchObservedRunningTime="2026-07-10 18:20:11.962964007 +0000 UTC m=+172.635879805"
Jul 10 18:20:21.398907 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:21.398863    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:21.399546 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:21.398954    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:21.403908 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:21.403885    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:21.980148 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:21.980117    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:20:22.024185 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:22.024150    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9c44d9dc-jhfv7"]
Jul 10 18:20:47.045010 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.044943    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9c44d9dc-jhfv7" podUID="26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" containerName="console" containerID="cri-o://f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54" gracePeriod=15
Jul 10 18:20:47.300925 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.300854    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:20:47.394701 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.394657    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-trusted-ca-bundle\") pod \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") "
Jul 10 18:20:47.394701 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.394709    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-oauth-serving-cert\") pod \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") "
Jul 10 18:20:47.394932 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.394757    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb9d9\" (UniqueName: \"kubernetes.io/projected/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-kube-api-access-xb9d9\") pod \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") "
Jul 10 18:20:47.394932 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.394776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-config\") pod \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") "
Jul 10 18:20:47.395036 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.394962    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-serving-cert\") pod \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") "
Jul 10 18:20:47.395036 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395022    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-oauth-config\") pod \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") "
Jul 10 18:20:47.395129 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395057    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-service-ca\") pod \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\" (UID: \"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2\") "
Jul 10 18:20:47.395129 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395091    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" (UID: "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:20:47.395252 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395199    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" (UID: "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:20:47.395252 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395204    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-config" (OuterVolumeSpecName: "console-config") pod "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" (UID: "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:20:47.395478 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395347    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-oauth-serving-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:20:47.395574 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395479    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-config\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:20:47.395574 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395495    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-trusted-ca-bundle\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:20:47.395574 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.395511    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" (UID: "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:20:47.396998 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.396974    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-kube-api-access-xb9d9" (OuterVolumeSpecName: "kube-api-access-xb9d9") pod "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" (UID: "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2"). InnerVolumeSpecName "kube-api-access-xb9d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:20:47.397098 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.397032    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" (UID: "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:20:47.397098 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.397054    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" (UID: "26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:20:47.496684 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.496643    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb9d9\" (UniqueName: \"kubernetes.io/projected/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-kube-api-access-xb9d9\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:20:47.496684 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.496680    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-serving-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:20:47.496684 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.496689    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-console-oauth-config\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:20:47.496904 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:47.496699    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:20:48.076571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.076536    2577 generic.go:356] "Generic (PLEG): container finished" podID="26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" containerID="f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54" exitCode=0
Jul 10 18:20:48.076979 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.076583    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c44d9dc-jhfv7"
Jul 10 18:20:48.076979 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.076608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c44d9dc-jhfv7" event={"ID":"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2","Type":"ContainerDied","Data":"f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54"}
Jul 10 18:20:48.076979 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.076649    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c44d9dc-jhfv7" event={"ID":"26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2","Type":"ContainerDied","Data":"f48833acdd98bef37bf11a676c7ef8f72902d435297e04c01cda988c4e2b7a0a"}
Jul 10 18:20:48.076979 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.076668    2577 scope.go:117] "RemoveContainer" containerID="f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54"
Jul 10 18:20:48.085368 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.085347    2577 scope.go:117] "RemoveContainer" containerID="f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54"
Jul 10 18:20:48.085687 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:20:48.085668    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54\": container with ID starting with f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54 not found: ID does not exist" containerID="f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54"
Jul 10 18:20:48.085737 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.085696    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54"} err="failed to get container status \"f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54\": rpc error: code = NotFound desc = could not find container \"f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54\": container with ID starting with f5ee2b64b19ee1a8bce7c17ac0f9ef082eec50784d6ef6d136ba0a545f8baf54 not found: ID does not exist"
Jul 10 18:20:48.098424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.098380    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9c44d9dc-jhfv7"]
Jul 10 18:20:48.102853 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.102823    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9c44d9dc-jhfv7"]
Jul 10 18:20:48.133154 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:20:48.133120    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" path="/var/lib/kubelet/pods/26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2/volumes"
Jul 10 18:21:26.541054 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.541014    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fd854b49c-qgk59"]
Jul 10 18:21:26.541500 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.541353    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" containerName="console"
Jul 10 18:21:26.541500 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.541366    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" containerName="console"
Jul 10 18:21:26.541500 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.541434    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fdd1fe-00a3-4b45-8fbe-2ff63d7d23a2" containerName="console"
Jul 10 18:21:26.544391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.544373    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.555463 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.555437    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fd854b49c-qgk59"]
Jul 10 18:21:26.721391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.721350    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9x6x\" (UniqueName: \"kubernetes.io/projected/37b06992-6bcf-40da-a2eb-0b5d5336233c-kube-api-access-p9x6x\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.721391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.721393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-oauth-serving-cert\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.721623 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.721449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-config\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.721623 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.721513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-service-ca\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.721623 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.721577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-oauth-config\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.721722 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.721623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-serving-cert\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.721722 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.721647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-trusted-ca-bundle\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.822432 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.822337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-oauth-config\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.822432 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.822386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-serving-cert\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.822432 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.822407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-trusted-ca-bundle\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.822432 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.822428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9x6x\" (UniqueName: \"kubernetes.io/projected/37b06992-6bcf-40da-a2eb-0b5d5336233c-kube-api-access-p9x6x\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.822758 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.822446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-oauth-serving-cert\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.822758 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.822544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-config\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.822758 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.822566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-service-ca\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.823345 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.823316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-service-ca\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.823345 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.823330    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-config\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.823489 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.823321    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-oauth-serving-cert\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.823489 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.823408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-trusted-ca-bundle\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.825052 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.825028    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-serving-cert\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.825052 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.825045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-oauth-config\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.831594 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.831575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9x6x\" (UniqueName: \"kubernetes.io/projected/37b06992-6bcf-40da-a2eb-0b5d5336233c-kube-api-access-p9x6x\") pod \"console-fd854b49c-qgk59\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") " pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.854694 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.854647    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:26.990119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:26.990093    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fd854b49c-qgk59"]
Jul 10 18:21:26.992667 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:21:26.992636    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b06992_6bcf_40da_a2eb_0b5d5336233c.slice/crio-dc28e564c714cdd1631c27c3c58657e484074a319475917bbcca72a6ce600ab4 WatchSource:0}: Error finding container dc28e564c714cdd1631c27c3c58657e484074a319475917bbcca72a6ce600ab4: Status 404 returned error can't find the container with id dc28e564c714cdd1631c27c3c58657e484074a319475917bbcca72a6ce600ab4
Jul 10 18:21:27.221876 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:27.221840    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd854b49c-qgk59" event={"ID":"37b06992-6bcf-40da-a2eb-0b5d5336233c","Type":"ContainerStarted","Data":"a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64"}
Jul 10 18:21:27.222074 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:27.221924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd854b49c-qgk59" event={"ID":"37b06992-6bcf-40da-a2eb-0b5d5336233c","Type":"ContainerStarted","Data":"dc28e564c714cdd1631c27c3c58657e484074a319475917bbcca72a6ce600ab4"}
Jul 10 18:21:27.240162 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:27.240104    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fd854b49c-qgk59" podStartSLOduration=1.240084734 podStartE2EDuration="1.240084734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:21:27.239675562 +0000 UTC m=+247.912591374" watchObservedRunningTime="2026-07-10 18:21:27.240084734 +0000 UTC m=+247.913000534"
Jul 10 18:21:36.855558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:36.855494    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:36.856163 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:36.855613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:36.860738 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:36.860715    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:37.265142 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:37.265109    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:21:37.309791 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:21:37.309764    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564db4447c-8mhpt"]
Jul 10 18:22:02.333760 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.333719    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-564db4447c-8mhpt" podUID="7afa0bbe-cc25-4190-aa1b-39463505d153" containerName="console" containerID="cri-o://0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39" gracePeriod=15
Jul 10 18:22:02.581624 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.581598    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:22:02.718176 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718138    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-oauth-serving-cert\") pod \"7afa0bbe-cc25-4190-aa1b-39463505d153\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") "
Jul 10 18:22:02.718394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718185    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-console-config\") pod \"7afa0bbe-cc25-4190-aa1b-39463505d153\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") "
Jul 10 18:22:02.718394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718234    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-oauth-config\") pod \"7afa0bbe-cc25-4190-aa1b-39463505d153\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") "
Jul 10 18:22:02.718394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718255    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54fg8\" (UniqueName: \"kubernetes.io/projected/7afa0bbe-cc25-4190-aa1b-39463505d153-kube-api-access-54fg8\") pod \"7afa0bbe-cc25-4190-aa1b-39463505d153\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") "
Jul 10 18:22:02.718394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718277    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-serving-cert\") pod \"7afa0bbe-cc25-4190-aa1b-39463505d153\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") "
Jul 10 18:22:02.718394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718306    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-trusted-ca-bundle\") pod \"7afa0bbe-cc25-4190-aa1b-39463505d153\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") "
Jul 10 18:22:02.718394 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718333    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-service-ca\") pod \"7afa0bbe-cc25-4190-aa1b-39463505d153\" (UID: \"7afa0bbe-cc25-4190-aa1b-39463505d153\") "
Jul 10 18:22:02.718719 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718667    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-console-config" (OuterVolumeSpecName: "console-config") pod "7afa0bbe-cc25-4190-aa1b-39463505d153" (UID: "7afa0bbe-cc25-4190-aa1b-39463505d153"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:22:02.718851 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718826    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-service-ca" (OuterVolumeSpecName: "service-ca") pod "7afa0bbe-cc25-4190-aa1b-39463505d153" (UID: "7afa0bbe-cc25-4190-aa1b-39463505d153"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:22:02.718967 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718928    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7afa0bbe-cc25-4190-aa1b-39463505d153" (UID: "7afa0bbe-cc25-4190-aa1b-39463505d153"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:22:02.719024 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.718964    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7afa0bbe-cc25-4190-aa1b-39463505d153" (UID: "7afa0bbe-cc25-4190-aa1b-39463505d153"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:22:02.720868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.720833    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7afa0bbe-cc25-4190-aa1b-39463505d153-kube-api-access-54fg8" (OuterVolumeSpecName: "kube-api-access-54fg8") pod "7afa0bbe-cc25-4190-aa1b-39463505d153" (UID: "7afa0bbe-cc25-4190-aa1b-39463505d153"). InnerVolumeSpecName "kube-api-access-54fg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:22:02.720868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.720839    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7afa0bbe-cc25-4190-aa1b-39463505d153" (UID: "7afa0bbe-cc25-4190-aa1b-39463505d153"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:22:02.721006 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.720917    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7afa0bbe-cc25-4190-aa1b-39463505d153" (UID: "7afa0bbe-cc25-4190-aa1b-39463505d153"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:22:02.819518 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.819474    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-oauth-serving-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:02.819518 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.819512    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-console-config\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:02.819518 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.819525    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-oauth-config\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:02.819760 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.819537    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54fg8\" (UniqueName: \"kubernetes.io/projected/7afa0bbe-cc25-4190-aa1b-39463505d153-kube-api-access-54fg8\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:02.819760 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.819551    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa0bbe-cc25-4190-aa1b-39463505d153-console-serving-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:02.819760 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.819564    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-trusted-ca-bundle\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:02.819760 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:02.819575    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa0bbe-cc25-4190-aa1b-39463505d153-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:03.368202 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.368162    2577 generic.go:356] "Generic (PLEG): container finished" podID="7afa0bbe-cc25-4190-aa1b-39463505d153" containerID="0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39" exitCode=0
Jul 10 18:22:03.368202 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.368207    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564db4447c-8mhpt"
Jul 10 18:22:03.368728 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.368253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564db4447c-8mhpt" event={"ID":"7afa0bbe-cc25-4190-aa1b-39463505d153","Type":"ContainerDied","Data":"0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39"}
Jul 10 18:22:03.368728 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.368306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564db4447c-8mhpt" event={"ID":"7afa0bbe-cc25-4190-aa1b-39463505d153","Type":"ContainerDied","Data":"d2571716df97ed84dcbe96c6dea54cbded475fea1aa0891d05c91b7cc255a679"}
Jul 10 18:22:03.368728 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.368327    2577 scope.go:117] "RemoveContainer" containerID="0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39"
Jul 10 18:22:03.377586 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.377567    2577 scope.go:117] "RemoveContainer" containerID="0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39"
Jul 10 18:22:03.377892 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:22:03.377874    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39\": container with ID starting with 0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39 not found: ID does not exist" containerID="0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39"
Jul 10 18:22:03.377932 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.377902    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39"} err="failed to get container status \"0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39\": rpc error: code = NotFound desc = could not find container \"0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39\": container with ID starting with 0e040def125fb3af0a63367ca5472831b8cb0275b71893ee0eada041e3ee4e39 not found: ID does not exist"
Jul 10 18:22:03.390631 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.390551    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564db4447c-8mhpt"]
Jul 10 18:22:03.392027 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:03.392001    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-564db4447c-8mhpt"]
Jul 10 18:22:04.131666 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:04.131636    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7afa0bbe-cc25-4190-aa1b-39463505d153" path="/var/lib/kubelet/pods/7afa0bbe-cc25-4190-aa1b-39463505d153/volumes"
Jul 10 18:22:19.734276 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.734214    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"]
Jul 10 18:22:19.734739 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.734528    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7afa0bbe-cc25-4190-aa1b-39463505d153" containerName="console"
Jul 10 18:22:19.734739 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.734539    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7afa0bbe-cc25-4190-aa1b-39463505d153" containerName="console"
Jul 10 18:22:19.734739 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.734600    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7afa0bbe-cc25-4190-aa1b-39463505d153" containerName="console"
Jul 10 18:22:19.736673 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.736656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.739305 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.739266    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-px9fh\""
Jul 10 18:22:19.739452 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.739430    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 18:22:19.740182 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.740167    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 18:22:19.746139 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.746114    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"]
Jul 10 18:22:19.861668 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.861635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.861860 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.861679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtd2b\" (UniqueName: \"kubernetes.io/projected/31fbd46c-09d5-4120-8daf-993052160354-kube-api-access-wtd2b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.861860 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.861714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.919822 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.919794    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:22:19.926655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.926630    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 18:22:19.928210 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.928187    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:22:19.962966 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.962926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.962966 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.962971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtd2b\" (UniqueName: \"kubernetes.io/projected/31fbd46c-09d5-4120-8daf-993052160354-kube-api-access-wtd2b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.963177 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.962999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.963359 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.963339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.963405 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.963363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:19.971337 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.971315    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 18:22:19.982751 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.982727    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 18:22:19.993317 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:19.993217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtd2b\" (UniqueName: \"kubernetes.io/projected/31fbd46c-09d5-4120-8daf-993052160354-kube-api-access-wtd2b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:20.049674 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:20.049646    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-px9fh\""
Jul 10 18:22:20.057017 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:20.056989    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:20.201470 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:20.201380    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"]
Jul 10 18:22:20.204216 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:22:20.204179    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fbd46c_09d5_4120_8daf_993052160354.slice/crio-42dea3722bc33c96af8436ae61ac6e39fd7ccd636b97ef52d1d2f556bfb013b5 WatchSource:0}: Error finding container 42dea3722bc33c96af8436ae61ac6e39fd7ccd636b97ef52d1d2f556bfb013b5: Status 404 returned error can't find the container with id 42dea3722bc33c96af8436ae61ac6e39fd7ccd636b97ef52d1d2f556bfb013b5
Jul 10 18:22:20.433921 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:20.433887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57" event={"ID":"31fbd46c-09d5-4120-8daf-993052160354","Type":"ContainerStarted","Data":"42dea3722bc33c96af8436ae61ac6e39fd7ccd636b97ef52d1d2f556bfb013b5"}
Jul 10 18:22:26.463133 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:26.463094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57" event={"ID":"31fbd46c-09d5-4120-8daf-993052160354","Type":"ContainerStarted","Data":"bdcdb4f12aebdc09054eac01696638f134e79a681c8344afd93bac4d29bf0b00"}
Jul 10 18:22:27.468039 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:27.468008    2577 generic.go:356] "Generic (PLEG): container finished" podID="31fbd46c-09d5-4120-8daf-993052160354" containerID="bdcdb4f12aebdc09054eac01696638f134e79a681c8344afd93bac4d29bf0b00" exitCode=0
Jul 10 18:22:27.468039 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:27.468045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57" event={"ID":"31fbd46c-09d5-4120-8daf-993052160354","Type":"ContainerDied","Data":"bdcdb4f12aebdc09054eac01696638f134e79a681c8344afd93bac4d29bf0b00"}
Jul 10 18:22:27.469023 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:27.469007    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:22:29.478101 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:29.478064    2577 generic.go:356] "Generic (PLEG): container finished" podID="31fbd46c-09d5-4120-8daf-993052160354" containerID="4c5200d2c8adaceade7568bb66e975c1331aa8a79f6d47df579bb65ba0727d05" exitCode=0
Jul 10 18:22:29.478599 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:29.478122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57" event={"ID":"31fbd46c-09d5-4120-8daf-993052160354","Type":"ContainerDied","Data":"4c5200d2c8adaceade7568bb66e975c1331aa8a79f6d47df579bb65ba0727d05"}
Jul 10 18:22:37.515518 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:37.515484    2577 generic.go:356] "Generic (PLEG): container finished" podID="31fbd46c-09d5-4120-8daf-993052160354" containerID="09a5b04bdf79fe9c7906f6f1d0ee70c678f27f618a7942ca063899ebb403cd9d" exitCode=0
Jul 10 18:22:37.516008 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:37.515567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57" event={"ID":"31fbd46c-09d5-4120-8daf-993052160354","Type":"ContainerDied","Data":"09a5b04bdf79fe9c7906f6f1d0ee70c678f27f618a7942ca063899ebb403cd9d"}
Jul 10 18:22:38.661142 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.660461    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:38.712488 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.712441    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-bundle\") pod \"31fbd46c-09d5-4120-8daf-993052160354\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") "
Jul 10 18:22:38.712488 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.712492    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtd2b\" (UniqueName: \"kubernetes.io/projected/31fbd46c-09d5-4120-8daf-993052160354-kube-api-access-wtd2b\") pod \"31fbd46c-09d5-4120-8daf-993052160354\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") "
Jul 10 18:22:38.712740 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.712525    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-util\") pod \"31fbd46c-09d5-4120-8daf-993052160354\" (UID: \"31fbd46c-09d5-4120-8daf-993052160354\") "
Jul 10 18:22:38.713262 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.713216    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-bundle" (OuterVolumeSpecName: "bundle") pod "31fbd46c-09d5-4120-8daf-993052160354" (UID: "31fbd46c-09d5-4120-8daf-993052160354"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:22:38.715245 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.715202    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fbd46c-09d5-4120-8daf-993052160354-kube-api-access-wtd2b" (OuterVolumeSpecName: "kube-api-access-wtd2b") pod "31fbd46c-09d5-4120-8daf-993052160354" (UID: "31fbd46c-09d5-4120-8daf-993052160354"). InnerVolumeSpecName "kube-api-access-wtd2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:22:38.717611 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.717576    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-util" (OuterVolumeSpecName: "util") pod "31fbd46c-09d5-4120-8daf-993052160354" (UID: "31fbd46c-09d5-4120-8daf-993052160354"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:22:38.813153 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.813056    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-bundle\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:38.813153 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.813094    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtd2b\" (UniqueName: \"kubernetes.io/projected/31fbd46c-09d5-4120-8daf-993052160354-kube-api-access-wtd2b\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:38.813153 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:38.813105    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31fbd46c-09d5-4120-8daf-993052160354-util\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:22:39.526477 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:39.526434    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57" event={"ID":"31fbd46c-09d5-4120-8daf-993052160354","Type":"ContainerDied","Data":"42dea3722bc33c96af8436ae61ac6e39fd7ccd636b97ef52d1d2f556bfb013b5"}
Jul 10 18:22:39.526656 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:39.526493    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42dea3722bc33c96af8436ae61ac6e39fd7ccd636b97ef52d1d2f556bfb013b5"
Jul 10 18:22:39.526656 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:39.526452    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l4f57"
Jul 10 18:22:50.190675 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.190641    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"]
Jul 10 18:22:50.194217 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.191519    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fbd46c-09d5-4120-8daf-993052160354" containerName="util"
Jul 10 18:22:50.194217 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.191551    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fbd46c-09d5-4120-8daf-993052160354" containerName="util"
Jul 10 18:22:50.194217 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.191580    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fbd46c-09d5-4120-8daf-993052160354" containerName="extract"
Jul 10 18:22:50.194217 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.191590    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fbd46c-09d5-4120-8daf-993052160354" containerName="extract"
Jul 10 18:22:50.194217 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.191603    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fbd46c-09d5-4120-8daf-993052160354" containerName="pull"
Jul 10 18:22:50.194217 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.191613    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fbd46c-09d5-4120-8daf-993052160354" containerName="pull"
Jul 10 18:22:50.194217 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.191861    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31fbd46c-09d5-4120-8daf-993052160354" containerName="extract"
Jul 10 18:22:50.196962 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.195084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"
Jul 10 18:22:50.198284 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.198252    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 18:22:50.198923 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.198903    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fpg8c\""
Jul 10 18:22:50.199024 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.198905    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 18:22:50.204121 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.204075    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"]
Jul 10 18:22:50.299578 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.299540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvzqq\" (UniqueName: \"kubernetes.io/projected/bacf400a-3bd4-475c-8585-05a958fe631f-kube-api-access-kvzqq\") pod \"cert-manager-cainjector-559cdd8c87-b4k5g\" (UID: \"bacf400a-3bd4-475c-8585-05a958fe631f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"
Jul 10 18:22:50.299719 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.299595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bacf400a-3bd4-475c-8585-05a958fe631f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b4k5g\" (UID: \"bacf400a-3bd4-475c-8585-05a958fe631f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"
Jul 10 18:22:50.400829 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.400792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bacf400a-3bd4-475c-8585-05a958fe631f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b4k5g\" (UID: \"bacf400a-3bd4-475c-8585-05a958fe631f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"
Jul 10 18:22:50.401014 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.400855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvzqq\" (UniqueName: \"kubernetes.io/projected/bacf400a-3bd4-475c-8585-05a958fe631f-kube-api-access-kvzqq\") pod \"cert-manager-cainjector-559cdd8c87-b4k5g\" (UID: \"bacf400a-3bd4-475c-8585-05a958fe631f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"
Jul 10 18:22:50.409118 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.409086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bacf400a-3bd4-475c-8585-05a958fe631f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b4k5g\" (UID: \"bacf400a-3bd4-475c-8585-05a958fe631f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"
Jul 10 18:22:50.409464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.409445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvzqq\" (UniqueName: \"kubernetes.io/projected/bacf400a-3bd4-475c-8585-05a958fe631f-kube-api-access-kvzqq\") pod \"cert-manager-cainjector-559cdd8c87-b4k5g\" (UID: \"bacf400a-3bd4-475c-8585-05a958fe631f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"
Jul 10 18:22:50.513316 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.513198    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"
Jul 10 18:22:50.645750 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:50.645697    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g"]
Jul 10 18:22:50.648770 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:22:50.648739    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbacf400a_3bd4_475c_8585_05a958fe631f.slice/crio-03072b3afbc7a844c74822771970ff17c4a61dd100127fff88b3d2348331293f WatchSource:0}: Error finding container 03072b3afbc7a844c74822771970ff17c4a61dd100127fff88b3d2348331293f: Status 404 returned error can't find the container with id 03072b3afbc7a844c74822771970ff17c4a61dd100127fff88b3d2348331293f
Jul 10 18:22:51.574886 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:51.574847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g" event={"ID":"bacf400a-3bd4-475c-8585-05a958fe631f","Type":"ContainerStarted","Data":"03072b3afbc7a844c74822771970ff17c4a61dd100127fff88b3d2348331293f"}
Jul 10 18:22:53.584645 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:53.584611    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g" event={"ID":"bacf400a-3bd4-475c-8585-05a958fe631f","Type":"ContainerStarted","Data":"e850b90b4ca95fdc38eb4c5651f201863516bb84e44248e2429f97043d1e99c1"}
Jul 10 18:22:53.602562 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:53.602513    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b4k5g" podStartSLOduration=1.174742511 podStartE2EDuration="3.602497099s" totalImagesPullingTime="2.427754588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:22:53.601699664 +0000 UTC m=+334.274615485" watchObservedRunningTime="2026-07-10 18:22:53.602497099 +0000 UTC m=+334.275412897"
Jul 10 18:22:57.123838 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.123797    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-84dgh"]
Jul 10 18:22:57.126403 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.126379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-84dgh"
Jul 10 18:22:57.128654 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.128632    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7k5br\""
Jul 10 18:22:57.135834 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.135801    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-84dgh"]
Jul 10 18:22:57.256613 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.256572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7qtk\" (UniqueName: \"kubernetes.io/projected/01ee6f95-6914-4521-bb29-6c3df56c091d-kube-api-access-q7qtk\") pod \"cert-manager-55b4d954d5-84dgh\" (UID: \"01ee6f95-6914-4521-bb29-6c3df56c091d\") " pod="cert-manager/cert-manager-55b4d954d5-84dgh"
Jul 10 18:22:57.256613 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.256614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01ee6f95-6914-4521-bb29-6c3df56c091d-bound-sa-token\") pod \"cert-manager-55b4d954d5-84dgh\" (UID: \"01ee6f95-6914-4521-bb29-6c3df56c091d\") " pod="cert-manager/cert-manager-55b4d954d5-84dgh"
Jul 10 18:22:57.357509 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.357474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7qtk\" (UniqueName: \"kubernetes.io/projected/01ee6f95-6914-4521-bb29-6c3df56c091d-kube-api-access-q7qtk\") pod \"cert-manager-55b4d954d5-84dgh\" (UID: \"01ee6f95-6914-4521-bb29-6c3df56c091d\") " pod="cert-manager/cert-manager-55b4d954d5-84dgh"
Jul 10 18:22:57.357665 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.357521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01ee6f95-6914-4521-bb29-6c3df56c091d-bound-sa-token\") pod \"cert-manager-55b4d954d5-84dgh\" (UID: \"01ee6f95-6914-4521-bb29-6c3df56c091d\") " pod="cert-manager/cert-manager-55b4d954d5-84dgh"
Jul 10 18:22:57.366065 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.366033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7qtk\" (UniqueName: \"kubernetes.io/projected/01ee6f95-6914-4521-bb29-6c3df56c091d-kube-api-access-q7qtk\") pod \"cert-manager-55b4d954d5-84dgh\" (UID: \"01ee6f95-6914-4521-bb29-6c3df56c091d\") " pod="cert-manager/cert-manager-55b4d954d5-84dgh"
Jul 10 18:22:57.366193 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.366078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01ee6f95-6914-4521-bb29-6c3df56c091d-bound-sa-token\") pod \"cert-manager-55b4d954d5-84dgh\" (UID: \"01ee6f95-6914-4521-bb29-6c3df56c091d\") " pod="cert-manager/cert-manager-55b4d954d5-84dgh"
Jul 10 18:22:57.437402 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.437356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-84dgh"
Jul 10 18:22:57.569347 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.569144    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-84dgh"]
Jul 10 18:22:57.572109 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:22:57.572071    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01ee6f95_6914_4521_bb29_6c3df56c091d.slice/crio-4f633f18252ca3e55d09d4d39927b2d1bb600576af07c42c0866f7641c2f22c2 WatchSource:0}: Error finding container 4f633f18252ca3e55d09d4d39927b2d1bb600576af07c42c0866f7641c2f22c2: Status 404 returned error can't find the container with id 4f633f18252ca3e55d09d4d39927b2d1bb600576af07c42c0866f7641c2f22c2
Jul 10 18:22:57.601700 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:57.601668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-84dgh" event={"ID":"01ee6f95-6914-4521-bb29-6c3df56c091d","Type":"ContainerStarted","Data":"4f633f18252ca3e55d09d4d39927b2d1bb600576af07c42c0866f7641c2f22c2"}
Jul 10 18:22:58.606961 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:58.606929    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-84dgh" event={"ID":"01ee6f95-6914-4521-bb29-6c3df56c091d","Type":"ContainerStarted","Data":"6e9bc78b6c901b6cdd0b6cf22b36d96d9252fcd9985df24dc71b7b15ec1a67c4"}
Jul 10 18:22:58.626212 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:22:58.626153    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-84dgh" podStartSLOduration=1.626135064 podStartE2EDuration="1.626135064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:22:58.625061936 +0000 UTC m=+339.297977759" watchObservedRunningTime="2026-07-10 18:22:58.626135064 +0000 UTC m=+339.299050863"
Jul 10 18:23:17.503866 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.503783    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"]
Jul 10 18:23:17.506767 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.506748    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.509107 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.509086    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 18:23:17.510014 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.509991    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 18:23:17.510088 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.510042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-px9fh\""
Jul 10 18:23:17.515630 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.515605    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"]
Jul 10 18:23:17.621154 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.621097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.621154 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.621161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm9sq\" (UniqueName: \"kubernetes.io/projected/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-kube-api-access-bm9sq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.621443 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.621281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.722340 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.722303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.722527 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.722370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.722527 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.722405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm9sq\" (UniqueName: \"kubernetes.io/projected/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-kube-api-access-bm9sq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.722780 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.722756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.722840 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.722769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.730691 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.730663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm9sq\" (UniqueName: \"kubernetes.io/projected/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-kube-api-access-bm9sq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:17.817803 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:17.817697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:18.044041 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:18.043939    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"]
Jul 10 18:23:18.046665 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:23:18.046633    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5047cc26_58e7_4b9d_8c00_d91c302a5bcd.slice/crio-e9eadc3da33f7451fdc3385d9e52b1ae4fd6a4a97d6c8355d67bf141ec181e59 WatchSource:0}: Error finding container e9eadc3da33f7451fdc3385d9e52b1ae4fd6a4a97d6c8355d67bf141ec181e59: Status 404 returned error can't find the container with id e9eadc3da33f7451fdc3385d9e52b1ae4fd6a4a97d6c8355d67bf141ec181e59
Jul 10 18:23:18.692141 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:18.692105    2577 generic.go:356] "Generic (PLEG): container finished" podID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerID="77b1be43d0bc870e57a37708e50ec574a14afe15a5b1e58f47633d1daa99031c" exitCode=0
Jul 10 18:23:18.692545 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:18.692151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg" event={"ID":"5047cc26-58e7-4b9d-8c00-d91c302a5bcd","Type":"ContainerDied","Data":"77b1be43d0bc870e57a37708e50ec574a14afe15a5b1e58f47633d1daa99031c"}
Jul 10 18:23:18.692545 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:18.692195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg" event={"ID":"5047cc26-58e7-4b9d-8c00-d91c302a5bcd","Type":"ContainerStarted","Data":"e9eadc3da33f7451fdc3385d9e52b1ae4fd6a4a97d6c8355d67bf141ec181e59"}
Jul 10 18:23:19.697576 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:19.697540    2577 generic.go:356] "Generic (PLEG): container finished" podID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerID="ed20012375072a3d7031d80a1cc7b63430807954b5db45e6b35157eadee402a4" exitCode=0
Jul 10 18:23:19.697974 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:19.697623    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg" event={"ID":"5047cc26-58e7-4b9d-8c00-d91c302a5bcd","Type":"ContainerDied","Data":"ed20012375072a3d7031d80a1cc7b63430807954b5db45e6b35157eadee402a4"}
Jul 10 18:23:20.704184 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:20.704148    2577 generic.go:356] "Generic (PLEG): container finished" podID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerID="86e4854df39e87950ca781f5a047d4e555c2d09eb04ccf40ad00b5ec7fc409d5" exitCode=0
Jul 10 18:23:20.704591 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:20.704247    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg" event={"ID":"5047cc26-58e7-4b9d-8c00-d91c302a5bcd","Type":"ContainerDied","Data":"86e4854df39e87950ca781f5a047d4e555c2d09eb04ccf40ad00b5ec7fc409d5"}
Jul 10 18:23:21.836737 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:21.836705    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:21.963968 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:21.963861    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-util\") pod \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") "
Jul 10 18:23:21.963968 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:21.963949    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm9sq\" (UniqueName: \"kubernetes.io/projected/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-kube-api-access-bm9sq\") pod \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") "
Jul 10 18:23:21.964204 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:21.963997    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-bundle\") pod \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\" (UID: \"5047cc26-58e7-4b9d-8c00-d91c302a5bcd\") "
Jul 10 18:23:21.964900 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:21.964874    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-bundle" (OuterVolumeSpecName: "bundle") pod "5047cc26-58e7-4b9d-8c00-d91c302a5bcd" (UID: "5047cc26-58e7-4b9d-8c00-d91c302a5bcd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:23:21.966129 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:21.966101    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-kube-api-access-bm9sq" (OuterVolumeSpecName: "kube-api-access-bm9sq") pod "5047cc26-58e7-4b9d-8c00-d91c302a5bcd" (UID: "5047cc26-58e7-4b9d-8c00-d91c302a5bcd"). InnerVolumeSpecName "kube-api-access-bm9sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:23:21.969770 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:21.969750    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-util" (OuterVolumeSpecName: "util") pod "5047cc26-58e7-4b9d-8c00-d91c302a5bcd" (UID: "5047cc26-58e7-4b9d-8c00-d91c302a5bcd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:23:22.065391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:22.065349    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-util\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:23:22.065391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:22.065381    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm9sq\" (UniqueName: \"kubernetes.io/projected/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-kube-api-access-bm9sq\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:23:22.065391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:22.065392    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5047cc26-58e7-4b9d-8c00-d91c302a5bcd-bundle\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:23:22.714180 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:22.714152    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg"
Jul 10 18:23:22.714347 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:22.714184    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmptsg" event={"ID":"5047cc26-58e7-4b9d-8c00-d91c302a5bcd","Type":"ContainerDied","Data":"e9eadc3da33f7451fdc3385d9e52b1ae4fd6a4a97d6c8355d67bf141ec181e59"}
Jul 10 18:23:22.714347 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:22.714271    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9eadc3da33f7451fdc3385d9e52b1ae4fd6a4a97d6c8355d67bf141ec181e59"
Jul 10 18:23:28.093110 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.093074    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"]
Jul 10 18:23:28.093611 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.093382    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerName="util"
Jul 10 18:23:28.093611 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.093393    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerName="util"
Jul 10 18:23:28.093611 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.093412    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerName="pull"
Jul 10 18:23:28.093611 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.093417    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerName="pull"
Jul 10 18:23:28.093611 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.093431    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerName="extract"
Jul 10 18:23:28.093611 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.093438    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerName="extract"
Jul 10 18:23:28.093611 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.093488    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5047cc26-58e7-4b9d-8c00-d91c302a5bcd" containerName="extract"
Jul 10 18:23:28.096350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.096333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.099682 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.099654    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 18:23:28.099830 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.099654    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 18:23:28.100772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.100755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 18:23:28.100869 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.100854    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-95bfc\""
Jul 10 18:23:28.100974 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.100960    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 18:23:28.102280 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.102261    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:23:28.112877 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.112845    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"]
Jul 10 18:23:28.215751 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.215705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk8pt\" (UniqueName: \"kubernetes.io/projected/a7c797bd-0dbf-4010-aa0d-594df6bf933d-kube-api-access-lk8pt\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.215944 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.215854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7c797bd-0dbf-4010-aa0d-594df6bf933d-cert\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.215944 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.215898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7c797bd-0dbf-4010-aa0d-594df6bf933d-metrics-cert\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.215944 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.215941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7c797bd-0dbf-4010-aa0d-594df6bf933d-manager-config\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.317094 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.317049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7c797bd-0dbf-4010-aa0d-594df6bf933d-cert\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.317094 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.317090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7c797bd-0dbf-4010-aa0d-594df6bf933d-metrics-cert\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.317376 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.317113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7c797bd-0dbf-4010-aa0d-594df6bf933d-manager-config\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.317376 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.317165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk8pt\" (UniqueName: \"kubernetes.io/projected/a7c797bd-0dbf-4010-aa0d-594df6bf933d-kube-api-access-lk8pt\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.317941 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.317912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a7c797bd-0dbf-4010-aa0d-594df6bf933d-manager-config\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.319746 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.319724    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7c797bd-0dbf-4010-aa0d-594df6bf933d-metrics-cert\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.319832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.319755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7c797bd-0dbf-4010-aa0d-594df6bf933d-cert\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.326141 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.326111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk8pt\" (UniqueName: \"kubernetes.io/projected/a7c797bd-0dbf-4010-aa0d-594df6bf933d-kube-api-access-lk8pt\") pod \"lws-controller-manager-6cfc4d774-j54x9\" (UID: \"a7c797bd-0dbf-4010-aa0d-594df6bf933d\") " pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.406345 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.406248    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:28.549295 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.549260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"]
Jul 10 18:23:28.555087 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:23:28.555049    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c797bd_0dbf_4010_aa0d_594df6bf933d.slice/crio-33153aed9fdb11f613a508c1c38ebc9b8f994b1315f33026fbab1b03346fc480 WatchSource:0}: Error finding container 33153aed9fdb11f613a508c1c38ebc9b8f994b1315f33026fbab1b03346fc480: Status 404 returned error can't find the container with id 33153aed9fdb11f613a508c1c38ebc9b8f994b1315f33026fbab1b03346fc480
Jul 10 18:23:28.740377 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:28.740338    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9" event={"ID":"a7c797bd-0dbf-4010-aa0d-594df6bf933d","Type":"ContainerStarted","Data":"33153aed9fdb11f613a508c1c38ebc9b8f994b1315f33026fbab1b03346fc480"}
Jul 10 18:23:31.756267 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:31.756213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9" event={"ID":"a7c797bd-0dbf-4010-aa0d-594df6bf933d","Type":"ContainerStarted","Data":"003d66a8d32611b90845ad8622cf806de07d96ad0a2ca26068c99383dde15ea7"}
Jul 10 18:23:31.756671 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:31.756371    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:31.787345 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:31.787291    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9" podStartSLOduration=1.4254325460000001 podStartE2EDuration="3.787274072s" totalImagesPullingTime="2.361841526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:23:31.785616784 +0000 UTC m=+372.458532603" watchObservedRunningTime="2026-07-10 18:23:31.787274072 +0000 UTC m=+372.460189872"
Jul 10 18:23:34.652063 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.652022    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"]
Jul 10 18:23:34.655429 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.655412    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.658772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.658739    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 18:23:34.658772 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.658754    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 18:23:34.659067 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.658895    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 18:23:34.659067 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.659004    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 18:23:34.659187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.659148    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5dt62\""
Jul 10 18:23:34.679274 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.679235    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"]
Jul 10 18:23:34.770994 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.770948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63b96f7d-0bf5-4364-b6d8-449400e814b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.770994 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.770995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63b96f7d-0bf5-4364-b6d8-449400e814b1-tmp\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.771242 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.771127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63b96f7d-0bf5-4364-b6d8-449400e814b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.771242 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.771154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63b96f7d-0bf5-4364-b6d8-449400e814b1-manifests\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.771242 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.771174    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg85k\" (UniqueName: \"kubernetes.io/projected/63b96f7d-0bf5-4364-b6d8-449400e814b1-kube-api-access-lg85k\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.872391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.872341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63b96f7d-0bf5-4364-b6d8-449400e814b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.872391 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.872392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63b96f7d-0bf5-4364-b6d8-449400e814b1-manifests\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.872635 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.872449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg85k\" (UniqueName: \"kubernetes.io/projected/63b96f7d-0bf5-4364-b6d8-449400e814b1-kube-api-access-lg85k\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.872635 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.872505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63b96f7d-0bf5-4364-b6d8-449400e814b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.872635 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.872533    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63b96f7d-0bf5-4364-b6d8-449400e814b1-tmp\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.872797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.872764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63b96f7d-0bf5-4364-b6d8-449400e814b1-manifests\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.874674 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.874641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63b96f7d-0bf5-4364-b6d8-449400e814b1-tmp\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.875017 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.874994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63b96f7d-0bf5-4364-b6d8-449400e814b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.875017 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.875008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63b96f7d-0bf5-4364-b6d8-449400e814b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.887695 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.887664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg85k\" (UniqueName: \"kubernetes.io/projected/63b96f7d-0bf5-4364-b6d8-449400e814b1-kube-api-access-lg85k\") pod \"opendatahub-operator-controller-manager-6d75465dc8-th2w7\" (UID: \"63b96f7d-0bf5-4364-b6d8-449400e814b1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:34.966193 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:34.966153    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:35.109476 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:35.109344    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"]
Jul 10 18:23:35.112151 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:23:35.112124    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b96f7d_0bf5_4364_b6d8_449400e814b1.slice/crio-c5f99dbbcc8a31e2369683eebe962cf19b3df304ca2fc96952151038be03aa3d WatchSource:0}: Error finding container c5f99dbbcc8a31e2369683eebe962cf19b3df304ca2fc96952151038be03aa3d: Status 404 returned error can't find the container with id c5f99dbbcc8a31e2369683eebe962cf19b3df304ca2fc96952151038be03aa3d
Jul 10 18:23:35.775426 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:35.775386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7" event={"ID":"63b96f7d-0bf5-4364-b6d8-449400e814b1","Type":"ContainerStarted","Data":"c5f99dbbcc8a31e2369683eebe962cf19b3df304ca2fc96952151038be03aa3d"}
Jul 10 18:23:38.792684 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:38.792647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7" event={"ID":"63b96f7d-0bf5-4364-b6d8-449400e814b1","Type":"ContainerStarted","Data":"3ea210e340d014b2b2bc9c6dab9de26b8493eee5aaa5b64d9f6553838690afdf"}
Jul 10 18:23:39.799287 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:39.799183    2577 generic.go:356] "Generic (PLEG): container finished" podID="63b96f7d-0bf5-4364-b6d8-449400e814b1" containerID="3ea210e340d014b2b2bc9c6dab9de26b8493eee5aaa5b64d9f6553838690afdf" exitCode=0
Jul 10 18:23:39.799287 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:39.799262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7" event={"ID":"63b96f7d-0bf5-4364-b6d8-449400e814b1","Type":"ContainerDied","Data":"3ea210e340d014b2b2bc9c6dab9de26b8493eee5aaa5b64d9f6553838690afdf"}
Jul 10 18:23:40.806017 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:40.805982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7" event={"ID":"63b96f7d-0bf5-4364-b6d8-449400e814b1","Type":"ContainerStarted","Data":"4e0feb55d06ffaf9bcd3dbe89719c74de72ab5d4a4870caf39ab5f774240d69e"}
Jul 10 18:23:40.806456 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:40.806077    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:23:40.829990 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:40.829929    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7" podStartSLOduration=2.147175048 podStartE2EDuration="6.829909131s" totalImagesPullingTime="3.517940528s" totalInitContainerRuntime="1.164793555s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:23:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:23:40.82776043 +0000 UTC m=+381.500676227" watchObservedRunningTime="2026-07-10 18:23:40.829909131 +0000 UTC m=+381.502824930"
Jul 10 18:23:42.762820 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:42.762783    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6cfc4d774-j54x9"
Jul 10 18:23:51.813089 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:23:51.813060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d75465dc8-th2w7"
Jul 10 18:24:02.171047 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.171011    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"]
Jul 10 18:24:02.183046 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.183018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.185842 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.185808    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 18:24:02.185842 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.185825    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 18:24:02.186058 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.185891    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 18:24:02.186058 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.185908    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 18:24:02.186185 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.186168    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 18:24:02.186268 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.186258    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 18:24:02.186328 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.186292    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mfql5\""
Jul 10 18:24:02.186328 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.186310    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"]
Jul 10 18:24:02.307197 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.307143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.307426 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.307295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t85vb\" (UniqueName: \"kubernetes.io/projected/ea72ff24-5b5e-44fd-8370-f9f99cc71852-kube-api-access-t85vb\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.307426 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.307337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.307426 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.307366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.307426 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.307421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.307647 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.307509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea72ff24-5b5e-44fd-8370-f9f99cc71852-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.307647 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.307532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.408736 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.408699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t85vb\" (UniqueName: \"kubernetes.io/projected/ea72ff24-5b5e-44fd-8370-f9f99cc71852-kube-api-access-t85vb\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.408736 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.408735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.408960 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.408755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.408960 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.408781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.408960 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.408808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea72ff24-5b5e-44fd-8370-f9f99cc71852-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.408960 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.408824    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.408960 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.408863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.409693 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.409663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.411205 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.411178    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea72ff24-5b5e-44fd-8370-f9f99cc71852-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.411205 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.411188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.411404 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.411177    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.411404 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.411263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.417353 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.417329    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea72ff24-5b5e-44fd-8370-f9f99cc71852-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.417710 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.417692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t85vb\" (UniqueName: \"kubernetes.io/projected/ea72ff24-5b5e-44fd-8370-f9f99cc71852-kube-api-access-t85vb\") pod \"istiod-openshift-gateway-94bb8fbfd-5pt7x\" (UID: \"ea72ff24-5b5e-44fd-8370-f9f99cc71852\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.493449 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.493365    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:02.663401 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.663366    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"]
Jul 10 18:24:02.666630 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:24:02.666577    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea72ff24_5b5e_44fd_8370_f9f99cc71852.slice/crio-5ddc5d3f8df5a0da501aa42000a3cba012ba40f805dc0cd1d8caf7ad50e9a7db WatchSource:0}: Error finding container 5ddc5d3f8df5a0da501aa42000a3cba012ba40f805dc0cd1d8caf7ad50e9a7db: Status 404 returned error can't find the container with id 5ddc5d3f8df5a0da501aa42000a3cba012ba40f805dc0cd1d8caf7ad50e9a7db
Jul 10 18:24:02.907594 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:02.907505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x" event={"ID":"ea72ff24-5b5e-44fd-8370-f9f99cc71852","Type":"ContainerStarted","Data":"5ddc5d3f8df5a0da501aa42000a3cba012ba40f805dc0cd1d8caf7ad50e9a7db"}
Jul 10 18:24:04.819398 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:04.819355    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:24:04.819670 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:04.819433    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 18:24:04.919456 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:04.919422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x" event={"ID":"ea72ff24-5b5e-44fd-8370-f9f99cc71852","Type":"ContainerStarted","Data":"652a617874abfb436b99ff09be37ed2edc5a7756f694146b2307885c57ceb91c"}
Jul 10 18:24:04.919637 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:04.919543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:24:04.958597 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:04.958544    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x" podStartSLOduration=0.808166756 podStartE2EDuration="2.958525557s" totalImagesPullingTime="2.150358801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:24:04.956490023 +0000 UTC m=+405.629405840" watchObservedRunningTime="2026-07-10 18:24:04.958525557 +0000 UTC m=+405.631441356"
Jul 10 18:24:05.925928 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:05.925896    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-5pt7x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 18:24:05.926325 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:05.925944    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x" podUID="ea72ff24-5b5e-44fd-8370-f9f99cc71852" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 18:24:08.925268 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:24:08.925212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pt7x"
Jul 10 18:25:12.006159 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.006117    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78f5bc747d-b7xbj"]
Jul 10 18:25:12.008909 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.008889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.023775 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.023740    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f5bc747d-b7xbj"]
Jul 10 18:25:12.121340 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.121301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-service-ca\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.121517 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.121347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6865t\" (UniqueName: \"kubernetes.io/projected/c48c1265-accb-470c-b9a7-030086ee1988-kube-api-access-6865t\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.121517 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.121406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-trusted-ca-bundle\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.121517 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.121435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-console-config\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.121517 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.121502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48c1265-accb-470c-b9a7-030086ee1988-console-serving-cert\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.121666 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.121549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48c1265-accb-470c-b9a7-030086ee1988-console-oauth-config\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.121666 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.121601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-oauth-serving-cert\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.222625 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.222584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-oauth-serving-cert\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.222832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.222639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-service-ca\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.222832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.222686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6865t\" (UniqueName: \"kubernetes.io/projected/c48c1265-accb-470c-b9a7-030086ee1988-kube-api-access-6865t\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.222832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.222735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-trusted-ca-bundle\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.222832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.222775    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-console-config\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.222832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.222800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48c1265-accb-470c-b9a7-030086ee1988-console-serving-cert\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.222832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.222822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48c1265-accb-470c-b9a7-030086ee1988-console-oauth-config\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.223485 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.223457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-service-ca\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.223616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.223592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-console-config\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.223681 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.223628    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-trusted-ca-bundle\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.223681 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.223640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48c1265-accb-470c-b9a7-030086ee1988-oauth-serving-cert\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.225262 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.225235    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48c1265-accb-470c-b9a7-030086ee1988-console-oauth-config\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.225415 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.225398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48c1265-accb-470c-b9a7-030086ee1988-console-serving-cert\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.232364 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.232339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6865t\" (UniqueName: \"kubernetes.io/projected/c48c1265-accb-470c-b9a7-030086ee1988-kube-api-access-6865t\") pod \"console-78f5bc747d-b7xbj\" (UID: \"c48c1265-accb-470c-b9a7-030086ee1988\") " pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.319090 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.318992    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:12.464657 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:12.464623    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f5bc747d-b7xbj"]
Jul 10 18:25:12.468023 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:25:12.467997    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48c1265_accb_470c_b9a7_030086ee1988.slice/crio-74b325958733b4836282c2ec113a5fc416d945f5c762413313c7a08d2a14032d WatchSource:0}: Error finding container 74b325958733b4836282c2ec113a5fc416d945f5c762413313c7a08d2a14032d: Status 404 returned error can't find the container with id 74b325958733b4836282c2ec113a5fc416d945f5c762413313c7a08d2a14032d
Jul 10 18:25:13.228248 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:13.228192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f5bc747d-b7xbj" event={"ID":"c48c1265-accb-470c-b9a7-030086ee1988","Type":"ContainerStarted","Data":"5f863a6ea02becc39401bb984faf91ea4dde5552bd2bcc90806eca8eae422da2"}
Jul 10 18:25:13.228636 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:13.228302    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f5bc747d-b7xbj" event={"ID":"c48c1265-accb-470c-b9a7-030086ee1988","Type":"ContainerStarted","Data":"74b325958733b4836282c2ec113a5fc416d945f5c762413313c7a08d2a14032d"}
Jul 10 18:25:13.249519 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:13.249460    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78f5bc747d-b7xbj" podStartSLOduration=2.249442745 podStartE2EDuration="2.249442745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:25:13.248874199 +0000 UTC m=+473.921789997" watchObservedRunningTime="2026-07-10 18:25:13.249442745 +0000 UTC m=+473.922358543"
Jul 10 18:25:22.319136 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:22.319087    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:22.319605 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:22.319188    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:22.324192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:22.324164    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:23.278444 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:23.278410    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78f5bc747d-b7xbj"
Jul 10 18:25:23.325713 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:23.325677    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fd854b49c-qgk59"]
Jul 10 18:25:48.347103 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.347060    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fd854b49c-qgk59" podUID="37b06992-6bcf-40da-a2eb-0b5d5336233c" containerName="console" containerID="cri-o://a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64" gracePeriod=15
Jul 10 18:25:48.599965 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.599895    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:25:48.701333 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701297    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9x6x\" (UniqueName: \"kubernetes.io/projected/37b06992-6bcf-40da-a2eb-0b5d5336233c-kube-api-access-p9x6x\") pod \"37b06992-6bcf-40da-a2eb-0b5d5336233c\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") "
Jul 10 18:25:48.701333 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701336    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-oauth-config\") pod \"37b06992-6bcf-40da-a2eb-0b5d5336233c\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") "
Jul 10 18:25:48.701596 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701385    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-serving-cert\") pod \"37b06992-6bcf-40da-a2eb-0b5d5336233c\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") "
Jul 10 18:25:48.701596 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701433    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-oauth-serving-cert\") pod \"37b06992-6bcf-40da-a2eb-0b5d5336233c\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") "
Jul 10 18:25:48.701596 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701451    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-config\") pod \"37b06992-6bcf-40da-a2eb-0b5d5336233c\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") "
Jul 10 18:25:48.701596 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701471    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-service-ca\") pod \"37b06992-6bcf-40da-a2eb-0b5d5336233c\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") "
Jul 10 18:25:48.701596 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701486    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-trusted-ca-bundle\") pod \"37b06992-6bcf-40da-a2eb-0b5d5336233c\" (UID: \"37b06992-6bcf-40da-a2eb-0b5d5336233c\") "
Jul 10 18:25:48.701955 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701922    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-service-ca" (OuterVolumeSpecName: "service-ca") pod "37b06992-6bcf-40da-a2eb-0b5d5336233c" (UID: "37b06992-6bcf-40da-a2eb-0b5d5336233c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:25:48.702026 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701958    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37b06992-6bcf-40da-a2eb-0b5d5336233c" (UID: "37b06992-6bcf-40da-a2eb-0b5d5336233c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:25:48.702026 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.701967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-config" (OuterVolumeSpecName: "console-config") pod "37b06992-6bcf-40da-a2eb-0b5d5336233c" (UID: "37b06992-6bcf-40da-a2eb-0b5d5336233c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:25:48.702135 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.702041    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37b06992-6bcf-40da-a2eb-0b5d5336233c" (UID: "37b06992-6bcf-40da-a2eb-0b5d5336233c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:25:48.703698 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.703670    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37b06992-6bcf-40da-a2eb-0b5d5336233c-kube-api-access-p9x6x" (OuterVolumeSpecName: "kube-api-access-p9x6x") pod "37b06992-6bcf-40da-a2eb-0b5d5336233c" (UID: "37b06992-6bcf-40da-a2eb-0b5d5336233c"). InnerVolumeSpecName "kube-api-access-p9x6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:25:48.703813 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.703717    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37b06992-6bcf-40da-a2eb-0b5d5336233c" (UID: "37b06992-6bcf-40da-a2eb-0b5d5336233c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:25:48.703813 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.703742    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37b06992-6bcf-40da-a2eb-0b5d5336233c" (UID: "37b06992-6bcf-40da-a2eb-0b5d5336233c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:25:48.802441 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.802402    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-oauth-serving-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:25:48.802441 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.802434    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-config\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:25:48.802441 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.802443    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:25:48.802441 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.802451    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37b06992-6bcf-40da-a2eb-0b5d5336233c-trusted-ca-bundle\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:25:48.802707 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.802460    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9x6x\" (UniqueName: \"kubernetes.io/projected/37b06992-6bcf-40da-a2eb-0b5d5336233c-kube-api-access-p9x6x\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:25:48.802707 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.802468    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-oauth-config\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:25:48.802707 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:48.802476    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37b06992-6bcf-40da-a2eb-0b5d5336233c-console-serving-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:25:49.401088 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.401055    2577 generic.go:356] "Generic (PLEG): container finished" podID="37b06992-6bcf-40da-a2eb-0b5d5336233c" containerID="a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64" exitCode=0
Jul 10 18:25:49.401581 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.401099    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd854b49c-qgk59"
Jul 10 18:25:49.401581 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.401123    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd854b49c-qgk59" event={"ID":"37b06992-6bcf-40da-a2eb-0b5d5336233c","Type":"ContainerDied","Data":"a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64"}
Jul 10 18:25:49.401581 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.401175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd854b49c-qgk59" event={"ID":"37b06992-6bcf-40da-a2eb-0b5d5336233c","Type":"ContainerDied","Data":"dc28e564c714cdd1631c27c3c58657e484074a319475917bbcca72a6ce600ab4"}
Jul 10 18:25:49.401581 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.401205    2577 scope.go:117] "RemoveContainer" containerID="a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64"
Jul 10 18:25:49.410601 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.410582    2577 scope.go:117] "RemoveContainer" containerID="a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64"
Jul 10 18:25:49.410910 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:25:49.410890    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64\": container with ID starting with a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64 not found: ID does not exist" containerID="a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64"
Jul 10 18:25:49.410973 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.410923    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64"} err="failed to get container status \"a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64\": rpc error: code = NotFound desc = could not find container \"a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64\": container with ID starting with a45b878f7cb5270e5a9dc18be36980731d1a5ef188166bb40ff9c877c7959a64 not found: ID does not exist"
Jul 10 18:25:49.422962 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.422931    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fd854b49c-qgk59"]
Jul 10 18:25:49.426973 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:49.426949    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fd854b49c-qgk59"]
Jul 10 18:25:50.132492 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:25:50.132457    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37b06992-6bcf-40da-a2eb-0b5d5336233c" path="/var/lib/kubelet/pods/37b06992-6bcf-40da-a2eb-0b5d5336233c/volumes"
Jul 10 18:26:01.947014 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.946973    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"]
Jul 10 18:26:01.947479 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.947294    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37b06992-6bcf-40da-a2eb-0b5d5336233c" containerName="console"
Jul 10 18:26:01.947479 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.947305    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="37b06992-6bcf-40da-a2eb-0b5d5336233c" containerName="console"
Jul 10 18:26:01.947479 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.947371    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="37b06992-6bcf-40da-a2eb-0b5d5336233c" containerName="console"
Jul 10 18:26:01.950420 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.950403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:01.952921 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.952900    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 18:26:01.953052 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.952903    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 18:26:01.953052 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.953002    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-47r9g\""
Jul 10 18:26:01.961648 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:01.961626    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"]
Jul 10 18:26:02.016043 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.016000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srfk9\" (UniqueName: \"kubernetes.io/projected/95907de0-1745-4f8c-84d5-49c78c55ceb1-kube-api-access-srfk9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" (UID: \"95907de0-1745-4f8c-84d5-49c78c55ceb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:02.016269 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.016067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95907de0-1745-4f8c-84d5-49c78c55ceb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" (UID: \"95907de0-1745-4f8c-84d5-49c78c55ceb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:02.117378 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.117333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95907de0-1745-4f8c-84d5-49c78c55ceb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" (UID: \"95907de0-1745-4f8c-84d5-49c78c55ceb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:02.117578 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.117421    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srfk9\" (UniqueName: \"kubernetes.io/projected/95907de0-1745-4f8c-84d5-49c78c55ceb1-kube-api-access-srfk9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" (UID: \"95907de0-1745-4f8c-84d5-49c78c55ceb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:02.117759 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.117739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95907de0-1745-4f8c-84d5-49c78c55ceb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" (UID: \"95907de0-1745-4f8c-84d5-49c78c55ceb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:02.131669 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.131640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srfk9\" (UniqueName: \"kubernetes.io/projected/95907de0-1745-4f8c-84d5-49c78c55ceb1-kube-api-access-srfk9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" (UID: \"95907de0-1745-4f8c-84d5-49c78c55ceb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:02.261141 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.261044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:02.403173 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.403109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"]
Jul 10 18:26:02.405789 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:26:02.405758    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95907de0_1745_4f8c_84d5_49c78c55ceb1.slice/crio-469fe4e4dc9404da7d2b4b6871039bc0c69678a9a5f8f5297ca326a24717195e WatchSource:0}: Error finding container 469fe4e4dc9404da7d2b4b6871039bc0c69678a9a5f8f5297ca326a24717195e: Status 404 returned error can't find the container with id 469fe4e4dc9404da7d2b4b6871039bc0c69678a9a5f8f5297ca326a24717195e
Jul 10 18:26:02.462929 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.462895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz" event={"ID":"95907de0-1745-4f8c-84d5-49c78c55ceb1","Type":"ContainerStarted","Data":"469fe4e4dc9404da7d2b4b6871039bc0c69678a9a5f8f5297ca326a24717195e"}
Jul 10 18:26:02.634416 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.634325    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"]
Jul 10 18:26:02.641938 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.641910    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"]
Jul 10 18:26:02.668427 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.668368    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"]
Jul 10 18:26:02.678041 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.678007    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:02.691928 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.691898    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"]
Jul 10 18:26:02.722273 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.722204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfq7t\" (UniqueName: \"kubernetes.io/projected/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-kube-api-access-rfq7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccv6l\" (UID: \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:02.722273 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.722269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccv6l\" (UID: \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:02.823409 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.823364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfq7t\" (UniqueName: \"kubernetes.io/projected/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-kube-api-access-rfq7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccv6l\" (UID: \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:02.823409 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.823407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccv6l\" (UID: \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:02.823771 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.823755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccv6l\" (UID: \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:02.832253 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.832199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfq7t\" (UniqueName: \"kubernetes.io/projected/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-kube-api-access-rfq7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccv6l\" (UID: \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:02.990664 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:02.990633    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:03.145162 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:03.145133    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"]
Jul 10 18:26:03.155818 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:26:03.155787    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3033fcd4_5bea_49b6_af0e_8c22fa0377f1.slice/crio-c45939b80545e5079d0be660f29085beab0207b0de9c25b6f5bbc017f4f951b6 WatchSource:0}: Error finding container c45939b80545e5079d0be660f29085beab0207b0de9c25b6f5bbc017f4f951b6: Status 404 returned error can't find the container with id c45939b80545e5079d0be660f29085beab0207b0de9c25b6f5bbc017f4f951b6
Jul 10 18:26:03.471081 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:03.471026    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l" event={"ID":"3033fcd4-5bea-49b6-af0e-8c22fa0377f1","Type":"ContainerStarted","Data":"c45939b80545e5079d0be660f29085beab0207b0de9c25b6f5bbc017f4f951b6"}
Jul 10 18:26:07.494114 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.494052    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz" podUID="95907de0-1745-4f8c-84d5-49c78c55ceb1" containerName="manager" containerID="cri-o://7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a" gracePeriod=2
Jul 10 18:26:07.495695 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.495665    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l" event={"ID":"3033fcd4-5bea-49b6-af0e-8c22fa0377f1","Type":"ContainerStarted","Data":"b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006"}
Jul 10 18:26:07.496028 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.495797    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:07.521022 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.520371    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l" podStartSLOduration=1.368844582 podStartE2EDuration="5.520348744s" totalImagesPullingTime="4.151504162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:07.517873538 +0000 UTC m=+528.190789336" watchObservedRunningTime="2026-07-10 18:26:07.520348744 +0000 UTC m=+528.193264545"
Jul 10 18:26:07.738399 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.738367    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:07.740567 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:26:07.740530    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" is forbidden: User \"system:node:ip-10-0-141-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-167.ec2.internal' and this object" podUID="95907de0-1745-4f8c-84d5-49c78c55ceb1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:07.873612 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.873513    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srfk9\" (UniqueName: \"kubernetes.io/projected/95907de0-1745-4f8c-84d5-49c78c55ceb1-kube-api-access-srfk9\") pod \"95907de0-1745-4f8c-84d5-49c78c55ceb1\" (UID: \"95907de0-1745-4f8c-84d5-49c78c55ceb1\") "
Jul 10 18:26:07.873612 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.873614    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95907de0-1745-4f8c-84d5-49c78c55ceb1-extensions-socket-volume\") pod \"95907de0-1745-4f8c-84d5-49c78c55ceb1\" (UID: \"95907de0-1745-4f8c-84d5-49c78c55ceb1\") "
Jul 10 18:26:07.873936 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.873906    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95907de0-1745-4f8c-84d5-49c78c55ceb1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "95907de0-1745-4f8c-84d5-49c78c55ceb1" (UID: "95907de0-1745-4f8c-84d5-49c78c55ceb1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:26:07.875769 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.875749    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95907de0-1745-4f8c-84d5-49c78c55ceb1-kube-api-access-srfk9" (OuterVolumeSpecName: "kube-api-access-srfk9") pod "95907de0-1745-4f8c-84d5-49c78c55ceb1" (UID: "95907de0-1745-4f8c-84d5-49c78c55ceb1"). InnerVolumeSpecName "kube-api-access-srfk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:26:07.975193 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.975151    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95907de0-1745-4f8c-84d5-49c78c55ceb1-extensions-socket-volume\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:26:07.975193 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:07.975184    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srfk9\" (UniqueName: \"kubernetes.io/projected/95907de0-1745-4f8c-84d5-49c78c55ceb1-kube-api-access-srfk9\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:26:08.133279 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:08.133187    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95907de0-1745-4f8c-84d5-49c78c55ceb1" path="/var/lib/kubelet/pods/95907de0-1745-4f8c-84d5-49c78c55ceb1/volumes"
Jul 10 18:26:08.501204 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:08.501171    2577 generic.go:356] "Generic (PLEG): container finished" podID="95907de0-1745-4f8c-84d5-49c78c55ceb1" containerID="7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a" exitCode=2
Jul 10 18:26:08.501719 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:08.501215    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:08.501719 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:08.501280    2577 scope.go:117] "RemoveContainer" containerID="7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a"
Jul 10 18:26:08.505932 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:26:08.505886    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" is forbidden: User \"system:node:ip-10-0-141-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-167.ec2.internal' and this object" podUID="95907de0-1745-4f8c-84d5-49c78c55ceb1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:08.510596 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:08.510576    2577 scope.go:117] "RemoveContainer" containerID="7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a"
Jul 10 18:26:08.510922 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:26:08.510903    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a\": container with ID starting with 7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a not found: ID does not exist" containerID="7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a"
Jul 10 18:26:08.510967 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:08.510935    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a"} err="failed to get container status \"7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a\": rpc error: code = NotFound desc = could not find container \"7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a\": container with ID starting with 7c1b48d779293f7b12a34b0d9ad104de681e92297119ffc9e4e1d4135433a84a not found: ID does not exist"
Jul 10 18:26:10.131928 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:26:10.131877    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vrnzz\" is forbidden: User \"system:node:ip-10-0-141-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-167.ec2.internal' and this object" podUID="95907de0-1745-4f8c-84d5-49c78c55ceb1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vrnzz"
Jul 10 18:26:18.504451 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:18.504415    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:32.141587 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.141554    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"]
Jul 10 18:26:32.142092 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.141805    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l" podUID="3033fcd4-5bea-49b6-af0e-8c22fa0377f1" containerName="manager" containerID="cri-o://b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006" gracePeriod=10
Jul 10 18:26:32.390253 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.390210    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:32.391712 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.391655    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfq7t\" (UniqueName: \"kubernetes.io/projected/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-kube-api-access-rfq7t\") pod \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\" (UID: \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\") "
Jul 10 18:26:32.391839 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.391714    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-extensions-socket-volume\") pod \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\" (UID: \"3033fcd4-5bea-49b6-af0e-8c22fa0377f1\") "
Jul 10 18:26:32.392120 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.392096    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3033fcd4-5bea-49b6-af0e-8c22fa0377f1" (UID: "3033fcd4-5bea-49b6-af0e-8c22fa0377f1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:26:32.393819 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.393792    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-kube-api-access-rfq7t" (OuterVolumeSpecName: "kube-api-access-rfq7t") pod "3033fcd4-5bea-49b6-af0e-8c22fa0377f1" (UID: "3033fcd4-5bea-49b6-af0e-8c22fa0377f1"). InnerVolumeSpecName "kube-api-access-rfq7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:26:32.492679 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.492644    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfq7t\" (UniqueName: \"kubernetes.io/projected/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-kube-api-access-rfq7t\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:26:32.492679 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.492673    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3033fcd4-5bea-49b6-af0e-8c22fa0377f1-extensions-socket-volume\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:26:32.614435 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.614400    2577 generic.go:356] "Generic (PLEG): container finished" podID="3033fcd4-5bea-49b6-af0e-8c22fa0377f1" containerID="b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006" exitCode=0
Jul 10 18:26:32.614435 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.614437    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"
Jul 10 18:26:32.614632 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.614474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l" event={"ID":"3033fcd4-5bea-49b6-af0e-8c22fa0377f1","Type":"ContainerDied","Data":"b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006"}
Jul 10 18:26:32.614632 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.614524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l" event={"ID":"3033fcd4-5bea-49b6-af0e-8c22fa0377f1","Type":"ContainerDied","Data":"c45939b80545e5079d0be660f29085beab0207b0de9c25b6f5bbc017f4f951b6"}
Jul 10 18:26:32.614632 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.614547    2577 scope.go:117] "RemoveContainer" containerID="b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006"
Jul 10 18:26:32.624067 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.624049    2577 scope.go:117] "RemoveContainer" containerID="b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006"
Jul 10 18:26:32.624423 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:26:32.624401    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006\": container with ID starting with b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006 not found: ID does not exist" containerID="b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006"
Jul 10 18:26:32.624500 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.624436    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006"} err="failed to get container status \"b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006\": rpc error: code = NotFound desc = could not find container \"b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006\": container with ID starting with b74ccff100dc96915ea14a34d930a82c63f66df567b26b3b70cb38ad8ff67006 not found: ID does not exist"
Jul 10 18:26:32.636765 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.636731    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"]
Jul 10 18:26:32.642988 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:32.642917    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccv6l"]
Jul 10 18:26:34.131953 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:34.131907    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3033fcd4-5bea-49b6-af0e-8c22fa0377f1" path="/var/lib/kubelet/pods/3033fcd4-5bea-49b6-af0e-8c22fa0377f1/volumes"
Jul 10 18:26:53.007942 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.007893    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-knm2p"]
Jul 10 18:26:53.008540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.008380    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95907de0-1745-4f8c-84d5-49c78c55ceb1" containerName="manager"
Jul 10 18:26:53.008540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.008398    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="95907de0-1745-4f8c-84d5-49c78c55ceb1" containerName="manager"
Jul 10 18:26:53.008540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.008430    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3033fcd4-5bea-49b6-af0e-8c22fa0377f1" containerName="manager"
Jul 10 18:26:53.008540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.008439    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3033fcd4-5bea-49b6-af0e-8c22fa0377f1" containerName="manager"
Jul 10 18:26:53.008540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.008519    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="95907de0-1745-4f8c-84d5-49c78c55ceb1" containerName="manager"
Jul 10 18:26:53.008540 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.008533    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3033fcd4-5bea-49b6-af0e-8c22fa0377f1" containerName="manager"
Jul 10 18:26:53.011761 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.011736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:53.014565 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.014537    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 18:26:53.014698 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.014574    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 18:26:53.014698 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.014574    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c6frz\""
Jul 10 18:26:53.015486 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.015463    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 18:26:53.023483 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.023455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-knm2p"]
Jul 10 18:26:53.054758 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.054716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6297f\" (UniqueName: \"kubernetes.io/projected/e2eec1ac-bc56-4089-b718-ab078a820751-kube-api-access-6297f\") pod \"limitador-limitador-64c94fd64f-knm2p\" (UID: \"e2eec1ac-bc56-4089-b718-ab078a820751\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:53.054954 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.054772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2eec1ac-bc56-4089-b718-ab078a820751-config-file\") pod \"limitador-limitador-64c94fd64f-knm2p\" (UID: \"e2eec1ac-bc56-4089-b718-ab078a820751\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:53.098152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.098111    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-knm2p"]
Jul 10 18:26:53.156354 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.156320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6297f\" (UniqueName: \"kubernetes.io/projected/e2eec1ac-bc56-4089-b718-ab078a820751-kube-api-access-6297f\") pod \"limitador-limitador-64c94fd64f-knm2p\" (UID: \"e2eec1ac-bc56-4089-b718-ab078a820751\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:53.156572 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.156389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2eec1ac-bc56-4089-b718-ab078a820751-config-file\") pod \"limitador-limitador-64c94fd64f-knm2p\" (UID: \"e2eec1ac-bc56-4089-b718-ab078a820751\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:53.156975 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.156954    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2eec1ac-bc56-4089-b718-ab078a820751-config-file\") pod \"limitador-limitador-64c94fd64f-knm2p\" (UID: \"e2eec1ac-bc56-4089-b718-ab078a820751\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:53.165155 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.165124    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6297f\" (UniqueName: \"kubernetes.io/projected/e2eec1ac-bc56-4089-b718-ab078a820751-kube-api-access-6297f\") pod \"limitador-limitador-64c94fd64f-knm2p\" (UID: \"e2eec1ac-bc56-4089-b718-ab078a820751\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:53.324934 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.324844    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:53.458907 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.458880    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-knm2p"]
Jul 10 18:26:53.461393 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:26:53.461367    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2eec1ac_bc56_4089_b718_ab078a820751.slice/crio-d0995c57c793478696ec7ddaa7214d46c352ff52254536ca7ac7c13d04ed3f13 WatchSource:0}: Error finding container d0995c57c793478696ec7ddaa7214d46c352ff52254536ca7ac7c13d04ed3f13: Status 404 returned error can't find the container with id d0995c57c793478696ec7ddaa7214d46c352ff52254536ca7ac7c13d04ed3f13
Jul 10 18:26:53.717544 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:53.717496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p" event={"ID":"e2eec1ac-bc56-4089-b718-ab078a820751","Type":"ContainerStarted","Data":"d0995c57c793478696ec7ddaa7214d46c352ff52254536ca7ac7c13d04ed3f13"}
Jul 10 18:26:56.735176 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:56.735067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p" event={"ID":"e2eec1ac-bc56-4089-b718-ab078a820751","Type":"ContainerStarted","Data":"bfab270b9543eb2e757f040356170a5e9a3f95d7d3fd1c37cf44572c8bebfb12"}
Jul 10 18:26:56.735579 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:56.735193    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:26:56.752545 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:26:56.752485    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p" podStartSLOduration=1.7914534610000001 podStartE2EDuration="4.752468351s" totalImagesPullingTime="2.96101489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:56.750832906 +0000 UTC m=+577.423748736" watchObservedRunningTime="2026-07-10 18:26:56.752468351 +0000 UTC m=+577.425384150"
Jul 10 18:27:07.741886 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:07.741854    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:27:08.123706 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:08.123618    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-knm2p"]
Jul 10 18:27:08.123866 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:08.123817    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p" podUID="e2eec1ac-bc56-4089-b718-ab078a820751" containerName="limitador" containerID="cri-o://bfab270b9543eb2e757f040356170a5e9a3f95d7d3fd1c37cf44572c8bebfb12" gracePeriod=30
Jul 10 18:27:08.792481 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:08.792391    2577 generic.go:356] "Generic (PLEG): container finished" podID="e2eec1ac-bc56-4089-b718-ab078a820751" containerID="bfab270b9543eb2e757f040356170a5e9a3f95d7d3fd1c37cf44572c8bebfb12" exitCode=0
Jul 10 18:27:08.792481 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:08.792430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p" event={"ID":"e2eec1ac-bc56-4089-b718-ab078a820751","Type":"ContainerDied","Data":"bfab270b9543eb2e757f040356170a5e9a3f95d7d3fd1c37cf44572c8bebfb12"}
Jul 10 18:27:09.076850 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.076821    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:27:09.200376 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.200339    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2eec1ac-bc56-4089-b718-ab078a820751-config-file\") pod \"e2eec1ac-bc56-4089-b718-ab078a820751\" (UID: \"e2eec1ac-bc56-4089-b718-ab078a820751\") "
Jul 10 18:27:09.200538 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.200389    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6297f\" (UniqueName: \"kubernetes.io/projected/e2eec1ac-bc56-4089-b718-ab078a820751-kube-api-access-6297f\") pod \"e2eec1ac-bc56-4089-b718-ab078a820751\" (UID: \"e2eec1ac-bc56-4089-b718-ab078a820751\") "
Jul 10 18:27:09.200759 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.200737    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2eec1ac-bc56-4089-b718-ab078a820751-config-file" (OuterVolumeSpecName: "config-file") pod "e2eec1ac-bc56-4089-b718-ab078a820751" (UID: "e2eec1ac-bc56-4089-b718-ab078a820751"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:27:09.202680 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.202654    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2eec1ac-bc56-4089-b718-ab078a820751-kube-api-access-6297f" (OuterVolumeSpecName: "kube-api-access-6297f") pod "e2eec1ac-bc56-4089-b718-ab078a820751" (UID: "e2eec1ac-bc56-4089-b718-ab078a820751"). InnerVolumeSpecName "kube-api-access-6297f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:27:09.301893 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.301857    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2eec1ac-bc56-4089-b718-ab078a820751-config-file\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:27:09.301893 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.301883    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6297f\" (UniqueName: \"kubernetes.io/projected/e2eec1ac-bc56-4089-b718-ab078a820751-kube-api-access-6297f\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:27:09.798949 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.798918    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p" event={"ID":"e2eec1ac-bc56-4089-b718-ab078a820751","Type":"ContainerDied","Data":"d0995c57c793478696ec7ddaa7214d46c352ff52254536ca7ac7c13d04ed3f13"}
Jul 10 18:27:09.799370 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.798951    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-knm2p"
Jul 10 18:27:09.799370 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.798983    2577 scope.go:117] "RemoveContainer" containerID="bfab270b9543eb2e757f040356170a5e9a3f95d7d3fd1c37cf44572c8bebfb12"
Jul 10 18:27:09.823820 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.823783    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-knm2p"]
Jul 10 18:27:09.827885 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:09.827850    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-knm2p"]
Jul 10 18:27:10.133923 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:10.133843    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2eec1ac-bc56-4089-b718-ab078a820751" path="/var/lib/kubelet/pods/e2eec1ac-bc56-4089-b718-ab078a820751/volumes"
Jul 10 18:27:14.360616 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.360579    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"]
Jul 10 18:27:14.361003 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.360925    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2eec1ac-bc56-4089-b718-ab078a820751" containerName="limitador"
Jul 10 18:27:14.361003 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.360937    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2eec1ac-bc56-4089-b718-ab078a820751" containerName="limitador"
Jul 10 18:27:14.361003 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.361000    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2eec1ac-bc56-4089-b718-ab078a820751" containerName="limitador"
Jul 10 18:27:14.363981 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.363959    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:14.366774 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.366746    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 18:27:14.366913 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.366753    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 10 18:27:14.367684 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.367666    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-sks7x\""
Jul 10 18:27:14.367750 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.367713    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 18:27:14.373980 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.373953    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"]
Jul 10 18:27:14.448462 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.448424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730-data\") pod \"postgres-69fb4594cf-q4nrh\" (UID: \"a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:14.448652 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.448486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldvkg\" (UniqueName: \"kubernetes.io/projected/a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730-kube-api-access-ldvkg\") pod \"postgres-69fb4594cf-q4nrh\" (UID: \"a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:14.549916 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.549567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldvkg\" (UniqueName: \"kubernetes.io/projected/a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730-kube-api-access-ldvkg\") pod \"postgres-69fb4594cf-q4nrh\" (UID: \"a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:14.550118 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.550059    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730-data\") pod \"postgres-69fb4594cf-q4nrh\" (UID: \"a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:14.550462 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.550442    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730-data\") pod \"postgres-69fb4594cf-q4nrh\" (UID: \"a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:14.558438 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.558406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldvkg\" (UniqueName: \"kubernetes.io/projected/a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730-kube-api-access-ldvkg\") pod \"postgres-69fb4594cf-q4nrh\" (UID: \"a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:14.676564 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.676527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:14.820013 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:14.819954    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"]
Jul 10 18:27:14.822209 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:27:14.822184    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0cb238a_4cf6_4fa8_a6a0_3fb8f5a9c730.slice/crio-b3f426771db750f8c56b20a59e7328f3d35691c2bc1802a84fbbd341748e178a WatchSource:0}: Error finding container b3f426771db750f8c56b20a59e7328f3d35691c2bc1802a84fbbd341748e178a: Status 404 returned error can't find the container with id b3f426771db750f8c56b20a59e7328f3d35691c2bc1802a84fbbd341748e178a
Jul 10 18:27:15.831199 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:15.831121    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh" event={"ID":"a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730","Type":"ContainerStarted","Data":"b3f426771db750f8c56b20a59e7328f3d35691c2bc1802a84fbbd341748e178a"}
Jul 10 18:27:19.853989 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:19.853890    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh" event={"ID":"a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730","Type":"ContainerStarted","Data":"d27c409f528f84206b863364a1b1e39bec8b68abc8d2651ea91ae48244b0ad1d"}
Jul 10 18:27:19.853989 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:19.853965    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:19.874534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:19.874448    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh" podStartSLOduration=1.254820818 podStartE2EDuration="5.87442745s" totalImagesPullingTime="4.619606632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:27:19.871934736 +0000 UTC m=+600.544850553" watchObservedRunningTime="2026-07-10 18:27:19.87442745 +0000 UTC m=+600.547343247"
Jul 10 18:27:19.953895 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:19.953870    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:27:19.956406 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:19.956378    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:27:25.890878 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:25.890841    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q4nrh"
Jul 10 18:27:32.822571 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.822528    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d98c785f9-29kdf"]
Jul 10 18:27:32.847615 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.847581    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d98c785f9-29kdf"]
Jul 10 18:27:32.847806 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.847711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:32.850711 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.850680    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 18:27:32.851012 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.850756    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 18:27:32.851558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.851532    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jrhsg\""
Jul 10 18:27:32.897162 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.897127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2jlp\" (UniqueName: \"kubernetes.io/projected/90404315-f00f-4800-8999-1b79d5dc15c1-kube-api-access-k2jlp\") pod \"maas-controller-7d98c785f9-29kdf\" (UID: \"90404315-f00f-4800-8999-1b79d5dc15c1\") " pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:32.897363 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.897173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90404315-f00f-4800-8999-1b79d5dc15c1-webhook-cert\") pod \"maas-controller-7d98c785f9-29kdf\" (UID: \"90404315-f00f-4800-8999-1b79d5dc15c1\") " pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:32.998340 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.998300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90404315-f00f-4800-8999-1b79d5dc15c1-webhook-cert\") pod \"maas-controller-7d98c785f9-29kdf\" (UID: \"90404315-f00f-4800-8999-1b79d5dc15c1\") " pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:32.998526 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:32.998429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2jlp\" (UniqueName: \"kubernetes.io/projected/90404315-f00f-4800-8999-1b79d5dc15c1-kube-api-access-k2jlp\") pod \"maas-controller-7d98c785f9-29kdf\" (UID: \"90404315-f00f-4800-8999-1b79d5dc15c1\") " pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:33.000860 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.000830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90404315-f00f-4800-8999-1b79d5dc15c1-webhook-cert\") pod \"maas-controller-7d98c785f9-29kdf\" (UID: \"90404315-f00f-4800-8999-1b79d5dc15c1\") " pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:33.007139 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.007108    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cb8597bc-2h2ct"]
Jul 10 18:27:33.010040 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.010015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:33.015043 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.015019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2jlp\" (UniqueName: \"kubernetes.io/projected/90404315-f00f-4800-8999-1b79d5dc15c1-kube-api-access-k2jlp\") pod \"maas-controller-7d98c785f9-29kdf\" (UID: \"90404315-f00f-4800-8999-1b79d5dc15c1\") " pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:33.047916 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.047886    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb8597bc-2h2ct"]
Jul 10 18:27:33.099261 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.099144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-webhook-cert\") pod \"maas-controller-5cb8597bc-2h2ct\" (UID: \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\") " pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:33.099261 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.099258    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4dbr\" (UniqueName: \"kubernetes.io/projected/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-kube-api-access-f4dbr\") pod \"maas-controller-5cb8597bc-2h2ct\" (UID: \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\") " pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:33.160538 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.160503    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:33.200325 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.200279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4dbr\" (UniqueName: \"kubernetes.io/projected/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-kube-api-access-f4dbr\") pod \"maas-controller-5cb8597bc-2h2ct\" (UID: \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\") " pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:33.200663 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.200639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-webhook-cert\") pod \"maas-controller-5cb8597bc-2h2ct\" (UID: \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\") " pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:33.203603 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.203575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-webhook-cert\") pod \"maas-controller-5cb8597bc-2h2ct\" (UID: \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\") " pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:33.215414 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.215384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4dbr\" (UniqueName: \"kubernetes.io/projected/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-kube-api-access-f4dbr\") pod \"maas-controller-5cb8597bc-2h2ct\" (UID: \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\") " pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:33.308036 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.307908    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d98c785f9-29kdf"]
Jul 10 18:27:33.310818 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:27:33.310789    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90404315_f00f_4800_8999_1b79d5dc15c1.slice/crio-387876e1a262347e81e9fa95a29919748673b229d38ce04ecdd28fdadefbf974 WatchSource:0}: Error finding container 387876e1a262347e81e9fa95a29919748673b229d38ce04ecdd28fdadefbf974: Status 404 returned error can't find the container with id 387876e1a262347e81e9fa95a29919748673b229d38ce04ecdd28fdadefbf974
Jul 10 18:27:33.312146 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.312127    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:27:33.328715 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.328682    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:33.469830 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.469805    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb8597bc-2h2ct"]
Jul 10 18:27:33.472479 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:27:33.472445    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867bc0a4_56f6_4eb9_84da_76b9e6588e6f.slice/crio-9be485a9e58c512ea8222c6b0bda9874911673722d62d72177048b78d4ee88ba WatchSource:0}: Error finding container 9be485a9e58c512ea8222c6b0bda9874911673722d62d72177048b78d4ee88ba: Status 404 returned error can't find the container with id 9be485a9e58c512ea8222c6b0bda9874911673722d62d72177048b78d4ee88ba
Jul 10 18:27:33.922129 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.922089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8597bc-2h2ct" event={"ID":"867bc0a4-56f6-4eb9-84da-76b9e6588e6f","Type":"ContainerStarted","Data":"9be485a9e58c512ea8222c6b0bda9874911673722d62d72177048b78d4ee88ba"}
Jul 10 18:27:33.923311 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:33.923284    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d98c785f9-29kdf" event={"ID":"90404315-f00f-4800-8999-1b79d5dc15c1","Type":"ContainerStarted","Data":"387876e1a262347e81e9fa95a29919748673b229d38ce04ecdd28fdadefbf974"}
Jul 10 18:27:35.937418 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:35.937377    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d98c785f9-29kdf" event={"ID":"90404315-f00f-4800-8999-1b79d5dc15c1","Type":"ContainerStarted","Data":"5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217"}
Jul 10 18:27:35.937909 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:35.937572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:35.939378 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:35.939327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8597bc-2h2ct" event={"ID":"867bc0a4-56f6-4eb9-84da-76b9e6588e6f","Type":"ContainerStarted","Data":"8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d"}
Jul 10 18:27:35.939545 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:35.939531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:35.957832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:35.957775    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d98c785f9-29kdf" podStartSLOduration=1.777539827 podStartE2EDuration="3.957756569s" totalImagesPullingTime="2.180216742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:27:35.95547708 +0000 UTC m=+616.628392883" watchObservedRunningTime="2026-07-10 18:27:35.957756569 +0000 UTC m=+616.630672368"
Jul 10 18:27:35.993243 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:35.993168    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cb8597bc-2h2ct" podStartSLOduration=1.980311175 podStartE2EDuration="3.993147432s" totalImagesPullingTime="2.012836257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:27:35.993025337 +0000 UTC m=+616.665941156" watchObservedRunningTime="2026-07-10 18:27:35.993147432 +0000 UTC m=+616.666063230"
Jul 10 18:27:46.949137 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:46.949059    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:46.949137 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:46.949127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:27:47.016105 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.016070    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d98c785f9-29kdf"]
Jul 10 18:27:47.016325 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.016275    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7d98c785f9-29kdf" podUID="90404315-f00f-4800-8999-1b79d5dc15c1" containerName="manager" containerID="cri-o://5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217" gracePeriod=30
Jul 10 18:27:47.269430 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.269396    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:47.323990 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.323948    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2jlp\" (UniqueName: \"kubernetes.io/projected/90404315-f00f-4800-8999-1b79d5dc15c1-kube-api-access-k2jlp\") pod \"90404315-f00f-4800-8999-1b79d5dc15c1\" (UID: \"90404315-f00f-4800-8999-1b79d5dc15c1\") "
Jul 10 18:27:47.323990 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.323995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90404315-f00f-4800-8999-1b79d5dc15c1-webhook-cert\") pod \"90404315-f00f-4800-8999-1b79d5dc15c1\" (UID: \"90404315-f00f-4800-8999-1b79d5dc15c1\") "
Jul 10 18:27:47.326315 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.326278    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90404315-f00f-4800-8999-1b79d5dc15c1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "90404315-f00f-4800-8999-1b79d5dc15c1" (UID: "90404315-f00f-4800-8999-1b79d5dc15c1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:27:47.326419 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.326395    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90404315-f00f-4800-8999-1b79d5dc15c1-kube-api-access-k2jlp" (OuterVolumeSpecName: "kube-api-access-k2jlp") pod "90404315-f00f-4800-8999-1b79d5dc15c1" (UID: "90404315-f00f-4800-8999-1b79d5dc15c1"). InnerVolumeSpecName "kube-api-access-k2jlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:27:47.425483 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.425440    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2jlp\" (UniqueName: \"kubernetes.io/projected/90404315-f00f-4800-8999-1b79d5dc15c1-kube-api-access-k2jlp\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:27:47.425483 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.425476    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90404315-f00f-4800-8999-1b79d5dc15c1-webhook-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:27:47.994624 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.994583    2577 generic.go:356] "Generic (PLEG): container finished" podID="90404315-f00f-4800-8999-1b79d5dc15c1" containerID="5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217" exitCode=0
Jul 10 18:27:47.995059 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.994632    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d98c785f9-29kdf"
Jul 10 18:27:47.995059 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.994668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d98c785f9-29kdf" event={"ID":"90404315-f00f-4800-8999-1b79d5dc15c1","Type":"ContainerDied","Data":"5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217"}
Jul 10 18:27:47.995059 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.994729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d98c785f9-29kdf" event={"ID":"90404315-f00f-4800-8999-1b79d5dc15c1","Type":"ContainerDied","Data":"387876e1a262347e81e9fa95a29919748673b229d38ce04ecdd28fdadefbf974"}
Jul 10 18:27:47.995059 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:47.994753    2577 scope.go:117] "RemoveContainer" containerID="5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217"
Jul 10 18:27:48.003688 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:48.003665    2577 scope.go:117] "RemoveContainer" containerID="5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217"
Jul 10 18:27:48.004001 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:27:48.003983    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217\": container with ID starting with 5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217 not found: ID does not exist" containerID="5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217"
Jul 10 18:27:48.004060 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:48.004012    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217"} err="failed to get container status \"5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217\": rpc error: code = NotFound desc = could not find container \"5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217\": container with ID starting with 5ee30b142cfd899c22211b005a198599674389936138b35dbcea41708f399217 not found: ID does not exist"
Jul 10 18:27:48.018082 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:48.018030    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d98c785f9-29kdf"]
Jul 10 18:27:48.021652 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:48.021620    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d98c785f9-29kdf"]
Jul 10 18:27:48.133242 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:27:48.133201    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90404315-f00f-4800-8999-1b79d5dc15c1" path="/var/lib/kubelet/pods/90404315-f00f-4800-8999-1b79d5dc15c1/volumes"
Jul 10 18:28:07.775115 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.775073    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"]
Jul 10 18:28:07.775661 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.775455    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90404315-f00f-4800-8999-1b79d5dc15c1" containerName="manager"
Jul 10 18:28:07.775661 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.775467    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="90404315-f00f-4800-8999-1b79d5dc15c1" containerName="manager"
Jul 10 18:28:07.775661 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.775531    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="90404315-f00f-4800-8999-1b79d5dc15c1" containerName="manager"
Jul 10 18:28:07.779893 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.779873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:07.783910 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.783886    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 18:28:07.784079 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.783964    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v2ltk\""
Jul 10 18:28:07.790351 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.790323    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"]
Jul 10 18:28:07.910848 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.910818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65dea2c7-9277-48cb-879f-235cc2b23d59-maas-api-tls\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:07.911044 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.910858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvc8b\" (UniqueName: \"kubernetes.io/projected/65dea2c7-9277-48cb-879f-235cc2b23d59-kube-api-access-dvc8b\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:07.911044 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:07.910888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65dea2c7-9277-48cb-879f-235cc2b23d59-openshift-service-ca\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.011735 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.011694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65dea2c7-9277-48cb-879f-235cc2b23d59-maas-api-tls\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.011908 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.011744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvc8b\" (UniqueName: \"kubernetes.io/projected/65dea2c7-9277-48cb-879f-235cc2b23d59-kube-api-access-dvc8b\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.011908 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.011780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65dea2c7-9277-48cb-879f-235cc2b23d59-openshift-service-ca\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.011908 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:28:08.011867    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 10 18:28:08.012083 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:28:08.011950    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65dea2c7-9277-48cb-879f-235cc2b23d59-maas-api-tls podName:65dea2c7-9277-48cb-879f-235cc2b23d59 nodeName:}" failed. No retries permitted until 2026-07-10 18:28:08.511928975 +0000 UTC m=+649.184844768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65dea2c7-9277-48cb-879f-235cc2b23d59-maas-api-tls") pod "maas-api-7c6c8c4796-frflv" (UID: "65dea2c7-9277-48cb-879f-235cc2b23d59") : secret "maas-api-serving-cert" not found
Jul 10 18:28:08.012627 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.012605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65dea2c7-9277-48cb-879f-235cc2b23d59-openshift-service-ca\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.023469 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.023435    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvc8b\" (UniqueName: \"kubernetes.io/projected/65dea2c7-9277-48cb-879f-235cc2b23d59-kube-api-access-dvc8b\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.312528 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.312490    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x7v29"]
Jul 10 18:28:08.316369 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.316347    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:08.319489 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.319464    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 18:28:08.319489 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.319484    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5xfjs\""
Jul 10 18:28:08.329092 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.329068    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x7v29"]
Jul 10 18:28:08.415677 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.415634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smzvc\" (UniqueName: \"kubernetes.io/projected/33c54701-2c71-4f88-8036-b851b03986e8-kube-api-access-smzvc\") pod \"payload-processing-58f86c7798-x7v29\" (UID: \"33c54701-2c71-4f88-8036-b851b03986e8\") " pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:08.415831 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.415726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33c54701-2c71-4f88-8036-b851b03986e8-plugins-config-volume\") pod \"payload-processing-58f86c7798-x7v29\" (UID: \"33c54701-2c71-4f88-8036-b851b03986e8\") " pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:08.516812 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.516763    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65dea2c7-9277-48cb-879f-235cc2b23d59-maas-api-tls\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.516997 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.516828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smzvc\" (UniqueName: \"kubernetes.io/projected/33c54701-2c71-4f88-8036-b851b03986e8-kube-api-access-smzvc\") pod \"payload-processing-58f86c7798-x7v29\" (UID: \"33c54701-2c71-4f88-8036-b851b03986e8\") " pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:08.516997 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.516890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33c54701-2c71-4f88-8036-b851b03986e8-plugins-config-volume\") pod \"payload-processing-58f86c7798-x7v29\" (UID: \"33c54701-2c71-4f88-8036-b851b03986e8\") " pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:08.517868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.517836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33c54701-2c71-4f88-8036-b851b03986e8-plugins-config-volume\") pod \"payload-processing-58f86c7798-x7v29\" (UID: \"33c54701-2c71-4f88-8036-b851b03986e8\") " pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:08.519248 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.519213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65dea2c7-9277-48cb-879f-235cc2b23d59-maas-api-tls\") pod \"maas-api-7c6c8c4796-frflv\" (UID: \"65dea2c7-9277-48cb-879f-235cc2b23d59\") " pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.526795 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.526768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smzvc\" (UniqueName: \"kubernetes.io/projected/33c54701-2c71-4f88-8036-b851b03986e8-kube-api-access-smzvc\") pod \"payload-processing-58f86c7798-x7v29\" (UID: \"33c54701-2c71-4f88-8036-b851b03986e8\") " pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:08.628007 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.627908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:08.693707 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.693203    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:08.777413 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.777375    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x7v29"]
Jul 10 18:28:08.779284 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:28:08.779253    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c54701_2c71_4f88_8036_b851b03986e8.slice/crio-5c319d7fbba3bf2c5aea1d020b6547cba3683ffce6b3415da3485fb7951a0331 WatchSource:0}: Error finding container 5c319d7fbba3bf2c5aea1d020b6547cba3683ffce6b3415da3485fb7951a0331: Status 404 returned error can't find the container with id 5c319d7fbba3bf2c5aea1d020b6547cba3683ffce6b3415da3485fb7951a0331
Jul 10 18:28:08.840583 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:08.840556    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"]
Jul 10 18:28:09.100781 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:09.100743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-x7v29" event={"ID":"33c54701-2c71-4f88-8036-b851b03986e8","Type":"ContainerStarted","Data":"5c319d7fbba3bf2c5aea1d020b6547cba3683ffce6b3415da3485fb7951a0331"}
Jul 10 18:28:09.101856 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:09.101830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv" event={"ID":"65dea2c7-9277-48cb-879f-235cc2b23d59","Type":"ContainerStarted","Data":"43cb45a867ff19227b496987d8e3e0fa2b36335fcc884b03ed9541e8a9068c9e"}
Jul 10 18:28:11.114961 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:11.114861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-x7v29" event={"ID":"33c54701-2c71-4f88-8036-b851b03986e8","Type":"ContainerStarted","Data":"d790481bd2c896d2aee0fd519be29572c63ec1bfc6b6d81e0bf79e1c70b596c3"}
Jul 10 18:28:11.115430 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:11.114974    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:11.116519 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:11.116488    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv" event={"ID":"65dea2c7-9277-48cb-879f-235cc2b23d59","Type":"ContainerStarted","Data":"560b7489e73499388566986565f14bd313a2a559e1eed5d8cf90e4292419af8a"}
Jul 10 18:28:11.116643 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:11.116611    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:11.132847 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:11.132793    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-x7v29" podStartSLOduration=1.217288839 podStartE2EDuration="3.132775451s" totalImagesPullingTime="1.915486612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:11.131828574 +0000 UTC m=+651.804744388" watchObservedRunningTime="2026-07-10 18:28:11.132775451 +0000 UTC m=+651.805691250"
Jul 10 18:28:11.150569 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:11.150503    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv" podStartSLOduration=2.297338982 podStartE2EDuration="4.150481242s" totalImagesPullingTime="1.85314226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:11.149670747 +0000 UTC m=+651.822586570" watchObservedRunningTime="2026-07-10 18:28:11.150481242 +0000 UTC m=+651.823397043"
Jul 10 18:28:17.127718 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:17.127691    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7c6c8c4796-frflv"
Jul 10 18:28:22.124336 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:22.124305    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-x7v29"
Jul 10 18:28:31.090534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.090492    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"]
Jul 10 18:28:31.095359 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.095333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.098026 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.097999    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 18:28:31.098179 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.098032    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 18:28:31.098981 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.098964    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m2g74\""
Jul 10 18:28:31.099073 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.099042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 10 18:28:31.103464 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.103434    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"]
Jul 10 18:28:31.214724 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.214684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.214724 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.214731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.214941 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.214755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.214941 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.214847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w55m\" (UniqueName: \"kubernetes.io/projected/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-kube-api-access-8w55m\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.214941 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.214887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.214941 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.214924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.315741 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.315697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.315741 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.315746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.316005 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.315777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.316005 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.315821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w55m\" (UniqueName: \"kubernetes.io/projected/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-kube-api-access-8w55m\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.316005 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.315849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.316005 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.315875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.316295 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.316266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.316419 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.316308    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.316419 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.316360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.318068 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.318047    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.318356 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.318339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.323949 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.323927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w55m\" (UniqueName: \"kubernetes.io/projected/2f37a9c3-b2c6-4daf-978a-e22c15724cd0-kube-api-access-8w55m\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x\" (UID: \"2f37a9c3-b2c6-4daf-978a-e22c15724cd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.408865 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.408770    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:31.593113 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:31.593089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"]
Jul 10 18:28:31.595215 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:28:31.595181    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f37a9c3_b2c6_4daf_978a_e22c15724cd0.slice/crio-a4bcadb2ff3a484c1d9b5b68ac1cc014452cb82af6d904b5632a66f6fba9088e WatchSource:0}: Error finding container a4bcadb2ff3a484c1d9b5b68ac1cc014452cb82af6d904b5632a66f6fba9088e: Status 404 returned error can't find the container with id a4bcadb2ff3a484c1d9b5b68ac1cc014452cb82af6d904b5632a66f6fba9088e
Jul 10 18:28:32.216303 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:32.216190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x" event={"ID":"2f37a9c3-b2c6-4daf-978a-e22c15724cd0","Type":"ContainerStarted","Data":"a4bcadb2ff3a484c1d9b5b68ac1cc014452cb82af6d904b5632a66f6fba9088e"}
Jul 10 18:28:33.222012 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:33.221979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x" event={"ID":"2f37a9c3-b2c6-4daf-978a-e22c15724cd0","Type":"ContainerStarted","Data":"73d0b73886977e6f70f1a40644d462e8a9438c1697c50344443badeb2d2e30c0"}
Jul 10 18:28:33.244998 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:33.244937    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x" podStartSLOduration=1.207218014 podStartE2EDuration="2.244918195s" totalImagesPullingTime="1.037700181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:33.243157211 +0000 UTC m=+673.916073032" watchObservedRunningTime="2026-07-10 18:28:33.244918195 +0000 UTC m=+673.917833994"
Jul 10 18:28:41.409590 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:41.409550    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:41.409983 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:41.409614    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:41.422467 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:41.422433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:42.273509 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:42.273474    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x"
Jul 10 18:28:46.267599 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.267562    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"]
Jul 10 18:28:46.271644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.271622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.274018 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.273989    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 18:28:46.282756 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.282723    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"]
Jul 10 18:28:46.354054 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.354017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.354271 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.354133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.354271 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.354163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80498301-38ad-4618-89b2-a2a0febb12c5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.354398 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.354272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffh4n\" (UniqueName: \"kubernetes.io/projected/80498301-38ad-4618-89b2-a2a0febb12c5-kube-api-access-ffh4n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.354398 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.354307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.354398 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.354332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.454803 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.454772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.454803 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.454807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80498301-38ad-4618-89b2-a2a0febb12c5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.455064 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.454845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffh4n\" (UniqueName: \"kubernetes.io/projected/80498301-38ad-4618-89b2-a2a0febb12c5-kube-api-access-ffh4n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.455064 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.454869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.455064 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.454891    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.455064 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.454932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.455352 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.455276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.455352 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.455321    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.455430 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.455397    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.457289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.457266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80498301-38ad-4618-89b2-a2a0febb12c5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.457481 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.457463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80498301-38ad-4618-89b2-a2a0febb12c5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.463514 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.463479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffh4n\" (UniqueName: \"kubernetes.io/projected/80498301-38ad-4618-89b2-a2a0febb12c5-kube-api-access-ffh4n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hrrlg\" (UID: \"80498301-38ad-4618-89b2-a2a0febb12c5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.583993 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.583890    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:46.726530 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:46.726502    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"]
Jul 10 18:28:46.729054 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:28:46.729008    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80498301_38ad_4618_89b2_a2a0febb12c5.slice/crio-9fe3f03fe31027319af6011501c7b2b0df5baa260a8d617ca51a179a32e78579 WatchSource:0}: Error finding container 9fe3f03fe31027319af6011501c7b2b0df5baa260a8d617ca51a179a32e78579: Status 404 returned error can't find the container with id 9fe3f03fe31027319af6011501c7b2b0df5baa260a8d617ca51a179a32e78579
Jul 10 18:28:47.291188 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:47.291098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg" event={"ID":"80498301-38ad-4618-89b2-a2a0febb12c5","Type":"ContainerStarted","Data":"7467d73501e47d0ea2008e6f6bc22bf42063efcfa988d9b8f528f1e40d283e34"}
Jul 10 18:28:47.291188 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:47.291162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg" event={"ID":"80498301-38ad-4618-89b2-a2a0febb12c5","Type":"ContainerStarted","Data":"9fe3f03fe31027319af6011501c7b2b0df5baa260a8d617ca51a179a32e78579"}
Jul 10 18:28:47.316190 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:47.313596    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg" podStartSLOduration=1.118255761 podStartE2EDuration="1.313569104s" totalImagesPullingTime="195.313343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:47.309466517 +0000 UTC m=+687.982382351" watchObservedRunningTime="2026-07-10 18:28:47.313569104 +0000 UTC m=+687.986484901"
Jul 10 18:28:56.585061 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:56.585015    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:56.585488 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:56.585087    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:56.597755 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:56.597723    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:28:57.349664 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:28:57.349629    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hrrlg"
Jul 10 18:30:00.147925 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:00.147885    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"]
Jul 10 18:30:00.151544 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:00.151524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"
Jul 10 18:30:00.155685 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:00.155662    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bw2j9\""
Jul 10 18:30:00.160064 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:00.160037    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"]
Jul 10 18:30:00.163486 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:00.163459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"
Jul 10 18:30:00.307202 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:00.307148    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"]
Jul 10 18:30:00.310131 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:30:00.310097    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ece079d_c65c_4260_ad71_f45a1df5fcb2.slice/crio-bd6dbebc0a55b2b5229745691a37052d839004635f140483f1bb3c4de2535751 WatchSource:0}: Error finding container bd6dbebc0a55b2b5229745691a37052d839004635f140483f1bb3c4de2535751: Status 404 returned error can't find the container with id bd6dbebc0a55b2b5229745691a37052d839004635f140483f1bb3c4de2535751
Jul 10 18:30:00.648073 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:00.648039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms" event={"ID":"1ece079d-c65c-4260-ad71-f45a1df5fcb2","Type":"ContainerStarted","Data":"bd6dbebc0a55b2b5229745691a37052d839004635f140483f1bb3c4de2535751"}
Jul 10 18:30:03.664613 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:03.664572    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms" event={"ID":"1ece079d-c65c-4260-ad71-f45a1df5fcb2","Type":"ContainerStarted","Data":"3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9"}
Jul 10 18:30:03.680468 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:30:03.680363    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms" podStartSLOduration=0.84264422 podStartE2EDuration="3.680344567s" totalImagesPullingTime="2.837700347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:03.679791226 +0000 UTC m=+764.352707036" watchObservedRunningTime="2026-07-10 18:30:03.680344567 +0000 UTC m=+764.353260366"
Jul 10 18:31:00.022296 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:00.022254    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"]
Jul 10 18:31:00.022756 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:00.022463    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms" podUID="1ece079d-c65c-4260-ad71-f45a1df5fcb2" containerName="cleanup" containerID="cri-o://3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9" gracePeriod=30
Jul 10 18:31:30.226661 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:30.226633    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"
Jul 10 18:31:31.085469 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.085435    2577 generic.go:356] "Generic (PLEG): container finished" podID="1ece079d-c65c-4260-ad71-f45a1df5fcb2" containerID="3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9" exitCode=137
Jul 10 18:31:31.085757 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.085479    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"
Jul 10 18:31:31.085757 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.085500    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms" event={"ID":"1ece079d-c65c-4260-ad71-f45a1df5fcb2","Type":"ContainerDied","Data":"3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9"}
Jul 10 18:31:31.085757 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.085545    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms" event={"ID":"1ece079d-c65c-4260-ad71-f45a1df5fcb2","Type":"ContainerDied","Data":"bd6dbebc0a55b2b5229745691a37052d839004635f140483f1bb3c4de2535751"}
Jul 10 18:31:31.085757 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.085577    2577 scope.go:117] "RemoveContainer" containerID="3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9"
Jul 10 18:31:31.094806 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.094783    2577 scope.go:117] "RemoveContainer" containerID="3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9"
Jul 10 18:31:31.095114 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:31:31.095094    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9\": container with ID starting with 3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9 not found: ID does not exist" containerID="3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9"
Jul 10 18:31:31.095188 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.095121    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9"} err="failed to get container status \"3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9\": rpc error: code = NotFound desc = could not find container \"3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9\": container with ID starting with 3bfcc5af40086e3338babb268e48d1707269a4b2673f02a3d73420eaa2d98cc9 not found: ID does not exist"
Jul 10 18:31:31.107829 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.107796    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"]
Jul 10 18:31:31.109660 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:31.109636    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-qm4ms"]
Jul 10 18:31:32.139301 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:32.139262    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ece079d-c65c-4260-ad71-f45a1df5fcb2" path="/var/lib/kubelet/pods/1ece079d-c65c-4260-ad71-f45a1df5fcb2/volumes"
Jul 10 18:31:55.917833 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:55.917786    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cb8597bc-2h2ct"]
Jul 10 18:31:55.918339 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:55.918053    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5cb8597bc-2h2ct" podUID="867bc0a4-56f6-4eb9-84da-76b9e6588e6f" containerName="manager" containerID="cri-o://8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d" gracePeriod=30
Jul 10 18:31:56.177793 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.177717    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:31:56.210950 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.210918    2577 generic.go:356] "Generic (PLEG): container finished" podID="867bc0a4-56f6-4eb9-84da-76b9e6588e6f" containerID="8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d" exitCode=0
Jul 10 18:31:56.211149 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.210967    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8597bc-2h2ct"
Jul 10 18:31:56.211149 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.210981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8597bc-2h2ct" event={"ID":"867bc0a4-56f6-4eb9-84da-76b9e6588e6f","Type":"ContainerDied","Data":"8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d"}
Jul 10 18:31:56.211149 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.211035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8597bc-2h2ct" event={"ID":"867bc0a4-56f6-4eb9-84da-76b9e6588e6f","Type":"ContainerDied","Data":"9be485a9e58c512ea8222c6b0bda9874911673722d62d72177048b78d4ee88ba"}
Jul 10 18:31:56.211149 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.211061    2577 scope.go:117] "RemoveContainer" containerID="8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d"
Jul 10 18:31:56.221926 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.221904    2577 scope.go:117] "RemoveContainer" containerID="8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d"
Jul 10 18:31:56.222279 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:31:56.222255    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d\": container with ID starting with 8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d not found: ID does not exist" containerID="8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d"
Jul 10 18:31:56.222382 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.222288    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d"} err="failed to get container status \"8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d\": rpc error: code = NotFound desc = could not find container \"8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d\": container with ID starting with 8fcf37b6adc8777a4aa402ffddf083cab7e6928c37cb3e68e237e54028a0dd0d not found: ID does not exist"
Jul 10 18:31:56.304273 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.304208    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4dbr\" (UniqueName: \"kubernetes.io/projected/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-kube-api-access-f4dbr\") pod \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\" (UID: \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\") "
Jul 10 18:31:56.304460 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.304281    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-webhook-cert\") pod \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\" (UID: \"867bc0a4-56f6-4eb9-84da-76b9e6588e6f\") "
Jul 10 18:31:56.306341 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.306307    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "867bc0a4-56f6-4eb9-84da-76b9e6588e6f" (UID: "867bc0a4-56f6-4eb9-84da-76b9e6588e6f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:31:56.306462 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.306346    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-kube-api-access-f4dbr" (OuterVolumeSpecName: "kube-api-access-f4dbr") pod "867bc0a4-56f6-4eb9-84da-76b9e6588e6f" (UID: "867bc0a4-56f6-4eb9-84da-76b9e6588e6f"). InnerVolumeSpecName "kube-api-access-f4dbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:31:56.405469 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.405426    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4dbr\" (UniqueName: \"kubernetes.io/projected/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-kube-api-access-f4dbr\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:31:56.405469 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.405458    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/867bc0a4-56f6-4eb9-84da-76b9e6588e6f-webhook-cert\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:31:56.533396 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.533363    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cb8597bc-2h2ct"]
Jul 10 18:31:56.537591 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:56.537539    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cb8597bc-2h2ct"]
Jul 10 18:31:57.306712 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.306673    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cb8597bc-f44j4"]
Jul 10 18:31:57.307299 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.307265    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867bc0a4-56f6-4eb9-84da-76b9e6588e6f" containerName="manager"
Jul 10 18:31:57.307299 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.307287    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="867bc0a4-56f6-4eb9-84da-76b9e6588e6f" containerName="manager"
Jul 10 18:31:57.307461 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.307329    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ece079d-c65c-4260-ad71-f45a1df5fcb2" containerName="cleanup"
Jul 10 18:31:57.307461 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.307342    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ece079d-c65c-4260-ad71-f45a1df5fcb2" containerName="cleanup"
Jul 10 18:31:57.307461 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.307443    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ece079d-c65c-4260-ad71-f45a1df5fcb2" containerName="cleanup"
Jul 10 18:31:57.307461 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.307461    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="867bc0a4-56f6-4eb9-84da-76b9e6588e6f" containerName="manager"
Jul 10 18:31:57.310494 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.310467    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:57.313989 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.313957    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 18:31:57.313989 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.313992    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 18:31:57.314186 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.313974    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jrhsg\""
Jul 10 18:31:57.320365 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.320332    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb8597bc-f44j4"]
Jul 10 18:31:57.414539 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.414505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fpbq\" (UniqueName: \"kubernetes.io/projected/40b00685-962a-4f3c-a4bc-b03d24f1d1fe-kube-api-access-8fpbq\") pod \"maas-controller-5cb8597bc-f44j4\" (UID: \"40b00685-962a-4f3c-a4bc-b03d24f1d1fe\") " pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:57.414716 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.414557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40b00685-962a-4f3c-a4bc-b03d24f1d1fe-webhook-cert\") pod \"maas-controller-5cb8597bc-f44j4\" (UID: \"40b00685-962a-4f3c-a4bc-b03d24f1d1fe\") " pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:57.515557 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.515528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fpbq\" (UniqueName: \"kubernetes.io/projected/40b00685-962a-4f3c-a4bc-b03d24f1d1fe-kube-api-access-8fpbq\") pod \"maas-controller-5cb8597bc-f44j4\" (UID: \"40b00685-962a-4f3c-a4bc-b03d24f1d1fe\") " pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:57.515742 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.515574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40b00685-962a-4f3c-a4bc-b03d24f1d1fe-webhook-cert\") pod \"maas-controller-5cb8597bc-f44j4\" (UID: \"40b00685-962a-4f3c-a4bc-b03d24f1d1fe\") " pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:57.518165 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.518139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40b00685-962a-4f3c-a4bc-b03d24f1d1fe-webhook-cert\") pod \"maas-controller-5cb8597bc-f44j4\" (UID: \"40b00685-962a-4f3c-a4bc-b03d24f1d1fe\") " pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:57.524196 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.524170    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fpbq\" (UniqueName: \"kubernetes.io/projected/40b00685-962a-4f3c-a4bc-b03d24f1d1fe-kube-api-access-8fpbq\") pod \"maas-controller-5cb8597bc-f44j4\" (UID: \"40b00685-962a-4f3c-a4bc-b03d24f1d1fe\") " pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:57.622412 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.622317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:57.761499 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:57.761472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb8597bc-f44j4"]
Jul 10 18:31:57.764143 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:31:57.764115    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b00685_962a_4f3c_a4bc_b03d24f1d1fe.slice/crio-f5e32d84da28ecfa0e419186f0f0563078cc3931e7663f3da3832657e1469c2e WatchSource:0}: Error finding container f5e32d84da28ecfa0e419186f0f0563078cc3931e7663f3da3832657e1469c2e: Status 404 returned error can't find the container with id f5e32d84da28ecfa0e419186f0f0563078cc3931e7663f3da3832657e1469c2e
Jul 10 18:31:58.132906 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:58.132868    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="867bc0a4-56f6-4eb9-84da-76b9e6588e6f" path="/var/lib/kubelet/pods/867bc0a4-56f6-4eb9-84da-76b9e6588e6f/volumes"
Jul 10 18:31:58.224053 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:58.224001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8597bc-f44j4" event={"ID":"40b00685-962a-4f3c-a4bc-b03d24f1d1fe","Type":"ContainerStarted","Data":"f5e32d84da28ecfa0e419186f0f0563078cc3931e7663f3da3832657e1469c2e"}
Jul 10 18:31:59.230546 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:59.230509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8597bc-f44j4" event={"ID":"40b00685-962a-4f3c-a4bc-b03d24f1d1fe","Type":"ContainerStarted","Data":"6b3e44f69021091b1352a8498f3702c60696e64d66f7825bdfde8b5516ea12e6"}
Jul 10 18:31:59.230986 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:59.230619    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:31:59.249874 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:31:59.249817    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cb8597bc-f44j4" podStartSLOduration=1.806173195 podStartE2EDuration="2.249800882s" totalImagesPullingTime="443.627687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:59.247934813 +0000 UTC m=+879.920850613" watchObservedRunningTime="2026-07-10 18:31:59.249800882 +0000 UTC m=+879.922716681"
Jul 10 18:32:10.240568 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:32:10.240489    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cb8597bc-f44j4"
Jul 10 18:32:19.985945 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:32:19.985914    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:32:19.986422 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:32:19.986352    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:37:20.016086 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:37:20.016054    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:37:20.017263 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:37:20.017239    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:42:20.045695 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:42:20.045653    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:42:20.047949 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:42:20.047925    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:44:28.517355 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.517313    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"]
Jul 10 18:44:28.520256 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.520214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:28.522983 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.522959    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8ca6169c-serving-cert\""
Jul 10 18:44:28.533602 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.533570    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"]
Jul 10 18:44:28.616020 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.615985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-openshift-service-ca\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:28.616020 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.616024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:28.616338 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.616129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhwf8\" (UniqueName: \"kubernetes.io/projected/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-kube-api-access-fhwf8\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:28.716797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.716755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-openshift-service-ca\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:28.716797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.716794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:28.717055 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.716857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhwf8\" (UniqueName: \"kubernetes.io/projected/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-kube-api-access-fhwf8\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:28.717055 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:44:28.716980    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-serving-cert: secret "maas-api-e2e-ait-8ca6169c-serving-cert" not found
Jul 10 18:44:28.717179 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:44:28.717068    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls podName:82ea7f57-5cd9-428b-8f83-0c65c41b5f3a nodeName:}" failed. No retries permitted until 2026-07-10 18:44:29.217045166 +0000 UTC m=+1629.889960980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls") pod "maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p" (UID: "82ea7f57-5cd9-428b-8f83-0c65c41b5f3a") : secret "maas-api-e2e-ait-8ca6169c-serving-cert" not found
Jul 10 18:44:28.717447 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.717429    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-openshift-service-ca\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:28.728673 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:28.728635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhwf8\" (UniqueName: \"kubernetes.io/projected/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-kube-api-access-fhwf8\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:29.221350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:29.221309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:29.223782 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:29.223756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls\") pod \"maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:29.433953 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:29.433914    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:29.583294 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:29.583260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"]
Jul 10 18:44:29.585475 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:44:29.585436    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ea7f57_5cd9_428b_8f83_0c65c41b5f3a.slice/crio-4e2639821778d6a02d9ba686fc5eecfc765971d1ea12fea5d5d458b1b8987822 WatchSource:0}: Error finding container 4e2639821778d6a02d9ba686fc5eecfc765971d1ea12fea5d5d458b1b8987822: Status 404 returned error can't find the container with id 4e2639821778d6a02d9ba686fc5eecfc765971d1ea12fea5d5d458b1b8987822
Jul 10 18:44:29.586942 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:29.586921    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:44:29.902706 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:29.902617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p" event={"ID":"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a","Type":"ContainerStarted","Data":"4e2639821778d6a02d9ba686fc5eecfc765971d1ea12fea5d5d458b1b8987822"}
Jul 10 18:44:30.909468 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:30.909423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p" event={"ID":"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a","Type":"ContainerStarted","Data":"4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031"}
Jul 10 18:44:30.909982 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:30.909544    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:30.929698 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:30.929636    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p" podStartSLOduration=2.530544711 podStartE2EDuration="2.929617305s" totalImagesPullingTime="399.072594ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:44:30.927724658 +0000 UTC m=+1631.600640486" watchObservedRunningTime="2026-07-10 18:44:30.929617305 +0000 UTC m=+1631.602533103"
Jul 10 18:44:33.920809 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:33.920771    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"]
Jul 10 18:44:33.921313 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:33.920992    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p" podUID="82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" containerName="maas-api" containerID="cri-o://4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031" gracePeriod=30
Jul 10 18:44:34.178157 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.178082    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:34.264701 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.264665    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-openshift-service-ca\") pod \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") "
Jul 10 18:44:34.264900 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.264728    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhwf8\" (UniqueName: \"kubernetes.io/projected/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-kube-api-access-fhwf8\") pod \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") "
Jul 10 18:44:34.264900 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.264797    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls\") pod \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\" (UID: \"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a\") "
Jul 10 18:44:34.265132 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.265097    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" (UID: "82ea7f57-5cd9-428b-8f83-0c65c41b5f3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:44:34.267181 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.267153    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" (UID: "82ea7f57-5cd9-428b-8f83-0c65c41b5f3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:44:34.267316 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.267176    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-kube-api-access-fhwf8" (OuterVolumeSpecName: "kube-api-access-fhwf8") pod "82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" (UID: "82ea7f57-5cd9-428b-8f83-0c65c41b5f3a"). InnerVolumeSpecName "kube-api-access-fhwf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:44:34.365490 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.365449    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhwf8\" (UniqueName: \"kubernetes.io/projected/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-kube-api-access-fhwf8\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:44:34.365490 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.365489    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:44:34.365702 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.365504    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:44:34.932595 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.932562    2577 generic.go:356] "Generic (PLEG): container finished" podID="82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" containerID="4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031" exitCode=0
Jul 10 18:44:34.933002 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.932607    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"
Jul 10 18:44:34.933002 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.932612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p" event={"ID":"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a","Type":"ContainerDied","Data":"4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031"}
Jul 10 18:44:34.933002 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.932732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p" event={"ID":"82ea7f57-5cd9-428b-8f83-0c65c41b5f3a","Type":"ContainerDied","Data":"4e2639821778d6a02d9ba686fc5eecfc765971d1ea12fea5d5d458b1b8987822"}
Jul 10 18:44:34.933002 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.932758    2577 scope.go:117] "RemoveContainer" containerID="4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031"
Jul 10 18:44:34.942404 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.942384    2577 scope.go:117] "RemoveContainer" containerID="4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031"
Jul 10 18:44:34.942713 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:44:34.942694    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031\": container with ID starting with 4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031 not found: ID does not exist" containerID="4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031"
Jul 10 18:44:34.942782 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.942721    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031"} err="failed to get container status \"4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031\": rpc error: code = NotFound desc = could not find container \"4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031\": container with ID starting with 4f86515e93ab069e6f2a12ce67a90d92c7251cd38a1bd1595ecdd8233c87e031 not found: ID does not exist"
Jul 10 18:44:34.956519 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.956480    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"]
Jul 10 18:44:34.963311 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:34.963281    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ca6169c-86f9c77cd-kw56p"]
Jul 10 18:44:36.133561 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:36.133516    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" path="/var/lib/kubelet/pods/82ea7f57-5cd9-428b-8f83-0c65c41b5f3a/volumes"
Jul 10 18:44:41.055826 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.055780    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"]
Jul 10 18:44:41.056395 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.056374    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" containerName="maas-api"
Jul 10 18:44:41.056463 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.056398    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" containerName="maas-api"
Jul 10 18:44:41.056563 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.056550    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ea7f57-5cd9-428b-8f83-0c65c41b5f3a" containerName="maas-api"
Jul 10 18:44:41.060361 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.060335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.064453 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.064429    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8dfa64c8-serving-cert\""
Jul 10 18:44:41.070911 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.070805    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"]
Jul 10 18:44:41.121631 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.121581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cca8279-1f20-45e1-b2df-60cd2835ee77-openshift-service-ca\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.121816 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.121674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqrmn\" (UniqueName: \"kubernetes.io/projected/9cca8279-1f20-45e1-b2df-60cd2835ee77-kube-api-access-gqrmn\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.121816 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.121724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cca8279-1f20-45e1-b2df-60cd2835ee77-maas-api-tls\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.223349 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.223301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cca8279-1f20-45e1-b2df-60cd2835ee77-maas-api-tls\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.223559 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.223393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cca8279-1f20-45e1-b2df-60cd2835ee77-openshift-service-ca\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.223644 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.223555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqrmn\" (UniqueName: \"kubernetes.io/projected/9cca8279-1f20-45e1-b2df-60cd2835ee77-kube-api-access-gqrmn\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.224201 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.224176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cca8279-1f20-45e1-b2df-60cd2835ee77-openshift-service-ca\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.225873 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.225849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cca8279-1f20-45e1-b2df-60cd2835ee77-maas-api-tls\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.232968 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.232942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqrmn\" (UniqueName: \"kubernetes.io/projected/9cca8279-1f20-45e1-b2df-60cd2835ee77-kube-api-access-gqrmn\") pod \"maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.374335 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.374200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:41.533782 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.533756    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"]
Jul 10 18:44:41.535814 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:44:41.535783    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cca8279_1f20_45e1_b2df_60cd2835ee77.slice/crio-11c631a3f6af8fa4f839b34d83bd55b1eeeb89373d6804c8934669e24dd77236 WatchSource:0}: Error finding container 11c631a3f6af8fa4f839b34d83bd55b1eeeb89373d6804c8934669e24dd77236: Status 404 returned error can't find the container with id 11c631a3f6af8fa4f839b34d83bd55b1eeeb89373d6804c8934669e24dd77236
Jul 10 18:44:41.970927 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:41.970871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq" event={"ID":"9cca8279-1f20-45e1-b2df-60cd2835ee77","Type":"ContainerStarted","Data":"11c631a3f6af8fa4f839b34d83bd55b1eeeb89373d6804c8934669e24dd77236"}
Jul 10 18:44:42.977471 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:42.977413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq" event={"ID":"9cca8279-1f20-45e1-b2df-60cd2835ee77","Type":"ContainerStarted","Data":"388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e"}
Jul 10 18:44:42.977898 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:42.977495    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:42.998887 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:42.998833    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq" podStartSLOduration=1.600781487 podStartE2EDuration="1.998816405s" totalImagesPullingTime="398.034918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:44:42.997256858 +0000 UTC m=+1643.670172715" watchObservedRunningTime="2026-07-10 18:44:42.998816405 +0000 UTC m=+1643.671732209"
Jul 10 18:44:46.505494 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.505455    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"]
Jul 10 18:44:46.506187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.505677    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq" podUID="9cca8279-1f20-45e1-b2df-60cd2835ee77" containerName="maas-api" containerID="cri-o://388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e" gracePeriod=30
Jul 10 18:44:46.511672 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.511645    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:46.759451 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.759374    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:46.875162 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.875121    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cca8279-1f20-45e1-b2df-60cd2835ee77-maas-api-tls\") pod \"9cca8279-1f20-45e1-b2df-60cd2835ee77\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") "
Jul 10 18:44:46.875381 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.875201    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cca8279-1f20-45e1-b2df-60cd2835ee77-openshift-service-ca\") pod \"9cca8279-1f20-45e1-b2df-60cd2835ee77\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") "
Jul 10 18:44:46.875381 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.875268    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqrmn\" (UniqueName: \"kubernetes.io/projected/9cca8279-1f20-45e1-b2df-60cd2835ee77-kube-api-access-gqrmn\") pod \"9cca8279-1f20-45e1-b2df-60cd2835ee77\" (UID: \"9cca8279-1f20-45e1-b2df-60cd2835ee77\") "
Jul 10 18:44:46.875655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.875625    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cca8279-1f20-45e1-b2df-60cd2835ee77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9cca8279-1f20-45e1-b2df-60cd2835ee77" (UID: "9cca8279-1f20-45e1-b2df-60cd2835ee77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:44:46.877486 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.877453    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cca8279-1f20-45e1-b2df-60cd2835ee77-kube-api-access-gqrmn" (OuterVolumeSpecName: "kube-api-access-gqrmn") pod "9cca8279-1f20-45e1-b2df-60cd2835ee77" (UID: "9cca8279-1f20-45e1-b2df-60cd2835ee77"). InnerVolumeSpecName "kube-api-access-gqrmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:44:46.877486 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.877469    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cca8279-1f20-45e1-b2df-60cd2835ee77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9cca8279-1f20-45e1-b2df-60cd2835ee77" (UID: "9cca8279-1f20-45e1-b2df-60cd2835ee77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:44:46.976894 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.976861    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cca8279-1f20-45e1-b2df-60cd2835ee77-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:44:46.976894 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.976889    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cca8279-1f20-45e1-b2df-60cd2835ee77-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:44:46.976894 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:46.976898    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqrmn\" (UniqueName: \"kubernetes.io/projected/9cca8279-1f20-45e1-b2df-60cd2835ee77-kube-api-access-gqrmn\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:44:47.000701 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.000665    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cca8279-1f20-45e1-b2df-60cd2835ee77" containerID="388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e" exitCode=0
Jul 10 18:44:47.000864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.000711    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"
Jul 10 18:44:47.000864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.000747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq" event={"ID":"9cca8279-1f20-45e1-b2df-60cd2835ee77","Type":"ContainerDied","Data":"388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e"}
Jul 10 18:44:47.000864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.000803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq" event={"ID":"9cca8279-1f20-45e1-b2df-60cd2835ee77","Type":"ContainerDied","Data":"11c631a3f6af8fa4f839b34d83bd55b1eeeb89373d6804c8934669e24dd77236"}
Jul 10 18:44:47.000864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.000826    2577 scope.go:117] "RemoveContainer" containerID="388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e"
Jul 10 18:44:47.011345 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.011310    2577 scope.go:117] "RemoveContainer" containerID="388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e"
Jul 10 18:44:47.011739 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:44:47.011715    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e\": container with ID starting with 388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e not found: ID does not exist" containerID="388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e"
Jul 10 18:44:47.011832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.011750    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e"} err="failed to get container status \"388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e\": rpc error: code = NotFound desc = could not find container \"388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e\": container with ID starting with 388b4ca0114101a92c568b0f6b19ab6d131bf86fb6d243f1c0658226ef67779e not found: ID does not exist"
Jul 10 18:44:47.026697 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.026638    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"]
Jul 10 18:44:47.030102 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:47.030071    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dfa64c8-66c496755c-dwvtq"]
Jul 10 18:44:48.133703 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:48.133670    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cca8279-1f20-45e1-b2df-60cd2835ee77" path="/var/lib/kubelet/pods/9cca8279-1f20-45e1-b2df-60cd2835ee77/volumes"
Jul 10 18:44:59.784575 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.784536    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"]
Jul 10 18:44:59.785123 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.785100    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cca8279-1f20-45e1-b2df-60cd2835ee77" containerName="maas-api"
Jul 10 18:44:59.785197 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.785126    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cca8279-1f20-45e1-b2df-60cd2835ee77" containerName="maas-api"
Jul 10 18:44:59.785268 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.785247    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cca8279-1f20-45e1-b2df-60cd2835ee77" containerName="maas-api"
Jul 10 18:44:59.788347 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.788325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:44:59.790930 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.790907    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-199d1e45-serving-cert\""
Jul 10 18:44:59.797765 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.797731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"]
Jul 10 18:44:59.898502 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.898459    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95830d56-8795-4353-ba05-95ca009a9daf-maas-api-tls\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:44:59.898502 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.898507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95830d56-8795-4353-ba05-95ca009a9daf-openshift-service-ca\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:44:59.898760 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:44:59.898532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj8z5\" (UniqueName: \"kubernetes.io/projected/95830d56-8795-4353-ba05-95ca009a9daf-kube-api-access-nj8z5\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:00.000074 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.000030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95830d56-8795-4353-ba05-95ca009a9daf-maas-api-tls\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:00.000074 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.000073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95830d56-8795-4353-ba05-95ca009a9daf-openshift-service-ca\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:00.000388 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.000091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj8z5\" (UniqueName: \"kubernetes.io/projected/95830d56-8795-4353-ba05-95ca009a9daf-kube-api-access-nj8z5\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:00.000841 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.000814    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95830d56-8795-4353-ba05-95ca009a9daf-openshift-service-ca\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:00.002770 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.002742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95830d56-8795-4353-ba05-95ca009a9daf-maas-api-tls\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:00.009343 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.009313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj8z5\" (UniqueName: \"kubernetes.io/projected/95830d56-8795-4353-ba05-95ca009a9daf-kube-api-access-nj8z5\") pod \"maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:00.100618 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.100506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:00.145917 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.145867    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"]
Jul 10 18:45:00.149809 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.149776    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"]
Jul 10 18:45:00.149923 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.149894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"
Jul 10 18:45:00.152898 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.152869    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bw2j9\""
Jul 10 18:45:00.153654 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.153608    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"
Jul 10 18:45:00.160101 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.159960    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"]
Jul 10 18:45:00.166438 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.166394    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"]
Jul 10 18:45:00.172741 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.171213    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"
Jul 10 18:45:00.183600 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.183573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"
Jul 10 18:45:00.270610 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.269507    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"]
Jul 10 18:45:00.274122 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:45:00.273988    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95830d56_8795_4353_ba05_95ca009a9daf.slice/crio-b1b113b2436f4e663cb3bce7cec3ca346cfe9744c0098924b908217c0d92ea93 WatchSource:0}: Error finding container b1b113b2436f4e663cb3bce7cec3ca346cfe9744c0098924b908217c0d92ea93: Status 404 returned error can't find the container with id b1b113b2436f4e663cb3bce7cec3ca346cfe9744c0098924b908217c0d92ea93
Jul 10 18:45:00.371081 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.371046    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"]
Jul 10 18:45:00.374786 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:45:00.374742    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73fde1fc_a1f3_4fc4_b6e0_3fb06815eafe.slice/crio-5f31c8262cede1ef810d32fe9239e442f46c14a3c0c41c5f99137aaec1e8c638 WatchSource:0}: Error finding container 5f31c8262cede1ef810d32fe9239e442f46c14a3c0c41c5f99137aaec1e8c638: Status 404 returned error can't find the container with id 5f31c8262cede1ef810d32fe9239e442f46c14a3c0c41c5f99137aaec1e8c638
Jul 10 18:45:00.402806 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:00.402719    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"]
Jul 10 18:45:00.410427 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:45:00.410398    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436f6367_3f65_4b9f_829d_252eeab6895c.slice/crio-11e174b783e124288f2e5a3273013615739e50ec05276c2c01239b7cf84a0f3f WatchSource:0}: Error finding container 11e174b783e124288f2e5a3273013615739e50ec05276c2c01239b7cf84a0f3f: Status 404 returned error can't find the container with id 11e174b783e124288f2e5a3273013615739e50ec05276c2c01239b7cf84a0f3f
Jul 10 18:45:01.072461 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.072426    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf" event={"ID":"95830d56-8795-4353-ba05-95ca009a9daf","Type":"ContainerStarted","Data":"d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da"}
Jul 10 18:45:01.072939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.072486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf" event={"ID":"95830d56-8795-4353-ba05-95ca009a9daf","Type":"ContainerStarted","Data":"b1b113b2436f4e663cb3bce7cec3ca346cfe9744c0098924b908217c0d92ea93"}
Jul 10 18:45:01.072939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.072516    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:01.074158 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.074129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9" event={"ID":"73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe","Type":"ContainerStarted","Data":"a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807"}
Jul 10 18:45:01.074294 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.074185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9" event={"ID":"73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe","Type":"ContainerStarted","Data":"5f31c8262cede1ef810d32fe9239e442f46c14a3c0c41c5f99137aaec1e8c638"}
Jul 10 18:45:01.075603 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.075581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml" event={"ID":"436f6367-3f65-4b9f-829d-252eeab6895c","Type":"ContainerStarted","Data":"b0bbc7248aeb338dea6fc826d3542e84783361312772c106abcbb42b6ddcd8a4"}
Jul 10 18:45:01.075685 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.075625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml" event={"ID":"436f6367-3f65-4b9f-829d-252eeab6895c","Type":"ContainerStarted","Data":"11e174b783e124288f2e5a3273013615739e50ec05276c2c01239b7cf84a0f3f"}
Jul 10 18:45:01.090120 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.090055    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf" podStartSLOduration=1.630263289 podStartE2EDuration="2.090029495s" totalImagesPullingTime="459.766206ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:45:01.088938597 +0000 UTC m=+1661.761854397" watchObservedRunningTime="2026-07-10 18:45:01.090029495 +0000 UTC m=+1661.762945295"
Jul 10 18:45:01.111306 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.111211    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9" podStartSLOduration=1.111187634 podStartE2EDuration="1.111187634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:45:01.108346491 +0000 UTC m=+1661.781262290" watchObservedRunningTime="2026-07-10 18:45:01.111187634 +0000 UTC m=+1661.784103434"
Jul 10 18:45:01.124780 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:01.124720    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml" podStartSLOduration=1.124699971 podStartE2EDuration="1.124699971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:45:01.122845965 +0000 UTC m=+1661.795761765" watchObservedRunningTime="2026-07-10 18:45:01.124699971 +0000 UTC m=+1661.797615770"
Jul 10 18:45:02.082116 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:02.082083    2577 generic.go:356] "Generic (PLEG): container finished" podID="436f6367-3f65-4b9f-829d-252eeab6895c" containerID="b0bbc7248aeb338dea6fc826d3542e84783361312772c106abcbb42b6ddcd8a4" exitCode=7
Jul 10 18:45:02.082515 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:02.082172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml" event={"ID":"436f6367-3f65-4b9f-829d-252eeab6895c","Type":"ContainerDied","Data":"b0bbc7248aeb338dea6fc826d3542e84783361312772c106abcbb42b6ddcd8a4"}
Jul 10 18:45:02.082515 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:02.082318    2577 scope.go:117] "RemoveContainer" containerID="b0bbc7248aeb338dea6fc826d3542e84783361312772c106abcbb42b6ddcd8a4"
Jul 10 18:45:03.088566 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:03.088476    2577 generic.go:356] "Generic (PLEG): container finished" podID="436f6367-3f65-4b9f-829d-252eeab6895c" containerID="e22e6eb844e22c5d4ac5f5c580a3ad3ee5d713565d81106c7a197544d0c09da7" exitCode=7
Jul 10 18:45:03.088566 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:03.088547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml" event={"ID":"436f6367-3f65-4b9f-829d-252eeab6895c","Type":"ContainerDied","Data":"e22e6eb844e22c5d4ac5f5c580a3ad3ee5d713565d81106c7a197544d0c09da7"}
Jul 10 18:45:03.089029 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:03.088593    2577 scope.go:117] "RemoveContainer" containerID="b0bbc7248aeb338dea6fc826d3542e84783361312772c106abcbb42b6ddcd8a4"
Jul 10 18:45:03.089029 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:03.088717    2577 scope.go:117] "RemoveContainer" containerID="e22e6eb844e22c5d4ac5f5c580a3ad3ee5d713565d81106c7a197544d0c09da7"
Jul 10 18:45:03.089029 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:45:03.088964    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml_odh-ai-gateway-infra(436f6367-3f65-4b9f-829d-252eeab6895c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml" podUID="436f6367-3f65-4b9f-829d-252eeab6895c"
Jul 10 18:45:04.095631 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.095599    2577 scope.go:117] "RemoveContainer" containerID="e22e6eb844e22c5d4ac5f5c580a3ad3ee5d713565d81106c7a197544d0c09da7"
Jul 10 18:45:04.096021 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:45:04.095816    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml_odh-ai-gateway-infra(436f6367-3f65-4b9f-829d-252eeab6895c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml" podUID="436f6367-3f65-4b9f-829d-252eeab6895c"
Jul 10 18:45:04.518759 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.518720    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"]
Jul 10 18:45:04.519033 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.519001    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf" podUID="95830d56-8795-4353-ba05-95ca009a9daf" containerName="maas-api" containerID="cri-o://d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da" gracePeriod=30
Jul 10 18:45:04.558139 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.558100    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"]
Jul 10 18:45:04.776393 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.776313    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:04.843962 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.843928    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95830d56-8795-4353-ba05-95ca009a9daf-openshift-service-ca\") pod \"95830d56-8795-4353-ba05-95ca009a9daf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") "
Jul 10 18:45:04.844120 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.843987    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj8z5\" (UniqueName: \"kubernetes.io/projected/95830d56-8795-4353-ba05-95ca009a9daf-kube-api-access-nj8z5\") pod \"95830d56-8795-4353-ba05-95ca009a9daf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") "
Jul 10 18:45:04.844120 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.844030    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95830d56-8795-4353-ba05-95ca009a9daf-maas-api-tls\") pod \"95830d56-8795-4353-ba05-95ca009a9daf\" (UID: \"95830d56-8795-4353-ba05-95ca009a9daf\") "
Jul 10 18:45:04.844354 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.844324    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95830d56-8795-4353-ba05-95ca009a9daf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95830d56-8795-4353-ba05-95ca009a9daf" (UID: "95830d56-8795-4353-ba05-95ca009a9daf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:45:04.846111 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.846075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95830d56-8795-4353-ba05-95ca009a9daf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95830d56-8795-4353-ba05-95ca009a9daf" (UID: "95830d56-8795-4353-ba05-95ca009a9daf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:45:04.846236 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.846134    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95830d56-8795-4353-ba05-95ca009a9daf-kube-api-access-nj8z5" (OuterVolumeSpecName: "kube-api-access-nj8z5") pod "95830d56-8795-4353-ba05-95ca009a9daf" (UID: "95830d56-8795-4353-ba05-95ca009a9daf"). InnerVolumeSpecName "kube-api-access-nj8z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:45:04.944869 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.944827    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95830d56-8795-4353-ba05-95ca009a9daf-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:45:04.944869 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.944859    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj8z5\" (UniqueName: \"kubernetes.io/projected/95830d56-8795-4353-ba05-95ca009a9daf-kube-api-access-nj8z5\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:45:04.944869 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:04.944872    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95830d56-8795-4353-ba05-95ca009a9daf-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:45:05.101289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.101180    2577 generic.go:356] "Generic (PLEG): container finished" podID="95830d56-8795-4353-ba05-95ca009a9daf" containerID="d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da" exitCode=0
Jul 10 18:45:05.101289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.101251    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"
Jul 10 18:45:05.101289 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.101275    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf" event={"ID":"95830d56-8795-4353-ba05-95ca009a9daf","Type":"ContainerDied","Data":"d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da"}
Jul 10 18:45:05.101814 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.101336    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf" event={"ID":"95830d56-8795-4353-ba05-95ca009a9daf","Type":"ContainerDied","Data":"b1b113b2436f4e663cb3bce7cec3ca346cfe9744c0098924b908217c0d92ea93"}
Jul 10 18:45:05.101814 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.101360    2577 scope.go:117] "RemoveContainer" containerID="d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da"
Jul 10 18:45:05.112976 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.112949    2577 scope.go:117] "RemoveContainer" containerID="d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da"
Jul 10 18:45:05.113337 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:45:05.113316    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da\": container with ID starting with d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da not found: ID does not exist" containerID="d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da"
Jul 10 18:45:05.113411 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.113347    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da"} err="failed to get container status \"d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da\": rpc error: code = NotFound desc = could not find container \"d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da\": container with ID starting with d224257bb6cf01f7c390aab4fdd6e20666dee96d315bbc61c9b77639483ed3da not found: ID does not exist"
Jul 10 18:45:05.133874 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.133838    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"]
Jul 10 18:45:05.137503 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.137471    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-199d1e45-d7c75c6fd-lvzzf"]
Jul 10 18:45:05.230793 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:05.230762    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"
Jul 10 18:45:06.107673 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:06.107642    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"
Jul 10 18:45:06.108109 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:06.107640    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml" event={"ID":"436f6367-3f65-4b9f-829d-252eeab6895c","Type":"ContainerDied","Data":"11e174b783e124288f2e5a3273013615739e50ec05276c2c01239b7cf84a0f3f"}
Jul 10 18:45:06.108109 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:06.107780    2577 scope.go:117] "RemoveContainer" containerID="e22e6eb844e22c5d4ac5f5c580a3ad3ee5d713565d81106c7a197544d0c09da7"
Jul 10 18:45:06.134622 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:06.134585    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95830d56-8795-4353-ba05-95ca009a9daf" path="/var/lib/kubelet/pods/95830d56-8795-4353-ba05-95ca009a9daf/volumes"
Jul 10 18:45:06.134905 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:06.134890    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"]
Jul 10 18:45:06.136010 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:06.135990    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-199d1e45-29728485-v4bml"]
Jul 10 18:45:08.133277 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:45:08.133242    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="436f6367-3f65-4b9f-829d-252eeab6895c" path="/var/lib/kubelet/pods/436f6367-3f65-4b9f-829d-252eeab6895c/volumes"
Jul 10 18:46:00.010977 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:00.010892    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"]
Jul 10 18:46:00.011478 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:00.011116    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9" podUID="73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe" containerName="cleanup" containerID="cri-o://a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807" gracePeriod=30
Jul 10 18:46:30.188302 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.188272    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"
Jul 10 18:46:30.525369 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.525336    2577 generic.go:356] "Generic (PLEG): container finished" podID="73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe" containerID="a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807" exitCode=137
Jul 10 18:46:30.525549 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.525377    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"
Jul 10 18:46:30.525549 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.525418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9" event={"ID":"73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe","Type":"ContainerDied","Data":"a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807"}
Jul 10 18:46:30.525549 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.525474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9" event={"ID":"73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe","Type":"ContainerDied","Data":"5f31c8262cede1ef810d32fe9239e442f46c14a3c0c41c5f99137aaec1e8c638"}
Jul 10 18:46:30.525549 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.525503    2577 scope.go:117] "RemoveContainer" containerID="a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807"
Jul 10 18:46:30.534742 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.534720    2577 scope.go:117] "RemoveContainer" containerID="a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807"
Jul 10 18:46:30.535060 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:46:30.535040    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807\": container with ID starting with a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807 not found: ID does not exist" containerID="a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807"
Jul 10 18:46:30.535110 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.535072    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807"} err="failed to get container status \"a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807\": rpc error: code = NotFound desc = could not find container \"a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807\": container with ID starting with a46bf330d4685cdc7e79e435ef5cbc14af0913b65b349b1271a8249fbab77807 not found: ID does not exist"
Jul 10 18:46:30.547189 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.547153    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"]
Jul 10 18:46:30.551453 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:30.551425    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728485-pxvq9"]
Jul 10 18:46:32.132685 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:32.132647    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe" path="/var/lib/kubelet/pods/73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe/volumes"
Jul 10 18:46:50.782411 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.782370    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"]
Jul 10 18:46:50.783062 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.782950    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436f6367-3f65-4b9f-829d-252eeab6895c" containerName="cleanup"
Jul 10 18:46:50.783062 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.782971    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="436f6367-3f65-4b9f-829d-252eeab6895c" containerName="cleanup"
Jul 10 18:46:50.783062 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.783003    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95830d56-8795-4353-ba05-95ca009a9daf" containerName="maas-api"
Jul 10 18:46:50.783062 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.783013    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="95830d56-8795-4353-ba05-95ca009a9daf" containerName="maas-api"
Jul 10 18:46:50.783062 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.783035    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe" containerName="cleanup"
Jul 10 18:46:50.783062 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.783044    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe" containerName="cleanup"
Jul 10 18:46:50.783386 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.783133    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="95830d56-8795-4353-ba05-95ca009a9daf" containerName="maas-api"
Jul 10 18:46:50.783386 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.783146    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="73fde1fc-a1f3-4fc4-b6e0-3fb06815eafe" containerName="cleanup"
Jul 10 18:46:50.783386 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.783156    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="436f6367-3f65-4b9f-829d-252eeab6895c" containerName="cleanup"
Jul 10 18:46:50.783386 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.783167    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="436f6367-3f65-4b9f-829d-252eeab6895c" containerName="cleanup"
Jul 10 18:46:50.786574 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.786550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:50.788918 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.788889    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7f824989-serving-cert\""
Jul 10 18:46:50.798354 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.798313    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"]
Jul 10 18:46:50.904636 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.904595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:50.904636 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.904645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3550620d-08c5-4d8d-be7d-41bd349da47f-openshift-service-ca\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:50.904880 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:50.904705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqlfl\" (UniqueName: \"kubernetes.io/projected/3550620d-08c5-4d8d-be7d-41bd349da47f-kube-api-access-pqlfl\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.006059 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.006015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.006059 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.006066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3550620d-08c5-4d8d-be7d-41bd349da47f-openshift-service-ca\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.006393 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.006173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqlfl\" (UniqueName: \"kubernetes.io/projected/3550620d-08c5-4d8d-be7d-41bd349da47f-kube-api-access-pqlfl\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.006393 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:46:51.006194    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-serving-cert: secret "maas-api-e2e-mt-7f824989-serving-cert" not found
Jul 10 18:46:51.006393 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:46:51.006312    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls podName:3550620d-08c5-4d8d-be7d-41bd349da47f nodeName:}" failed. No retries permitted until 2026-07-10 18:46:51.506288829 +0000 UTC m=+1772.179204623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls") pod "maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj" (UID: "3550620d-08c5-4d8d-be7d-41bd349da47f") : secret "maas-api-e2e-mt-7f824989-serving-cert" not found
Jul 10 18:46:51.006791 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.006768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3550620d-08c5-4d8d-be7d-41bd349da47f-openshift-service-ca\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.025380 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.025338    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqlfl\" (UniqueName: \"kubernetes.io/projected/3550620d-08c5-4d8d-be7d-41bd349da47f-kube-api-access-pqlfl\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.510759 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.510715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.513356 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.513323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls\") pod \"maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.698745 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.698700    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:51.846020 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:51.845994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"]
Jul 10 18:46:51.848467 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:46:51.848438    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3550620d_08c5_4d8d_be7d_41bd349da47f.slice/crio-bfa04f82fd8b30af62a892ab842474cf8f100a5ce137d7be4ead9a1e181aa0c7 WatchSource:0}: Error finding container bfa04f82fd8b30af62a892ab842474cf8f100a5ce137d7be4ead9a1e181aa0c7: Status 404 returned error can't find the container with id bfa04f82fd8b30af62a892ab842474cf8f100a5ce137d7be4ead9a1e181aa0c7
Jul 10 18:46:52.637476 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:52.637387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj" event={"ID":"3550620d-08c5-4d8d-be7d-41bd349da47f","Type":"ContainerStarted","Data":"2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d"}
Jul 10 18:46:52.637476 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:52.637442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj" event={"ID":"3550620d-08c5-4d8d-be7d-41bd349da47f","Type":"ContainerStarted","Data":"bfa04f82fd8b30af62a892ab842474cf8f100a5ce137d7be4ead9a1e181aa0c7"}
Jul 10 18:46:52.637688 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:52.637517    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:46:52.657312 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:52.657254    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj" podStartSLOduration=2.286531718 podStartE2EDuration="2.65721687s" totalImagesPullingTime="370.685152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:46:52.656594953 +0000 UTC m=+1773.329510770" watchObservedRunningTime="2026-07-10 18:46:52.65721687 +0000 UTC m=+1773.330132702"
Jul 10 18:46:58.648738 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:46:58.648703    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:47:02.995788 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:02.995750    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"]
Jul 10 18:47:02.996263 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:02.995963    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj" podUID="3550620d-08c5-4d8d-be7d-41bd349da47f" containerName="maas-api" containerID="cri-o://2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d" gracePeriod=30
Jul 10 18:47:03.253647 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.253581    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:47:03.417400 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.417356    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3550620d-08c5-4d8d-be7d-41bd349da47f-openshift-service-ca\") pod \"3550620d-08c5-4d8d-be7d-41bd349da47f\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") "
Jul 10 18:47:03.417400 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.417408    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls\") pod \"3550620d-08c5-4d8d-be7d-41bd349da47f\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") "
Jul 10 18:47:03.417684 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.417430    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqlfl\" (UniqueName: \"kubernetes.io/projected/3550620d-08c5-4d8d-be7d-41bd349da47f-kube-api-access-pqlfl\") pod \"3550620d-08c5-4d8d-be7d-41bd349da47f\" (UID: \"3550620d-08c5-4d8d-be7d-41bd349da47f\") "
Jul 10 18:47:03.417859 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.417836    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3550620d-08c5-4d8d-be7d-41bd349da47f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3550620d-08c5-4d8d-be7d-41bd349da47f" (UID: "3550620d-08c5-4d8d-be7d-41bd349da47f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:47:03.419587 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.419561    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3550620d-08c5-4d8d-be7d-41bd349da47f" (UID: "3550620d-08c5-4d8d-be7d-41bd349da47f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:47:03.419669 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.419593    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3550620d-08c5-4d8d-be7d-41bd349da47f-kube-api-access-pqlfl" (OuterVolumeSpecName: "kube-api-access-pqlfl") pod "3550620d-08c5-4d8d-be7d-41bd349da47f" (UID: "3550620d-08c5-4d8d-be7d-41bd349da47f"). InnerVolumeSpecName "kube-api-access-pqlfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:47:03.518974 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.518866    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3550620d-08c5-4d8d-be7d-41bd349da47f-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:47:03.518974 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.518899    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3550620d-08c5-4d8d-be7d-41bd349da47f-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:47:03.518974 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.518911    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqlfl\" (UniqueName: \"kubernetes.io/projected/3550620d-08c5-4d8d-be7d-41bd349da47f-kube-api-access-pqlfl\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:47:03.695567 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.695533    2577 generic.go:356] "Generic (PLEG): container finished" podID="3550620d-08c5-4d8d-be7d-41bd349da47f" containerID="2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d" exitCode=0
Jul 10 18:47:03.695567 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.695569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj" event={"ID":"3550620d-08c5-4d8d-be7d-41bd349da47f","Type":"ContainerDied","Data":"2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d"}
Jul 10 18:47:03.695838 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.695585    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"
Jul 10 18:47:03.695838 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.695611    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj" event={"ID":"3550620d-08c5-4d8d-be7d-41bd349da47f","Type":"ContainerDied","Data":"bfa04f82fd8b30af62a892ab842474cf8f100a5ce137d7be4ead9a1e181aa0c7"}
Jul 10 18:47:03.695838 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.695633    2577 scope.go:117] "RemoveContainer" containerID="2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d"
Jul 10 18:47:03.705342 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.705322    2577 scope.go:117] "RemoveContainer" containerID="2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d"
Jul 10 18:47:03.705680 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:47:03.705660    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d\": container with ID starting with 2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d not found: ID does not exist" containerID="2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d"
Jul 10 18:47:03.705757 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.705691    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d"} err="failed to get container status \"2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d\": rpc error: code = NotFound desc = could not find container \"2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d\": container with ID starting with 2741b02390908e0e4bda0f0d52a92a3248447b98c02bfda63783f1db22c0ae7d not found: ID does not exist"
Jul 10 18:47:03.722697 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.720750    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"]
Jul 10 18:47:03.725913 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:03.725881    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7f824989-7c4d9d4bf9-26fcj"]
Jul 10 18:47:04.132481 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:04.132420    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3550620d-08c5-4d8d-be7d-41bd349da47f" path="/var/lib/kubelet/pods/3550620d-08c5-4d8d-be7d-41bd349da47f/volumes"
Jul 10 18:47:20.075023 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:20.074991    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:47:20.078606 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:20.078580    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:47:32.985136 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:32.985098    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"]
Jul 10 18:47:32.985629 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:32.985510    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436f6367-3f65-4b9f-829d-252eeab6895c" containerName="cleanup"
Jul 10 18:47:32.985629 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:32.985524    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="436f6367-3f65-4b9f-829d-252eeab6895c" containerName="cleanup"
Jul 10 18:47:32.985629 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:32.985531    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3550620d-08c5-4d8d-be7d-41bd349da47f" containerName="maas-api"
Jul 10 18:47:32.985629 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:32.985537    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3550620d-08c5-4d8d-be7d-41bd349da47f" containerName="maas-api"
Jul 10 18:47:32.985629 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:32.985624    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3550620d-08c5-4d8d-be7d-41bd349da47f" containerName="maas-api"
Jul 10 18:47:32.990045 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:32.990017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:32.992943 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:32.992918    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0a09b19d-serving-cert\""
Jul 10 18:47:33.058807 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.058774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"]
Jul 10 18:47:33.083693 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.083655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54220b32-afec-451b-a0b3-d90f7ad89ce8-openshift-service-ca\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.083894 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.083706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9htw\" (UniqueName: \"kubernetes.io/projected/54220b32-afec-451b-a0b3-d90f7ad89ce8-kube-api-access-n9htw\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.083894 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.083742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54220b32-afec-451b-a0b3-d90f7ad89ce8-maas-api-tls\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.185152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.185114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54220b32-afec-451b-a0b3-d90f7ad89ce8-openshift-service-ca\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.185389 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.185174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9htw\" (UniqueName: \"kubernetes.io/projected/54220b32-afec-451b-a0b3-d90f7ad89ce8-kube-api-access-n9htw\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.185389 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.185212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54220b32-afec-451b-a0b3-d90f7ad89ce8-maas-api-tls\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.185892 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.185868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54220b32-afec-451b-a0b3-d90f7ad89ce8-openshift-service-ca\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.187754 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.187733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54220b32-afec-451b-a0b3-d90f7ad89ce8-maas-api-tls\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.208212 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.208175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9htw\" (UniqueName: \"kubernetes.io/projected/54220b32-afec-451b-a0b3-d90f7ad89ce8-kube-api-access-n9htw\") pod \"maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.303068 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.302964    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:33.452849 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.452804    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"]
Jul 10 18:47:33.456096 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:47:33.456063    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54220b32_afec_451b_a0b3_d90f7ad89ce8.slice/crio-92758ac8b3187d255052dfe77798e2f9b4bf7b9f4d5f3d23c07dd1dc64cdbafc WatchSource:0}: Error finding container 92758ac8b3187d255052dfe77798e2f9b4bf7b9f4d5f3d23c07dd1dc64cdbafc: Status 404 returned error can't find the container with id 92758ac8b3187d255052dfe77798e2f9b4bf7b9f4d5f3d23c07dd1dc64cdbafc
Jul 10 18:47:33.846163 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:33.846129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6" event={"ID":"54220b32-afec-451b-a0b3-d90f7ad89ce8","Type":"ContainerStarted","Data":"92758ac8b3187d255052dfe77798e2f9b4bf7b9f4d5f3d23c07dd1dc64cdbafc"}
Jul 10 18:47:34.852823 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:34.852785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6" event={"ID":"54220b32-afec-451b-a0b3-d90f7ad89ce8","Type":"ContainerStarted","Data":"135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac"}
Jul 10 18:47:34.853340 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:34.852944    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:47:34.872069 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:34.872012    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6" podStartSLOduration=2.533297878 podStartE2EDuration="2.87199568s" totalImagesPullingTime="338.697802ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:47:34.871835312 +0000 UTC m=+1815.544751109" watchObservedRunningTime="2026-07-10 18:47:34.87199568 +0000 UTC m=+1815.544911479"
Jul 10 18:47:40.864022 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:47:40.863993    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:48:15.543318 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.543276    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"]
Jul 10 18:48:15.543878 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.543569    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6" podUID="54220b32-afec-451b-a0b3-d90f7ad89ce8" containerName="maas-api" containerID="cri-o://135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac" gracePeriod=30
Jul 10 18:48:15.795558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.795486    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:48:15.870759 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.870721    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54220b32-afec-451b-a0b3-d90f7ad89ce8-openshift-service-ca\") pod \"54220b32-afec-451b-a0b3-d90f7ad89ce8\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") "
Jul 10 18:48:15.870920 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.870773    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9htw\" (UniqueName: \"kubernetes.io/projected/54220b32-afec-451b-a0b3-d90f7ad89ce8-kube-api-access-n9htw\") pod \"54220b32-afec-451b-a0b3-d90f7ad89ce8\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") "
Jul 10 18:48:15.870920 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.870808    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54220b32-afec-451b-a0b3-d90f7ad89ce8-maas-api-tls\") pod \"54220b32-afec-451b-a0b3-d90f7ad89ce8\" (UID: \"54220b32-afec-451b-a0b3-d90f7ad89ce8\") "
Jul 10 18:48:15.871110 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.871086    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54220b32-afec-451b-a0b3-d90f7ad89ce8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54220b32-afec-451b-a0b3-d90f7ad89ce8" (UID: "54220b32-afec-451b-a0b3-d90f7ad89ce8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:48:15.872865 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.872837    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54220b32-afec-451b-a0b3-d90f7ad89ce8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54220b32-afec-451b-a0b3-d90f7ad89ce8" (UID: "54220b32-afec-451b-a0b3-d90f7ad89ce8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:48:15.872968 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.872869    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54220b32-afec-451b-a0b3-d90f7ad89ce8-kube-api-access-n9htw" (OuterVolumeSpecName: "kube-api-access-n9htw") pod "54220b32-afec-451b-a0b3-d90f7ad89ce8" (UID: "54220b32-afec-451b-a0b3-d90f7ad89ce8"). InnerVolumeSpecName "kube-api-access-n9htw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:48:15.972420 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.972383    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54220b32-afec-451b-a0b3-d90f7ad89ce8-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:48:15.972420 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.972416    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9htw\" (UniqueName: \"kubernetes.io/projected/54220b32-afec-451b-a0b3-d90f7ad89ce8-kube-api-access-n9htw\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:48:15.972420 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:15.972428    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54220b32-afec-451b-a0b3-d90f7ad89ce8-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:48:16.050791 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.050700    2577 generic.go:356] "Generic (PLEG): container finished" podID="54220b32-afec-451b-a0b3-d90f7ad89ce8" containerID="135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac" exitCode=0
Jul 10 18:48:16.050791 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.050750    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"
Jul 10 18:48:16.050970 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.050788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6" event={"ID":"54220b32-afec-451b-a0b3-d90f7ad89ce8","Type":"ContainerDied","Data":"135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac"}
Jul 10 18:48:16.050970 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.050849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6" event={"ID":"54220b32-afec-451b-a0b3-d90f7ad89ce8","Type":"ContainerDied","Data":"92758ac8b3187d255052dfe77798e2f9b4bf7b9f4d5f3d23c07dd1dc64cdbafc"}
Jul 10 18:48:16.050970 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.050878    2577 scope.go:117] "RemoveContainer" containerID="135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac"
Jul 10 18:48:16.060383 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.060361    2577 scope.go:117] "RemoveContainer" containerID="135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac"
Jul 10 18:48:16.060687 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:48:16.060668    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac\": container with ID starting with 135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac not found: ID does not exist" containerID="135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac"
Jul 10 18:48:16.060749 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.060695    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac"} err="failed to get container status \"135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac\": rpc error: code = NotFound desc = could not find container \"135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac\": container with ID starting with 135ddf50cb01be77e8c4682ce5b6d2a4660d15094cf6d6fc840e5e2b1db66aac not found: ID does not exist"
Jul 10 18:48:16.072876 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.072837    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"]
Jul 10 18:48:16.077783 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.077754    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a09b19d-d9c4d9846-2khm6"]
Jul 10 18:48:16.133623 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:48:16.133584    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54220b32-afec-451b-a0b3-d90f7ad89ce8" path="/var/lib/kubelet/pods/54220b32-afec-451b-a0b3-d90f7ad89ce8/volumes"
Jul 10 18:50:07.687642 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.687606    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"]
Jul 10 18:50:07.688293 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.688038    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54220b32-afec-451b-a0b3-d90f7ad89ce8" containerName="maas-api"
Jul 10 18:50:07.688293 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.688055    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54220b32-afec-451b-a0b3-d90f7ad89ce8" containerName="maas-api"
Jul 10 18:50:07.688293 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.688126    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="54220b32-afec-451b-a0b3-d90f7ad89ce8" containerName="maas-api"
Jul 10 18:50:07.691252 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.691231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.699873 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.699845    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-bee2bc-serving-cert\""
Jul 10 18:50:07.700093 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.700069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/397b39ed-6254-4e3a-8542-97169c789636-maas-api-tls\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.700188 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.700165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/397b39ed-6254-4e3a-8542-97169c789636-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.700267 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.700210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghggr\" (UniqueName: \"kubernetes.io/projected/397b39ed-6254-4e3a-8542-97169c789636-kube-api-access-ghggr\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.712734 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.712699    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"]
Jul 10 18:50:07.800784 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.800746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/397b39ed-6254-4e3a-8542-97169c789636-maas-api-tls\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.801006 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.800828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/397b39ed-6254-4e3a-8542-97169c789636-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.801006 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.800857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghggr\" (UniqueName: \"kubernetes.io/projected/397b39ed-6254-4e3a-8542-97169c789636-kube-api-access-ghggr\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.801579 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.801545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/397b39ed-6254-4e3a-8542-97169c789636-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.803330 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.803309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/397b39ed-6254-4e3a-8542-97169c789636-maas-api-tls\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:07.818362 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:07.818334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghggr\" (UniqueName: \"kubernetes.io/projected/397b39ed-6254-4e3a-8542-97169c789636-kube-api-access-ghggr\") pod \"maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:08.002771 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:08.002655    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:08.149788 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:08.149757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"]
Jul 10 18:50:08.151561 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:50:08.151532    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397b39ed_6254_4e3a_8542_97169c789636.slice/crio-66c41482ca2948091ebb80cb77169ab0455e2eb8f631ff532c5892c506a635f7 WatchSource:0}: Error finding container 66c41482ca2948091ebb80cb77169ab0455e2eb8f631ff532c5892c506a635f7: Status 404 returned error can't find the container with id 66c41482ca2948091ebb80cb77169ab0455e2eb8f631ff532c5892c506a635f7
Jul 10 18:50:08.152832 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:08.152814    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:50:08.608414 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:08.608371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89" event={"ID":"397b39ed-6254-4e3a-8542-97169c789636","Type":"ContainerStarted","Data":"66c41482ca2948091ebb80cb77169ab0455e2eb8f631ff532c5892c506a635f7"}
Jul 10 18:50:09.614185 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:09.614147    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89" event={"ID":"397b39ed-6254-4e3a-8542-97169c789636","Type":"ContainerStarted","Data":"1d15f0ca260a02084b3bab88ee2d3651fee6bcf7a1d53b0065a897f53745f9d2"}
Jul 10 18:50:09.614603 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:09.614214    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:09.632827 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:09.632779    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89" podStartSLOduration=2.213846995 podStartE2EDuration="2.632762003s" totalImagesPullingTime="418.915008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:50:09.63187817 +0000 UTC m=+1970.304793990" watchObservedRunningTime="2026-07-10 18:50:09.632762003 +0000 UTC m=+1970.305677802"
Jul 10 18:50:15.624670 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.624587    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:50:15.705024 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.704994    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"]
Jul 10 18:50:15.708835 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.708812    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:15.711800 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.711775    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-9a1ca1-serving-cert\""
Jul 10 18:50:15.718654 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.718197    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"]
Jul 10 18:50:15.764018 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.763984    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:15.764192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.764052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:15.764192 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.764092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592wf\" (UniqueName: \"kubernetes.io/projected/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-kube-api-access-592wf\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:15.864679 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.864643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592wf\" (UniqueName: \"kubernetes.io/projected/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-kube-api-access-592wf\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:15.864868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.864731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:15.864868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.864773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:15.864979 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:50:15.864962    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-serving-cert: secret "maas-api-e2e-inf-b-9a1ca1-serving-cert" not found
Jul 10 18:50:15.865047 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:50:15.865035    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls podName:ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8 nodeName:}" failed. No retries permitted until 2026-07-10 18:50:16.365017723 +0000 UTC m=+1977.037933505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls") pod "maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt" (UID: "ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8") : secret "maas-api-e2e-inf-b-9a1ca1-serving-cert" not found
Jul 10 18:50:15.865604 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.865582    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:15.873990 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:15.873961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-592wf\" (UniqueName: \"kubernetes.io/projected/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-kube-api-access-592wf\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:16.368282 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:16.368243    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:16.371255 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:16.371194    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:16.623951 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:16.623856    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:16.775915 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:16.775736    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"]
Jul 10 18:50:16.778970 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:50:16.778928    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce230bf3_8c4e_4f9c_a3a6_12dff50e09e8.slice/crio-5fec3fb5540e1cdb81ab15f96867b0f288d10d8b0fdb5dac92ca3721cd94ba70 WatchSource:0}: Error finding container 5fec3fb5540e1cdb81ab15f96867b0f288d10d8b0fdb5dac92ca3721cd94ba70: Status 404 returned error can't find the container with id 5fec3fb5540e1cdb81ab15f96867b0f288d10d8b0fdb5dac92ca3721cd94ba70
Jul 10 18:50:17.656071 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:17.655978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt" event={"ID":"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8","Type":"ContainerStarted","Data":"551328882f836ac94628f339bfa8ff624568fcb36d80e2f13c3a445182afe7e4"}
Jul 10 18:50:17.656272 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:17.656069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt" event={"ID":"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8","Type":"ContainerStarted","Data":"5fec3fb5540e1cdb81ab15f96867b0f288d10d8b0fdb5dac92ca3721cd94ba70"}
Jul 10 18:50:17.656272 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:17.656202    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:50:17.675690 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:17.675634    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt" podStartSLOduration=2.261462636 podStartE2EDuration="2.675618109s" totalImagesPullingTime="414.155473ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:50:17.674194519 +0000 UTC m=+1978.347110319" watchObservedRunningTime="2026-07-10 18:50:17.675618109 +0000 UTC m=+1978.348533939"
Jul 10 18:50:23.667067 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:50:23.667036    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:51:46.900433 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:46.900315    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"]
Jul 10 18:51:46.901036 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:46.900916    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89" podUID="397b39ed-6254-4e3a-8542-97169c789636" containerName="maas-api" containerID="cri-o://1d15f0ca260a02084b3bab88ee2d3651fee6bcf7a1d53b0065a897f53745f9d2" gracePeriod=30
Jul 10 18:51:47.112560 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.112527    2577 generic.go:356] "Generic (PLEG): container finished" podID="397b39ed-6254-4e3a-8542-97169c789636" containerID="1d15f0ca260a02084b3bab88ee2d3651fee6bcf7a1d53b0065a897f53745f9d2" exitCode=0
Jul 10 18:51:47.112753 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.112603    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89" event={"ID":"397b39ed-6254-4e3a-8542-97169c789636","Type":"ContainerDied","Data":"1d15f0ca260a02084b3bab88ee2d3651fee6bcf7a1d53b0065a897f53745f9d2"}
Jul 10 18:51:47.166966 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.166936    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:51:47.294731 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.294680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghggr\" (UniqueName: \"kubernetes.io/projected/397b39ed-6254-4e3a-8542-97169c789636-kube-api-access-ghggr\") pod \"397b39ed-6254-4e3a-8542-97169c789636\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") "
Jul 10 18:51:47.294935 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.294775    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/397b39ed-6254-4e3a-8542-97169c789636-maas-api-tls\") pod \"397b39ed-6254-4e3a-8542-97169c789636\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") "
Jul 10 18:51:47.294935 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.294867    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/397b39ed-6254-4e3a-8542-97169c789636-openshift-service-ca\") pod \"397b39ed-6254-4e3a-8542-97169c789636\" (UID: \"397b39ed-6254-4e3a-8542-97169c789636\") "
Jul 10 18:51:47.295282 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.295257    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397b39ed-6254-4e3a-8542-97169c789636-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "397b39ed-6254-4e3a-8542-97169c789636" (UID: "397b39ed-6254-4e3a-8542-97169c789636"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:51:47.296959 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.296935    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397b39ed-6254-4e3a-8542-97169c789636-kube-api-access-ghggr" (OuterVolumeSpecName: "kube-api-access-ghggr") pod "397b39ed-6254-4e3a-8542-97169c789636" (UID: "397b39ed-6254-4e3a-8542-97169c789636"). InnerVolumeSpecName "kube-api-access-ghggr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:51:47.296959 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.296947    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b39ed-6254-4e3a-8542-97169c789636-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "397b39ed-6254-4e3a-8542-97169c789636" (UID: "397b39ed-6254-4e3a-8542-97169c789636"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:51:47.396580 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.396533    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghggr\" (UniqueName: \"kubernetes.io/projected/397b39ed-6254-4e3a-8542-97169c789636-kube-api-access-ghggr\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:51:47.396580 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.396570    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/397b39ed-6254-4e3a-8542-97169c789636-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:51:47.396580 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:47.396579    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/397b39ed-6254-4e3a-8542-97169c789636-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:51:48.119103 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:48.119066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89" event={"ID":"397b39ed-6254-4e3a-8542-97169c789636","Type":"ContainerDied","Data":"66c41482ca2948091ebb80cb77169ab0455e2eb8f631ff532c5892c506a635f7"}
Jul 10 18:51:48.119582 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:48.119129    2577 scope.go:117] "RemoveContainer" containerID="1d15f0ca260a02084b3bab88ee2d3651fee6bcf7a1d53b0065a897f53745f9d2"
Jul 10 18:51:48.119582 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:48.119079    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"
Jul 10 18:51:48.142655 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:48.142618    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"]
Jul 10 18:51:48.145949 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:48.145919    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bee2bc-5b6d6b7dbf-8jc89"]
Jul 10 18:51:50.134370 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:51:50.134336    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="397b39ed-6254-4e3a-8542-97169c789636" path="/var/lib/kubelet/pods/397b39ed-6254-4e3a-8542-97169c789636/volumes"
Jul 10 18:52:20.104754 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:20.104721    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:52:20.109433 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:20.109406    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:52:30.147254 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.147206    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"]
Jul 10 18:52:30.147751 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.147436    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt" podUID="ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" containerName="maas-api" containerID="cri-o://551328882f836ac94628f339bfa8ff624568fcb36d80e2f13c3a445182afe7e4" gracePeriod=30
Jul 10 18:52:30.330542 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.330508    2577 generic.go:356] "Generic (PLEG): container finished" podID="ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" containerID="551328882f836ac94628f339bfa8ff624568fcb36d80e2f13c3a445182afe7e4" exitCode=0
Jul 10 18:52:30.330731 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.330550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt" event={"ID":"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8","Type":"ContainerDied","Data":"551328882f836ac94628f339bfa8ff624568fcb36d80e2f13c3a445182afe7e4"}
Jul 10 18:52:30.403016 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.402935    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:52:30.469590 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.469536    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls\") pod \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") "
Jul 10 18:52:30.469590 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.469594    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-openshift-service-ca\") pod \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") "
Jul 10 18:52:30.469811 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.469631    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-592wf\" (UniqueName: \"kubernetes.io/projected/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-kube-api-access-592wf\") pod \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\" (UID: \"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8\") "
Jul 10 18:52:30.469976 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.469941    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" (UID: "ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:52:30.471844 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.471816    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-kube-api-access-592wf" (OuterVolumeSpecName: "kube-api-access-592wf") pod "ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" (UID: "ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8"). InnerVolumeSpecName "kube-api-access-592wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:52:30.471916 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.471820    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" (UID: "ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:52:30.570984 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.570951    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:52:30.570984 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.570979    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:52:30.571203 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:30.570999    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-592wf\" (UniqueName: \"kubernetes.io/projected/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8-kube-api-access-592wf\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:52:31.344433 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:31.344405    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"
Jul 10 18:52:31.344433 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:31.344414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt" event={"ID":"ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8","Type":"ContainerDied","Data":"5fec3fb5540e1cdb81ab15f96867b0f288d10d8b0fdb5dac92ca3721cd94ba70"}
Jul 10 18:52:31.345029 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:31.344514    2577 scope.go:117] "RemoveContainer" containerID="551328882f836ac94628f339bfa8ff624568fcb36d80e2f13c3a445182afe7e4"
Jul 10 18:52:31.369381 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:31.369345    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"]
Jul 10 18:52:31.374985 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:31.374949    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9a1ca1-7779d57fdc-mh7vt"]
Jul 10 18:52:32.132689 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:32.132655    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" path="/var/lib/kubelet/pods/ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8/volumes"
Jul 10 18:52:39.454864 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.454824    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"]
Jul 10 18:52:39.455441 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.455392    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b39ed-6254-4e3a-8542-97169c789636" containerName="maas-api"
Jul 10 18:52:39.455441 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.455413    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b39ed-6254-4e3a-8542-97169c789636" containerName="maas-api"
Jul 10 18:52:39.455441 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.455436    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" containerName="maas-api"
Jul 10 18:52:39.455441 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.455444    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" containerName="maas-api"
Jul 10 18:52:39.455659 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.455537    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="397b39ed-6254-4e3a-8542-97169c789636" containerName="maas-api"
Jul 10 18:52:39.455659 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.455548    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce230bf3-8c4e-4f9c-a3a6-12dff50e09e8" containerName="maas-api"
Jul 10 18:52:39.459841 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.459813    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:39.463358 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.463302    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-dc187f-serving-cert\""
Jul 10 18:52:39.466295 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.466263    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"]
Jul 10 18:52:39.551982 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.551944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfj2g\" (UniqueName: \"kubernetes.io/projected/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-kube-api-access-cfj2g\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:39.551982 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.551991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-openshift-service-ca\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:39.552238 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.552060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:39.653457 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.653417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfj2g\" (UniqueName: \"kubernetes.io/projected/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-kube-api-access-cfj2g\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:39.653457 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.653457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-openshift-service-ca\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:39.653747 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.653481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:39.653747 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:52:39.653615    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-serving-cert: secret "maas-api-e2e-api-a-dc187f-serving-cert" not found
Jul 10 18:52:39.653747 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:52:39.653682    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls podName:ef3cf97f-65b9-407a-9d30-83f3caaea9eb nodeName:}" failed. No retries permitted until 2026-07-10 18:52:40.153665112 +0000 UTC m=+2120.826580888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls") pod "maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4" (UID: "ef3cf97f-65b9-407a-9d30-83f3caaea9eb") : secret "maas-api-e2e-api-a-dc187f-serving-cert" not found
Jul 10 18:52:39.654119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.654097    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-openshift-service-ca\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:39.663865 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:39.663832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfj2g\" (UniqueName: \"kubernetes.io/projected/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-kube-api-access-cfj2g\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:40.157325 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:40.157277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:40.159899 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:40.159862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls\") pod \"maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:40.372905 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:40.372869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:40.516890 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:40.516804    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"]
Jul 10 18:52:40.519436 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:52:40.519408    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3cf97f_65b9_407a_9d30_83f3caaea9eb.slice/crio-9fe748c182e8555e4d32dea83c9b564afe542a1600496f3ce60acf55242136d1 WatchSource:0}: Error finding container 9fe748c182e8555e4d32dea83c9b564afe542a1600496f3ce60acf55242136d1: Status 404 returned error can't find the container with id 9fe748c182e8555e4d32dea83c9b564afe542a1600496f3ce60acf55242136d1
Jul 10 18:52:41.399636 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:41.399528    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4" event={"ID":"ef3cf97f-65b9-407a-9d30-83f3caaea9eb","Type":"ContainerStarted","Data":"a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9"}
Jul 10 18:52:41.399636 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:41.399599    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4" event={"ID":"ef3cf97f-65b9-407a-9d30-83f3caaea9eb","Type":"ContainerStarted","Data":"9fe748c182e8555e4d32dea83c9b564afe542a1600496f3ce60acf55242136d1"}
Jul 10 18:52:41.399636 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:41.399627    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:41.419040 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:41.418991    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4" podStartSLOduration=1.979495091 podStartE2EDuration="2.418972459s" totalImagesPullingTime="439.477368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:52:41.417798784 +0000 UTC m=+2122.090714620" watchObservedRunningTime="2026-07-10 18:52:41.418972459 +0000 UTC m=+2122.091888258"
Jul 10 18:52:47.411535 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:47.411502    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:52:47.825836 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:47.825736    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"]
Jul 10 18:52:47.829510 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:47.829482    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:47.832513 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:47.832481    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1d5607-serving-cert\""
Jul 10 18:52:47.884956 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:47.884924    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"]
Jul 10 18:52:47.935676 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:47.935641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/565a3271-f3da-4f3d-aa31-7a21e2d964ef-maas-api-tls\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:47.935868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:47.935715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/565a3271-f3da-4f3d-aa31-7a21e2d964ef-openshift-service-ca\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:47.935868 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:47.935750    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bswz8\" (UniqueName: \"kubernetes.io/projected/565a3271-f3da-4f3d-aa31-7a21e2d964ef-kube-api-access-bswz8\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:48.037199 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.037162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/565a3271-f3da-4f3d-aa31-7a21e2d964ef-openshift-service-ca\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:48.037424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.037210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bswz8\" (UniqueName: \"kubernetes.io/projected/565a3271-f3da-4f3d-aa31-7a21e2d964ef-kube-api-access-bswz8\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:48.037424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.037279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/565a3271-f3da-4f3d-aa31-7a21e2d964ef-maas-api-tls\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:48.037987 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.037961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/565a3271-f3da-4f3d-aa31-7a21e2d964ef-openshift-service-ca\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:48.039885 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.039850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/565a3271-f3da-4f3d-aa31-7a21e2d964ef-maas-api-tls\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:48.052493 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.052464    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bswz8\" (UniqueName: \"kubernetes.io/projected/565a3271-f3da-4f3d-aa31-7a21e2d964ef-kube-api-access-bswz8\") pod \"maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:48.141348 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.141212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:48.303362 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.303331    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"]
Jul 10 18:52:48.305630 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:52:48.305599    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565a3271_f3da_4f3d_aa31_7a21e2d964ef.slice/crio-3a3c8930f1d232682d6f1f74a79e588dea84951e2bf8544bb513b8bb1ead3a09 WatchSource:0}: Error finding container 3a3c8930f1d232682d6f1f74a79e588dea84951e2bf8544bb513b8bb1ead3a09: Status 404 returned error can't find the container with id 3a3c8930f1d232682d6f1f74a79e588dea84951e2bf8544bb513b8bb1ead3a09
Jul 10 18:52:48.436891 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:48.436858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k" event={"ID":"565a3271-f3da-4f3d-aa31-7a21e2d964ef","Type":"ContainerStarted","Data":"3a3c8930f1d232682d6f1f74a79e588dea84951e2bf8544bb513b8bb1ead3a09"}
Jul 10 18:52:49.443901 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:49.443860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k" event={"ID":"565a3271-f3da-4f3d-aa31-7a21e2d964ef","Type":"ContainerStarted","Data":"197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce"}
Jul 10 18:52:49.444434 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:49.443985    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:52:49.476700 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:49.476645    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k" podStartSLOduration=2.146406374 podStartE2EDuration="2.476628795s" totalImagesPullingTime="330.222421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:52:49.47392535 +0000 UTC m=+2130.146841150" watchObservedRunningTime="2026-07-10 18:52:49.476628795 +0000 UTC m=+2130.149544593"
Jul 10 18:52:55.454830 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:52:55.454799    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:53:01.230152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.230108    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"]
Jul 10 18:53:01.230743 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.230409    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4" podUID="ef3cf97f-65b9-407a-9d30-83f3caaea9eb" containerName="maas-api" containerID="cri-o://a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9" gracePeriod=30
Jul 10 18:53:01.496643 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.496573    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:53:01.503542 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.503502    2577 generic.go:356] "Generic (PLEG): container finished" podID="ef3cf97f-65b9-407a-9d30-83f3caaea9eb" containerID="a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9" exitCode=0
Jul 10 18:53:01.503542 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.503543    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"
Jul 10 18:53:01.503798 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.503546    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4" event={"ID":"ef3cf97f-65b9-407a-9d30-83f3caaea9eb","Type":"ContainerDied","Data":"a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9"}
Jul 10 18:53:01.503798 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.503667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4" event={"ID":"ef3cf97f-65b9-407a-9d30-83f3caaea9eb","Type":"ContainerDied","Data":"9fe748c182e8555e4d32dea83c9b564afe542a1600496f3ce60acf55242136d1"}
Jul 10 18:53:01.503798 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.503696    2577 scope.go:117] "RemoveContainer" containerID="a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9"
Jul 10 18:53:01.512411 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.512385    2577 scope.go:117] "RemoveContainer" containerID="a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9"
Jul 10 18:53:01.512718 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:53:01.512698    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9\": container with ID starting with a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9 not found: ID does not exist" containerID="a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9"
Jul 10 18:53:01.512811 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.512728    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9"} err="failed to get container status \"a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9\": rpc error: code = NotFound desc = could not find container \"a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9\": container with ID starting with a026b1c23714657407adfbaea58668ae0169ced7ecb1a1cdafc18848f82a93a9 not found: ID does not exist"
Jul 10 18:53:01.557896 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.557854    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-openshift-service-ca\") pod \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") "
Jul 10 18:53:01.558128 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.557912    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls\") pod \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") "
Jul 10 18:53:01.558128 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.558049    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfj2g\" (UniqueName: \"kubernetes.io/projected/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-kube-api-access-cfj2g\") pod \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\" (UID: \"ef3cf97f-65b9-407a-9d30-83f3caaea9eb\") "
Jul 10 18:53:01.558447 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.558393    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef3cf97f-65b9-407a-9d30-83f3caaea9eb" (UID: "ef3cf97f-65b9-407a-9d30-83f3caaea9eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:53:01.560433 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.560405    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-kube-api-access-cfj2g" (OuterVolumeSpecName: "kube-api-access-cfj2g") pod "ef3cf97f-65b9-407a-9d30-83f3caaea9eb" (UID: "ef3cf97f-65b9-407a-9d30-83f3caaea9eb"). InnerVolumeSpecName "kube-api-access-cfj2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:53:01.560546 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.560527    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef3cf97f-65b9-407a-9d30-83f3caaea9eb" (UID: "ef3cf97f-65b9-407a-9d30-83f3caaea9eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:53:01.658917 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.658874    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfj2g\" (UniqueName: \"kubernetes.io/projected/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-kube-api-access-cfj2g\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:53:01.658917 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.658908    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:53:01.658917 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.658922    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef3cf97f-65b9-407a-9d30-83f3caaea9eb-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:53:01.831813 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.831777    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"]
Jul 10 18:53:01.839332 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:01.839302    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc187f-7c994c976b-vxsp4"]
Jul 10 18:53:02.132526 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:02.132430    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef3cf97f-65b9-407a-9d30-83f3caaea9eb" path="/var/lib/kubelet/pods/ef3cf97f-65b9-407a-9d30-83f3caaea9eb/volumes"
Jul 10 18:53:08.764512 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:08.764475    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"]
Jul 10 18:53:08.764967 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:08.764728    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k" podUID="565a3271-f3da-4f3d-aa31-7a21e2d964ef" containerName="maas-api" containerID="cri-o://197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce" gracePeriod=30
Jul 10 18:53:09.022830 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.022754    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:53:09.128700 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.128669    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bswz8\" (UniqueName: \"kubernetes.io/projected/565a3271-f3da-4f3d-aa31-7a21e2d964ef-kube-api-access-bswz8\") pod \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") "
Jul 10 18:53:09.128900 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.128718    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/565a3271-f3da-4f3d-aa31-7a21e2d964ef-maas-api-tls\") pod \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") "
Jul 10 18:53:09.128900 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.128745    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/565a3271-f3da-4f3d-aa31-7a21e2d964ef-openshift-service-ca\") pod \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\" (UID: \"565a3271-f3da-4f3d-aa31-7a21e2d964ef\") "
Jul 10 18:53:09.129140 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.129118    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/565a3271-f3da-4f3d-aa31-7a21e2d964ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "565a3271-f3da-4f3d-aa31-7a21e2d964ef" (UID: "565a3271-f3da-4f3d-aa31-7a21e2d964ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:53:09.130867 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.130830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/565a3271-f3da-4f3d-aa31-7a21e2d964ef-kube-api-access-bswz8" (OuterVolumeSpecName: "kube-api-access-bswz8") pod "565a3271-f3da-4f3d-aa31-7a21e2d964ef" (UID: "565a3271-f3da-4f3d-aa31-7a21e2d964ef"). InnerVolumeSpecName "kube-api-access-bswz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:53:09.130867 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.130854    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/565a3271-f3da-4f3d-aa31-7a21e2d964ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "565a3271-f3da-4f3d-aa31-7a21e2d964ef" (UID: "565a3271-f3da-4f3d-aa31-7a21e2d964ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:53:09.229774 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.229736    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bswz8\" (UniqueName: \"kubernetes.io/projected/565a3271-f3da-4f3d-aa31-7a21e2d964ef-kube-api-access-bswz8\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:53:09.229774 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.229774    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/565a3271-f3da-4f3d-aa31-7a21e2d964ef-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:53:09.229774 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.229788    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/565a3271-f3da-4f3d-aa31-7a21e2d964ef-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:53:09.547119 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.547080    2577 generic.go:356] "Generic (PLEG): container finished" podID="565a3271-f3da-4f3d-aa31-7a21e2d964ef" containerID="197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce" exitCode=0
Jul 10 18:53:09.547350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.547124    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"
Jul 10 18:53:09.547350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.547166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k" event={"ID":"565a3271-f3da-4f3d-aa31-7a21e2d964ef","Type":"ContainerDied","Data":"197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce"}
Jul 10 18:53:09.547350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.547254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k" event={"ID":"565a3271-f3da-4f3d-aa31-7a21e2d964ef","Type":"ContainerDied","Data":"3a3c8930f1d232682d6f1f74a79e588dea84951e2bf8544bb513b8bb1ead3a09"}
Jul 10 18:53:09.547350 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.547284    2577 scope.go:117] "RemoveContainer" containerID="197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce"
Jul 10 18:53:09.556505 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.556484    2577 scope.go:117] "RemoveContainer" containerID="197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce"
Jul 10 18:53:09.556799 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:53:09.556774    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce\": container with ID starting with 197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce not found: ID does not exist" containerID="197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce"
Jul 10 18:53:09.556838 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.556816    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce"} err="failed to get container status \"197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce\": rpc error: code = NotFound desc = could not find container \"197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce\": container with ID starting with 197ef550cdba677e39ad64d2c49a77d4b72af50fe9906ce314165212e78ea4ce not found: ID does not exist"
Jul 10 18:53:09.576177 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.576130    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"]
Jul 10 18:53:09.578105 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:09.578079    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5607-666db76bf7-xzz6k"]
Jul 10 18:53:10.133127 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:10.133089    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="565a3271-f3da-4f3d-aa31-7a21e2d964ef" path="/var/lib/kubelet/pods/565a3271-f3da-4f3d-aa31-7a21e2d964ef/volumes"
Jul 10 18:53:18.803353 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.803316    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"]
Jul 10 18:53:18.803824 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.803674    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef3cf97f-65b9-407a-9d30-83f3caaea9eb" containerName="maas-api"
Jul 10 18:53:18.803824 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.803686    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef3cf97f-65b9-407a-9d30-83f3caaea9eb" containerName="maas-api"
Jul 10 18:53:18.803824 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.803700    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="565a3271-f3da-4f3d-aa31-7a21e2d964ef" containerName="maas-api"
Jul 10 18:53:18.803824 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.803706    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="565a3271-f3da-4f3d-aa31-7a21e2d964ef" containerName="maas-api"
Jul 10 18:53:18.803824 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.803784    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="565a3271-f3da-4f3d-aa31-7a21e2d964ef" containerName="maas-api"
Jul 10 18:53:18.803824 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.803800    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef3cf97f-65b9-407a-9d30-83f3caaea9eb" containerName="maas-api"
Jul 10 18:53:18.808175 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.808151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:18.811528 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.811508    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-afdf1e-serving-cert\""
Jul 10 18:53:18.818712 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.818684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"]
Jul 10 18:53:18.921674 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.921632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkrqq\" (UniqueName: \"kubernetes.io/projected/db69263b-80bc-4d69-abd8-e51805d53669-kube-api-access-tkrqq\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:18.921845 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.921723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:18.921845 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:18.921759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db69263b-80bc-4d69-abd8-e51805d53669-openshift-service-ca\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.022708 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.022668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkrqq\" (UniqueName: \"kubernetes.io/projected/db69263b-80bc-4d69-abd8-e51805d53669-kube-api-access-tkrqq\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.022939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.022777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.022939 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.022828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db69263b-80bc-4d69-abd8-e51805d53669-openshift-service-ca\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.022939 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:53:19.022921    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-serving-cert: secret "maas-api-e2e-shared-a-afdf1e-serving-cert" not found
Jul 10 18:53:19.023114 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:53:19.022999    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls podName:db69263b-80bc-4d69-abd8-e51805d53669 nodeName:}" failed. No retries permitted until 2026-07-10 18:53:19.522980339 +0000 UTC m=+2160.195896116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls") pod "maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs" (UID: "db69263b-80bc-4d69-abd8-e51805d53669") : secret "maas-api-e2e-shared-a-afdf1e-serving-cert" not found
Jul 10 18:53:19.023586 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.023561    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db69263b-80bc-4d69-abd8-e51805d53669-openshift-service-ca\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.032370 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.032338    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkrqq\" (UniqueName: \"kubernetes.io/projected/db69263b-80bc-4d69-abd8-e51805d53669-kube-api-access-tkrqq\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.527828 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.527784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.530377 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.530345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls\") pod \"maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.720138 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.720095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:19.874555 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:19.874524    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"]
Jul 10 18:53:19.876804 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:53:19.876774    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb69263b_80bc_4d69_abd8_e51805d53669.slice/crio-932be4d9cd640967c07d10c37207dcf3f192240b78f73cdff32706bbbe601aa8 WatchSource:0}: Error finding container 932be4d9cd640967c07d10c37207dcf3f192240b78f73cdff32706bbbe601aa8: Status 404 returned error can't find the container with id 932be4d9cd640967c07d10c37207dcf3f192240b78f73cdff32706bbbe601aa8
Jul 10 18:53:20.604974 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:20.604872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs" event={"ID":"db69263b-80bc-4d69-abd8-e51805d53669","Type":"ContainerStarted","Data":"004f9749f772db2163596cf4692558a4b8367fea3c96b26c7e60dd8e2a3e85e1"}
Jul 10 18:53:20.605152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:20.605030    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:20.605152 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:20.605079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs" event={"ID":"db69263b-80bc-4d69-abd8-e51805d53669","Type":"ContainerStarted","Data":"932be4d9cd640967c07d10c37207dcf3f192240b78f73cdff32706bbbe601aa8"}
Jul 10 18:53:20.623683 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:20.623628    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs" podStartSLOduration=2.239593672 podStartE2EDuration="2.62361062s" totalImagesPullingTime="384.016948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:53:20.622374738 +0000 UTC m=+2161.295290548" watchObservedRunningTime="2026-07-10 18:53:20.62361062 +0000 UTC m=+2161.296526418"
Jul 10 18:53:26.615898 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.615864    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:53:26.805399 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.805362    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"]
Jul 10 18:53:26.810349 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.810324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:26.813295 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.813270    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f83faf-serving-cert\""
Jul 10 18:53:26.826471 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.826430    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"]
Jul 10 18:53:26.897953 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.897847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d617e4f0-075b-4f75-bf99-9a16cad85fca-maas-api-tls\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:26.898123 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.898018    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d617e4f0-075b-4f75-bf99-9a16cad85fca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:26.898123 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.898094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nck78\" (UniqueName: \"kubernetes.io/projected/d617e4f0-075b-4f75-bf99-9a16cad85fca-kube-api-access-nck78\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:26.998730 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.998683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d617e4f0-075b-4f75-bf99-9a16cad85fca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:26.998935 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.998746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nck78\" (UniqueName: \"kubernetes.io/projected/d617e4f0-075b-4f75-bf99-9a16cad85fca-kube-api-access-nck78\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:26.998935 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.998772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d617e4f0-075b-4f75-bf99-9a16cad85fca-maas-api-tls\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:26.999424 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:26.999400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d617e4f0-075b-4f75-bf99-9a16cad85fca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:27.001341 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:27.001313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d617e4f0-075b-4f75-bf99-9a16cad85fca-maas-api-tls\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:27.010711 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:27.010679    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nck78\" (UniqueName: \"kubernetes.io/projected/d617e4f0-075b-4f75-bf99-9a16cad85fca-kube-api-access-nck78\") pod \"maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:27.120430 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:27.120389    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:27.269797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:27.269770    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"]
Jul 10 18:53:27.271713 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:53:27.271680    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd617e4f0_075b_4f75_bf99_9a16cad85fca.slice/crio-921087052ee2a2246307463371417baccd3ff3cf46a39610677f3356bfd9fe81 WatchSource:0}: Error finding container 921087052ee2a2246307463371417baccd3ff3cf46a39610677f3356bfd9fe81: Status 404 returned error can't find the container with id 921087052ee2a2246307463371417baccd3ff3cf46a39610677f3356bfd9fe81
Jul 10 18:53:27.650241 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:27.650178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6" event={"ID":"d617e4f0-075b-4f75-bf99-9a16cad85fca","Type":"ContainerStarted","Data":"fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1"}
Jul 10 18:53:27.650662 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:27.650284    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:53:27.650662 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:27.650310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6" event={"ID":"d617e4f0-075b-4f75-bf99-9a16cad85fca","Type":"ContainerStarted","Data":"921087052ee2a2246307463371417baccd3ff3cf46a39610677f3356bfd9fe81"}
Jul 10 18:53:27.671071 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:27.671012    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6" podStartSLOduration=1.362921821 podStartE2EDuration="1.670990631s" totalImagesPullingTime="308.06881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:53:27.669718388 +0000 UTC m=+2168.342634192" watchObservedRunningTime="2026-07-10 18:53:27.670990631 +0000 UTC m=+2168.343906430"
Jul 10 18:53:33.663721 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:53:33.663689    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:57:20.135351 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:57:20.135319    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:57:20.141749 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:57:20.141723    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8kmc_5545911c-2885-4a2f-8a1c-9c96070e1ede/ovn-acl-logging/0.log"
Jul 10 18:59:10.187817 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.187708    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"]
Jul 10 18:59:10.188402 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.187995    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs" podUID="db69263b-80bc-4d69-abd8-e51805d53669" containerName="maas-api" containerID="cri-o://004f9749f772db2163596cf4692558a4b8367fea3c96b26c7e60dd8e2a3e85e1" gracePeriod=30
Jul 10 18:59:10.371667 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.371633    2577 generic.go:356] "Generic (PLEG): container finished" podID="db69263b-80bc-4d69-abd8-e51805d53669" containerID="004f9749f772db2163596cf4692558a4b8367fea3c96b26c7e60dd8e2a3e85e1" exitCode=0
Jul 10 18:59:10.371833 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.371686    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs" event={"ID":"db69263b-80bc-4d69-abd8-e51805d53669","Type":"ContainerDied","Data":"004f9749f772db2163596cf4692558a4b8367fea3c96b26c7e60dd8e2a3e85e1"}
Jul 10 18:59:10.439205 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.439126    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:59:10.565066 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.565024    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db69263b-80bc-4d69-abd8-e51805d53669-openshift-service-ca\") pod \"db69263b-80bc-4d69-abd8-e51805d53669\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") "
Jul 10 18:59:10.565066 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.565063    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkrqq\" (UniqueName: \"kubernetes.io/projected/db69263b-80bc-4d69-abd8-e51805d53669-kube-api-access-tkrqq\") pod \"db69263b-80bc-4d69-abd8-e51805d53669\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") "
Jul 10 18:59:10.565325 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.565106    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls\") pod \"db69263b-80bc-4d69-abd8-e51805d53669\" (UID: \"db69263b-80bc-4d69-abd8-e51805d53669\") "
Jul 10 18:59:10.565564 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.565521    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db69263b-80bc-4d69-abd8-e51805d53669-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db69263b-80bc-4d69-abd8-e51805d53669" (UID: "db69263b-80bc-4d69-abd8-e51805d53669"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:59:10.567418 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.567387    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db69263b-80bc-4d69-abd8-e51805d53669" (UID: "db69263b-80bc-4d69-abd8-e51805d53669"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:59:10.567537 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.567500    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db69263b-80bc-4d69-abd8-e51805d53669-kube-api-access-tkrqq" (OuterVolumeSpecName: "kube-api-access-tkrqq") pod "db69263b-80bc-4d69-abd8-e51805d53669" (UID: "db69263b-80bc-4d69-abd8-e51805d53669"). InnerVolumeSpecName "kube-api-access-tkrqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:59:10.665905 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.665868    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db69263b-80bc-4d69-abd8-e51805d53669-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:59:10.665905 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.665902    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db69263b-80bc-4d69-abd8-e51805d53669-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:59:10.665905 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:10.665914    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkrqq\" (UniqueName: \"kubernetes.io/projected/db69263b-80bc-4d69-abd8-e51805d53669-kube-api-access-tkrqq\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:59:11.378065 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:11.378035    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"
Jul 10 18:59:11.378592 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:11.378068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs" event={"ID":"db69263b-80bc-4d69-abd8-e51805d53669","Type":"ContainerDied","Data":"932be4d9cd640967c07d10c37207dcf3f192240b78f73cdff32706bbbe601aa8"}
Jul 10 18:59:11.378592 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:11.378131    2577 scope.go:117] "RemoveContainer" containerID="004f9749f772db2163596cf4692558a4b8367fea3c96b26c7e60dd8e2a3e85e1"
Jul 10 18:59:11.405279 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:11.405244    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"]
Jul 10 18:59:11.408633 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:11.408602    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-afdf1e-5b8bdb9645-gh9fs"]
Jul 10 18:59:12.133025 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:12.132976    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db69263b-80bc-4d69-abd8-e51805d53669" path="/var/lib/kubelet/pods/db69263b-80bc-4d69-abd8-e51805d53669/volumes"
Jul 10 18:59:17.578665 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.578631    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"]
Jul 10 18:59:17.579090 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.578858    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6" podUID="d617e4f0-075b-4f75-bf99-9a16cad85fca" containerName="maas-api" containerID="cri-o://fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1" gracePeriod=30
Jul 10 18:59:17.832339 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.832265    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:59:17.930714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.930670    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d617e4f0-075b-4f75-bf99-9a16cad85fca-maas-api-tls\") pod \"d617e4f0-075b-4f75-bf99-9a16cad85fca\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") "
Jul 10 18:59:17.930714 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.930719    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d617e4f0-075b-4f75-bf99-9a16cad85fca-openshift-service-ca\") pod \"d617e4f0-075b-4f75-bf99-9a16cad85fca\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") "
Jul 10 18:59:17.930984 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.930767    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nck78\" (UniqueName: \"kubernetes.io/projected/d617e4f0-075b-4f75-bf99-9a16cad85fca-kube-api-access-nck78\") pod \"d617e4f0-075b-4f75-bf99-9a16cad85fca\" (UID: \"d617e4f0-075b-4f75-bf99-9a16cad85fca\") "
Jul 10 18:59:17.931138 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.931098    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d617e4f0-075b-4f75-bf99-9a16cad85fca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d617e4f0-075b-4f75-bf99-9a16cad85fca" (UID: "d617e4f0-075b-4f75-bf99-9a16cad85fca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:59:17.932831 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.932796    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d617e4f0-075b-4f75-bf99-9a16cad85fca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d617e4f0-075b-4f75-bf99-9a16cad85fca" (UID: "d617e4f0-075b-4f75-bf99-9a16cad85fca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:59:17.932942 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:17.932832    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d617e4f0-075b-4f75-bf99-9a16cad85fca-kube-api-access-nck78" (OuterVolumeSpecName: "kube-api-access-nck78") pod "d617e4f0-075b-4f75-bf99-9a16cad85fca" (UID: "d617e4f0-075b-4f75-bf99-9a16cad85fca"). InnerVolumeSpecName "kube-api-access-nck78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:59:18.032501 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.032462    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nck78\" (UniqueName: \"kubernetes.io/projected/d617e4f0-075b-4f75-bf99-9a16cad85fca-kube-api-access-nck78\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:59:18.032501 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.032493    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d617e4f0-075b-4f75-bf99-9a16cad85fca-maas-api-tls\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:59:18.032501 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.032503    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d617e4f0-075b-4f75-bf99-9a16cad85fca-openshift-service-ca\") on node \"ip-10-0-141-167.ec2.internal\" DevicePath \"\""
Jul 10 18:59:18.420375 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.420342    2577 generic.go:356] "Generic (PLEG): container finished" podID="d617e4f0-075b-4f75-bf99-9a16cad85fca" containerID="fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1" exitCode=0
Jul 10 18:59:18.420552 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.420389    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"
Jul 10 18:59:18.420552 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.420434    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6" event={"ID":"d617e4f0-075b-4f75-bf99-9a16cad85fca","Type":"ContainerDied","Data":"fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1"}
Jul 10 18:59:18.420552 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.420494    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6" event={"ID":"d617e4f0-075b-4f75-bf99-9a16cad85fca","Type":"ContainerDied","Data":"921087052ee2a2246307463371417baccd3ff3cf46a39610677f3356bfd9fe81"}
Jul 10 18:59:18.420552 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.420522    2577 scope.go:117] "RemoveContainer" containerID="fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1"
Jul 10 18:59:18.429422 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.429397    2577 scope.go:117] "RemoveContainer" containerID="fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1"
Jul 10 18:59:18.429770 ip-10-0-141-167 kubenswrapper[2577]: E0710 18:59:18.429748    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1\": container with ID starting with fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1 not found: ID does not exist" containerID="fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1"
Jul 10 18:59:18.429840 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.429787    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1"} err="failed to get container status \"fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1\": rpc error: code = NotFound desc = could not find container \"fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1\": container with ID starting with fe1da99b1968b37c0fd5a5927d7317081b8b9f588c6047ff1fc2e30b5ac2e1b1 not found: ID does not exist"
Jul 10 18:59:18.447139 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.447098    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"]
Jul 10 18:59:18.453998 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:18.453959    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f83faf-855887d8d9-v8tb6"]
Jul 10 18:59:20.133711 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:20.133675    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d617e4f0-075b-4f75-bf99-9a16cad85fca" path="/var/lib/kubelet/pods/d617e4f0-075b-4f75-bf99-9a16cad85fca/volumes"
Jul 10 18:59:29.678607 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:29.678553    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cb8597bc-f44j4_40b00685-962a-4f3c-a4bc-b03d24f1d1fe/manager/0.log"
Jul 10 18:59:30.282388 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:30.282358    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d75465dc8-th2w7_63b96f7d-0bf5-4364-b6d8-449400e814b1/copy-manifests/0.log"
Jul 10 18:59:30.298260 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:30.298193    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d75465dc8-th2w7_63b96f7d-0bf5-4364-b6d8-449400e814b1/manager/0.log"
Jul 10 18:59:30.655440 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:30.655332    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7c6c8c4796-frflv_65dea2c7-9277-48cb-879f-235cc2b23d59/maas-api/0.log"
Jul 10 18:59:30.786803 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:30.786769    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-q4nrh_a0cb238a-4cf6-4fa8-a6a0-3fb8f5a9c730/postgres/0.log"
Jul 10 18:59:33.521782 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:33.521750    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5pt7x_ea72ff24-5b5e-44fd-8370-f9f99cc71852/discovery/0.log"
Jul 10 18:59:34.131023 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:34.130990    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x7v29_33c54701-2c71-4f88-8036-b851b03986e8/payload-processing/0.log"
Jul 10 18:59:34.618775 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:34.618735    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ltv9x_2f37a9c3-b2c6-4daf-978a-e22c15724cd0/main/0.log"
Jul 10 18:59:34.854071 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:34.854043    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-hrrlg_80498301-38ad-4618-89b2-a2a0febb12c5/main/0.log"
Jul 10 18:59:42.247056 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:42.247022    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qsjnf_c85a26b2-a7d3-4a3b-8e1b-6256359a5227/global-pull-secret-syncer/0.log"
Jul 10 18:59:42.378728 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:42.378690    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kfpbd_18fc4602-515d-4c27-b186-0c8bceceaafa/konnectivity-agent/0.log"
Jul 10 18:59:42.432605 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:42.432579    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-167.ec2.internal_c50dc436f615212845a6d6b895b3210b/haproxy/0.log"
Jul 10 18:59:50.779361 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:50.779321    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6bf447c8f6-lkb9j_618cbc90-2e0d-45e2-9bfe-69bf5e6d08b6/metrics-server/0.log"
Jul 10 18:59:50.942878 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:50.942846    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmndv_927bc1d4-2766-41a4-9dad-e6f619035370/node-exporter/0.log"
Jul 10 18:59:50.972715 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:50.972677    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmndv_927bc1d4-2766-41a4-9dad-e6f619035370/kube-rbac-proxy/0.log"
Jul 10 18:59:50.998256 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:50.998209    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmndv_927bc1d4-2766-41a4-9dad-e6f619035370/init-textfile/0.log"
Jul 10 18:59:51.112940 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.112857    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kgw9x_60e590d6-2bf0-4f75-9bb3-c55898aa43ed/kube-rbac-proxy-main/0.log"
Jul 10 18:59:51.138202 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.138171    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kgw9x_60e590d6-2bf0-4f75-9bb3-c55898aa43ed/kube-rbac-proxy-self/0.log"
Jul 10 18:59:51.163366 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.163340    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kgw9x_60e590d6-2bf0-4f75-9bb3-c55898aa43ed/openshift-state-metrics/0.log"
Jul 10 18:59:51.399097 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.398981    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-p5vwp_f21f9cdb-59a6-4abe-a010-f29ff7aebda6/prometheus-operator/0.log"
Jul 10 18:59:51.425873 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.425840    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-p5vwp_f21f9cdb-59a6-4abe-a010-f29ff7aebda6/kube-rbac-proxy/0.log"
Jul 10 18:59:51.456028 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.456000    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-b6pgl_be8dab2f-38fe-406b-b760-204f8c366875/prometheus-operator-admission-webhook/0.log"
Jul 10 18:59:51.600170 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.600138    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668699c488-hhq6b_2ffa9634-85ff-4824-aebb-1338da485765/thanos-query/0.log"
Jul 10 18:59:51.627554 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.627521    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668699c488-hhq6b_2ffa9634-85ff-4824-aebb-1338da485765/kube-rbac-proxy-web/0.log"
Jul 10 18:59:51.652992 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.652919    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668699c488-hhq6b_2ffa9634-85ff-4824-aebb-1338da485765/kube-rbac-proxy/0.log"
Jul 10 18:59:51.678828 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.678797    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668699c488-hhq6b_2ffa9634-85ff-4824-aebb-1338da485765/prom-label-proxy/0.log"
Jul 10 18:59:51.705595 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.705567    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668699c488-hhq6b_2ffa9634-85ff-4824-aebb-1338da485765/kube-rbac-proxy-rules/0.log"
Jul 10 18:59:51.730915 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:51.730889    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668699c488-hhq6b_2ffa9634-85ff-4824-aebb-1338da485765/kube-rbac-proxy-metrics/0.log"
Jul 10 18:59:52.136972 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.136937    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"]
Jul 10 18:59:52.137387 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.137329    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db69263b-80bc-4d69-abd8-e51805d53669" containerName="maas-api"
Jul 10 18:59:52.137387 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.137341    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db69263b-80bc-4d69-abd8-e51805d53669" containerName="maas-api"
Jul 10 18:59:52.137387 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.137356    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d617e4f0-075b-4f75-bf99-9a16cad85fca" containerName="maas-api"
Jul 10 18:59:52.137387 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.137362    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d617e4f0-075b-4f75-bf99-9a16cad85fca" containerName="maas-api"
Jul 10 18:59:52.137512 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.137416    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d617e4f0-075b-4f75-bf99-9a16cad85fca" containerName="maas-api"
Jul 10 18:59:52.137512 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.137425    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="db69263b-80bc-4d69-abd8-e51805d53669" containerName="maas-api"
Jul 10 18:59:52.140797 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.140774    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.144199 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.144173    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9xwdk\"/\"default-dockercfg-rjp4f\""
Jul 10 18:59:52.145442 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.145421    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9xwdk\"/\"kube-root-ca.crt\""
Jul 10 18:59:52.145597 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.145449    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9xwdk\"/\"openshift-service-ca.crt\""
Jul 10 18:59:52.150656 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.150626    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"]
Jul 10 18:59:52.239791 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.239755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-lib-modules\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.239791 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.239798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-proc\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.240079 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.239822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-podres\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.240079 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.239859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2v7g\" (UniqueName: \"kubernetes.io/projected/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-kube-api-access-g2v7g\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.240079 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.239948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-sys\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.340813 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.340770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-sys\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.341021 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.340921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-sys\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.341021 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.340935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-lib-modules\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.341021 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.340990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-proc\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.341187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.341026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-podres\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.341187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.341049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-lib-modules\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.341187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.341095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2v7g\" (UniqueName: \"kubernetes.io/projected/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-kube-api-access-g2v7g\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.341187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.341116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-proc\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.341187 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.341149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-podres\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.350695 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.350665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2v7g\" (UniqueName: \"kubernetes.io/projected/f51e2a84-b82c-4695-b31c-3c8ce2aacea5-kube-api-access-g2v7g\") pod \"perf-node-gather-daemonset-wmmfw\" (UID: \"f51e2a84-b82c-4695-b31c-3c8ce2aacea5\") " pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.451591 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.451545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:52.597034 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.597005    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"]
Jul 10 18:59:52.599237 ip-10-0-141-167 kubenswrapper[2577]: W0710 18:59:52.599194    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf51e2a84_b82c_4695_b31c_3c8ce2aacea5.slice/crio-28e903f5721928596023cdba0ad071a07f5e6fece8947ebd1a90dc85567a4972 WatchSource:0}: Error finding container 28e903f5721928596023cdba0ad071a07f5e6fece8947ebd1a90dc85567a4972: Status 404 returned error can't find the container with id 28e903f5721928596023cdba0ad071a07f5e6fece8947ebd1a90dc85567a4972
Jul 10 18:59:52.985263 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:52.985167    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-6jxtl_2b743100-ee27-469c-a38c-44c18163ae46/networking-console-plugin/0.log"
Jul 10 18:59:53.606534 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:53.606495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw" event={"ID":"f51e2a84-b82c-4695-b31c-3c8ce2aacea5","Type":"ContainerStarted","Data":"3c2edd6c184c44e4122c8dcbb244b6a9472149b9d751cfdf11289064a96374ef"}
Jul 10 18:59:53.606950 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:53.606554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw" event={"ID":"f51e2a84-b82c-4695-b31c-3c8ce2aacea5","Type":"ContainerStarted","Data":"28e903f5721928596023cdba0ad071a07f5e6fece8947ebd1a90dc85567a4972"}
Jul 10 18:59:53.606950 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:53.606670    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 18:59:53.626789 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:53.626737    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw" podStartSLOduration=1.626720475 podStartE2EDuration="1.626720475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:53.626022374 +0000 UTC m=+2554.298938212" watchObservedRunningTime="2026-07-10 18:59:53.626720475 +0000 UTC m=+2554.299636273"
Jul 10 18:59:54.051820 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:54.051796    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78f5bc747d-b7xbj_c48c1265-accb-470c-b9a7-030086ee1988/console/0.log"
Jul 10 18:59:54.090715 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:54.090686    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-8xnbd_2664d308-ba4b-417b-872f-59c0e3c27e48/download-server/0.log"
Jul 10 18:59:55.818479 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:55.818449    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jrgzz_0ead3efb-54c3-461f-af60-dcf7c3e54d7e/dns/0.log"
Jul 10 18:59:55.852373 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:55.852337    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jrgzz_0ead3efb-54c3-461f-af60-dcf7c3e54d7e/kube-rbac-proxy/0.log"
Jul 10 18:59:56.000114 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:56.000081    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n4575_af29cd1b-dd41-4581-b5f4-062b07cce95d/dns-node-resolver/0.log"
Jul 10 18:59:56.564408 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:56.564376    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c5898f476-4rd2c_136e0966-bf1b-4f9c-bf9b-ba9d4f17bab2/registry/0.log"
Jul 10 18:59:56.642957 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:56.642924    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vwl86_c853e25f-65cb-4393-b0bf-af5f3a2b83d9/node-ca/0.log"
Jul 10 18:59:57.819454 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:57.819410    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5pt7x_ea72ff24-5b5e-44fd-8370-f9f99cc71852/discovery/0.log"
Jul 10 18:59:58.027558 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:58.027520    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x7v29_33c54701-2c71-4f88-8036-b851b03986e8/payload-processing/0.log"
Jul 10 18:59:58.822018 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:58.821981    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pn9wr_54ea2926-1c78-4aac-b6ac-e1df01ddcdaa/serve-healthcheck-canary/0.log"
Jul 10 18:59:59.524326 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:59.524293    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5kn7_5794e824-336e-4d71-82ff-f11af6174ee6/kube-rbac-proxy/0.log"
Jul 10 18:59:59.550386 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:59.550355    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5kn7_5794e824-336e-4d71-82ff-f11af6174ee6/exporter/0.log"
Jul 10 18:59:59.577147 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:59.577113    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5kn7_5794e824-336e-4d71-82ff-f11af6174ee6/extractor/0.log"
Jul 10 18:59:59.623260 ip-10-0-141-167 kubenswrapper[2577]: I0710 18:59:59.623216    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9xwdk/perf-node-gather-daemonset-wmmfw"
Jul 10 19:00:00.144513 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.144475    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-j4frf"]
Jul 10 19:00:00.148125 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.148100    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-j4frf"
Jul 10 19:00:00.151125 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.151100    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bw2j9\""
Jul 10 19:00:00.156486 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.156447    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-j4frf"]
Jul 10 19:00:00.159483 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.159459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-j4frf"
Jul 10 19:00:00.303835 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.303790    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728500-j4frf"]
Jul 10 19:00:00.306963 ip-10-0-141-167 kubenswrapper[2577]: W0710 19:00:00.306928    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98d3d5c_9504_4bdc_b80b_4b2196b73f71.slice/crio-30452c2a27face9e4c705fe5fa53259a52eff4d71a80e973b6d4472035b36951 WatchSource:0}: Error finding container 30452c2a27face9e4c705fe5fa53259a52eff4d71a80e973b6d4472035b36951: Status 404 returned error can't find the container with id 30452c2a27face9e4c705fe5fa53259a52eff4d71a80e973b6d4472035b36951
Jul 10 19:00:00.642025 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.641987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-j4frf" event={"ID":"c98d3d5c-9504-4bdc-b80b-4b2196b73f71","Type":"ContainerStarted","Data":"4848c097830838a88b5c80c67c265eae38558ec471fcf18e4dca62c56a546f71"}
Jul 10 19:00:00.642198 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.642055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-j4frf" event={"ID":"c98d3d5c-9504-4bdc-b80b-4b2196b73f71","Type":"ContainerStarted","Data":"30452c2a27face9e4c705fe5fa53259a52eff4d71a80e973b6d4472035b36951"}
Jul 10 19:00:00.661532 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:00.661474    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728500-j4frf" podStartSLOduration=0.661458554 podStartE2EDuration="661.458554ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:00.659751854 +0000 UTC m=+2561.332667655" watchObservedRunningTime="2026-07-10 19:00:00.661458554 +0000 UTC m=+2561.334374353"
Jul 10 19:00:02.412848 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:02.412804    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cb8597bc-f44j4_40b00685-962a-4f3c-a4bc-b03d24f1d1fe/manager/0.log"
Jul 10 19:00:02.720762 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:02.720729    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d75465dc8-th2w7_63b96f7d-0bf5-4364-b6d8-449400e814b1/manager/0.log"
Jul 10 19:00:02.740452 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:02.740425    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d75465dc8-th2w7_63b96f7d-0bf5-4364-b6d8-449400e814b1/copy-manifests/0.log"
Jul 10 19:00:03.414951 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:03.414923    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5pt7x_ea72ff24-5b5e-44fd-8370-f9f99cc71852/discovery/0.log"
Jul 10 19:00:03.551625 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:03.551596    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x7v29_33c54701-2c71-4f88-8036-b851b03986e8/payload-processing/0.log"
Jul 10 19:00:04.083382 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:04.083292    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6cfc4d774-j54x9_a7c797bd-0dbf-4010-aa0d-594df6bf933d/manager/0.log"
Jul 10 19:00:04.917651 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:04.917617    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5pt7x_ea72ff24-5b5e-44fd-8370-f9f99cc71852/discovery/0.log"
Jul 10 19:00:05.057875 ip-10-0-141-167 kubenswrapper[2577]: I0710 19:00:05.057835    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x7v29_33c54701-2c71-4f88-8036-b851b03986e8/payload-processing/0.log"