Jul 13 21:11:06.117343 ip-10-0-136-160 systemd[1]: Starting Kubernetes Kubelet... Jul 13 21:11:06.551203 ip-10-0-136-160 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 21:11:06.551203 ip-10-0-136-160 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 21:11:06.551203 ip-10-0-136-160 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 21:11:06.551203 ip-10-0-136-160 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 21:11:06.551203 ip-10-0-136-160 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 21:11:06.554061 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.553953 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 21:11:06.559051 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559030 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:11:06.559051 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559051 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559057 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559060 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559064 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559066 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559069 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559072 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559075 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559078 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559081 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559084 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559086 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559089 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559092 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559094 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559103 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559106 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559109 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559111 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559114 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:11:06.559130 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559117 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559120 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559122 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559125 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559127 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559130 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559133 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559136 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559138 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559142 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559144 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559147 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559149 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559152 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559154 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559156 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559159 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559161 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559164 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559166 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:11:06.559619 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559169 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559171 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559174 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559182 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559186 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559190 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559193 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559197 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559199 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559203 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559206 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559209 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559211 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559214 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559218 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559222 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559224 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559227 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559230 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:11:06.560178 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559234 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559237 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559239 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559243 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559245 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559249 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559253 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559256 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559258 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559261 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559263 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559266 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559269 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559271 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559274 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559276 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559279 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559281 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559283 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:11:06.560645 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559286 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559288 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559291 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559293 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559296 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559298 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559301 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559303 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559307 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559310 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559312 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559315 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559318 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559320 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559323 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559325 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559327 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559330 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559332 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.559335 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:11:06.561220 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560099 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560107 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560110 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560114 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560116 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560120 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560123 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560126 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560128 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560131 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560133 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560137 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560141 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560144 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560147 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560151 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560155 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560158 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560161 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:11:06.561752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560164 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560168 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560171 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560174 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560176 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560179 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560182 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560185 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560187 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560190 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560193 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560196 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560199 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560202 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560204 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560207 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560210 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560212 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560215 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560219 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:11:06.562308 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560222 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560224 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560227 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560229 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560232 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560234 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560237 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560239 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560242 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560244 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560246 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560249 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560251 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560254 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560257 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560260 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560263 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560265 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560268 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560270 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:11:06.562814 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560273 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560275 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560280 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560284 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560287 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560290 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560293 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560295 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560298 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560300 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560303 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560305 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560308 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560311 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560314 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560317 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560319 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560321 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560324 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:11:06.563348 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560326 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560328 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560331 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560333 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560336 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560338 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560341 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560344 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560347 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560349 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560352 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560354 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560357 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560360 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560362 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560364 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560367 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560370 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560372 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560375 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:11:06.563816 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560377 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560833 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560840 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560843 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560846 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560852 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560855 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560858 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560861 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560863 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560866 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560868 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560871 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560873 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560876 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560878 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560881 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560883 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560887 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560890 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:11:06.564385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560893 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560896 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560898 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560901 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560903 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560906 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560908 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560911 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560914 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560917 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560919 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560922 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560924 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560927 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560929 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560932 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560935 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560937 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560947 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:11:06.564888 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560951 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560954 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560957 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560959 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560962 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560965 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560968 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560970 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560973 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560976 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560979 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560982 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560984 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560987 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560989 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560992 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.560996 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561000 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561017 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:11:06.565364 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561020 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561023 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561025 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561028 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561031 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561033 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561036 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561040 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561043 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561046 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561049 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561052 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561055 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561063 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561066 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561068 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561071 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561073 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561075 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:11:06.565826 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561080 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561082 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561085 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561088 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561091 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561094 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561096 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561099 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561102 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561104 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561107 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561109 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561111 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561114 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561117 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561119 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561121 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561124 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561126 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561129 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:11:06.566330 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561131 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561134 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561136 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561205 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561212 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561229 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561234 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561244 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561248 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561252 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561257 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561260 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561263 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561266 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561270 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561273 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561276 2572 flags.go:64] FLAG: --cgroup-root="" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561279 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561281 2572 flags.go:64] FLAG: --client-ca-file="" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561284 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561287 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561294 2572 flags.go:64] FLAG: --cluster-domain="" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561297 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561300 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 21:11:06.566808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561303 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561306 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561310 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561313 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561316 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561319 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561322 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561325 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561328 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561331 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561334 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561337 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561340 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561343 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561346 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561349 2572 flags.go:64] FLAG: --enable-server="true" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561357 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561365 2572 flags.go:64] FLAG: --event-burst="100" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561369 2572 flags.go:64] FLAG: --event-qps="50" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561372 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561375 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561379 2572 flags.go:64] FLAG: --eviction-hard="" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561382 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561385 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561389 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 21:11:06.567405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561392 2572 flags.go:64] FLAG: --eviction-soft="" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561395 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561398 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561401 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561404 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561407 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561409 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561412 2572 flags.go:64] FLAG: --feature-gates="" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561416 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561419 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561422 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561425 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561428 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561431 2572 flags.go:64] FLAG: --help="false" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561434 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561437 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561440 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561442 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561446 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561449 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561452 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561454 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561457 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 21:11:06.568084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561460 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561464 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561470 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561473 2572 flags.go:64] FLAG: --kube-reserved="" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561476 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561479 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561482 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561485 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561488 2572 flags.go:64] FLAG: --lock-file="" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561491 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561494 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561497 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561503 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561515 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561518 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561521 2572 flags.go:64] FLAG: --logging-format="text" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561524 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561528 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561531 2572 flags.go:64] FLAG: --manifest-url="" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561534 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561538 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561541 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561546 2572 flags.go:64] FLAG: --max-pods="110" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561548 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561551 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 21:11:06.568832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561554 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561558 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561561 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561563 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561566 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561573 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561577 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561580 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561583 2572 flags.go:64] FLAG: --pod-cidr="" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561588 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561594 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561597 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561600 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561603 2572 flags.go:64] FLAG: --port="10250" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561608 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561611 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d33ba7bdef8d861" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561614 2572 flags.go:64] FLAG: --qos-reserved="" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561617 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561620 2572 flags.go:64] FLAG: --register-node="true" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561623 2572 flags.go:64] FLAG: --register-with-taints="" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561627 2572 flags.go:64] FLAG: --registry-burst="10" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561629 2572 flags.go:64] FLAG: --registry-qps="5" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561632 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561635 2572 flags.go:64] FLAG: --reserved-memory="" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561639 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 21:11:06.569684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561642 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561645 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561648 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561651 2572 flags.go:64] FLAG: --runonce="false" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561653 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561656 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561659 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561662 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561664 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561668 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561671 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561674 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561676 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561680 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561682 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561685 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561688 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561693 2572 flags.go:64] FLAG: --system-cgroups="" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561696 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561701 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561704 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561707 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561714 2572 flags.go:64] FLAG: --tls-min-version="" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561717 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561720 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 21:11:06.570364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561723 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561726 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561729 2572 flags.go:64] FLAG: --v="2" Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561733 2572 flags.go:64] FLAG: --version="false" Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561737 2572 flags.go:64] FLAG: --vmodule="" Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561741 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.561744 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561861 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561865 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561868 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561871 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561874 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561876 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561879 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561882 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561885 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561887 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561890 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561892 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561895 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561898 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:11:06.570989 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561906 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561918 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561921 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561925 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561935 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561938 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561940 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561943 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561946 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561949 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561952 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561954 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561957 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561959 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561962 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561964 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561968 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561972 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561975 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:11:06.571522 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561978 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561981 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561983 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561986 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561988 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561991 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561994 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561997 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.561999 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562014 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562016 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562019 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562021 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562024 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562027 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562029 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562034 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562037 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562045 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562048 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:11:06.572060 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562051 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562054 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562058 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562062 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562065 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562068 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562071 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562088 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562092 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562095 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562098 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562101 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562104 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562107 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562110 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562113 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562115 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562118 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562121 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:11:06.572558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562124 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562127 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562130 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562132 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562135 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562137 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562140 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562142 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562145 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562149 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562152 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562154 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562157 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562162 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562165 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562167 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562170 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562173 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562175 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562178 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:11:06.573037 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562181 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562183 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562186 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562188 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562191 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562194 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.562196 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.562202 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.570509 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.570529 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.570552 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.570558 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570622 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570627 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570631 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:11:06.573524 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570634 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570638 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570641 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570644 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570648 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570653 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570656 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570659 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570662 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570665 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570668 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570671 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570674 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570677 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570680 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570682 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570685 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570687 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570690 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:11:06.573906 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570694 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570698 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570706 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570709 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570712 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570715 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570717 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570721 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570724 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570727 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570729 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570733 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570735 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570739 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570743 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570746 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570748 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570751 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570754 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570756 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:11:06.574436 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570759 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570761 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570764 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570766 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570769 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570771 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570774 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570777 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570779 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570782 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570784 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570787 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570790 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570792 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570795 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570798 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570800 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570802 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570805 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570809 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:11:06.574949 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570811 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570814 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570817 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570820 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570822 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570825 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570827 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570830 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570833 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570836 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570839 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570841 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570844 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570847 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570849 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570851 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570854 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570858 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570860 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:11:06.575558 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570863 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570866 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570868 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570871 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570874 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570876 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570879 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570881 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570884 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570887 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570889 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570892 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570895 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570898 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570901 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570904 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570906 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:11:06.576049 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.570909 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.570914 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571056 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571063 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571066 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571069 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571072 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571075 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571078 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571081 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571083 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571086 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571089 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571091 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 21:11:06.576535 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571095 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571097 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571101 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571103 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571106 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571108 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571111 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571113 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571116 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571118 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571121 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571123 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571126 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571128 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571132 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571134 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571137 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571140 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571142 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571145 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 21:11:06.576883 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571147 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571150 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571153 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571157 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571160 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571162 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571165 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571168 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571170 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571173 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571175 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571178 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571180 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571184 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571187 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571189 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571192 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571194 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571197 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571199 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 21:11:06.577588 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571202 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571206 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571210 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571213 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571215 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571219 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571222 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571225 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571228 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571231 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571233 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571236 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571239 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571241 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571244 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571246 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571249 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571251 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571253 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 21:11:06.578371 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571256 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571258 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571261 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571263 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571266 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571268 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571271 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571274 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571276 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571279 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571282 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571284 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571287 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571289 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571292 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571294 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571297 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571299 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571302 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 21:11:06.578839 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571305 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571308 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571311 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571313 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571316 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571319 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571321 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571324 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:06.571326 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.571332 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.571469 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.573740 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.575086 2572 server.go:1019] "Starting client certificate rotation" Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.575213 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 21:11:06.579377 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.575267 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 21:11:06.579753 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.577744 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 21:11:06.579753 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.578932 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 21:11:06.586466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.586445 2572 log.go:25] "Validated CRI v1 runtime API" Jul 13 21:11:06.588480 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.588464 2572 log.go:25] "Validated CRI v1 image API" Jul 13 21:11:06.589327 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.589302 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 21:11:06.592474 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.592451 2572 fs.go:135] Filesystem UUIDs: map[5f208677-8bd2-4d4b-b061-c862cbf81372:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fa5b7b17-548b-469d-8f6e-05912eeb18cb:/dev/nvme0n1p3] Jul 13 21:11:06.592550 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.592473 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 21:11:06.598997 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.598855 2572 manager.go:216] Machine: {Timestamp:2026-07-13 21:11:06.597390606 +0000 UTC m=+0.354610063 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3027679 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a9651f9cd8ca8aa85ed75322e2440 SystemUUID:ec2a9651-f9cd-8ca8-aa85-ed75322e2440 BootID:87157f41-9c4e-4bf4-8170-21abbab1d40f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:34:7c:c5:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:34:7c:c5:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:5e:3a:b1:93:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 21:11:06.598997 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.598975 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 21:11:06.599173 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.599093 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 21:11:06.602201 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.602167 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 21:11:06.602347 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.602203 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 21:11:06.603101 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.603088 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 21:11:06.603139 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.603104 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 21:11:06.603139 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.603112 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 21:11:06.603338 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.603320 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 21:11:06.603937 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.603922 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 21:11:06.606080 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.606060 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 21:11:06.609903 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.609889 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 13 21:11:06.610045 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.610035 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 21:11:06.610084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.610066 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 13 21:11:06.610113 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.610084 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 21:11:06.610113 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.610103 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 21:11:06.610192 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.610115 2572 kubelet.go:398] "Adding apiserver pod source" Jul 13 21:11:06.610192 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.610126 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 21:11:06.610523 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.610510 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 21:11:06.610561 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.610536 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 21:11:06.613495 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.613476 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 21:11:06.615200 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.615185 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 21:11:06.615253 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.615220 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 21:11:06.615465 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.615451 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 21:11:06.615507 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.615478 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 21:11:06.615507 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.615491 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 21:11:06.615507 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.615502 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 21:11:06.615590 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.615519 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 21:11:06.615590 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.615532 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 21:11:06.616029 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.616018 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 21:11:06.616029 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.616029 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 21:11:06.616401 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.616037 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 21:11:06.616434 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.616401 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 21:11:06.616434 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.616414 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 21:11:06.616434 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.616423 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 21:11:06.617291 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.617280 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 21:11:06.617326 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.617292 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 21:11:06.620563 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.620548 2572 server.go:1268] "Started kubelet" Jul 13 21:11:06.620701 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.620639 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 21:11:06.620756 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.620727 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 21:11:06.620841 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.620659 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 21:11:06.621048 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.621027 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 21:11:06.621154 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.621117 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 21:11:06.621234 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.621177 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 21:11:06.621516 ip-10-0-136-160 systemd[1]: Started Kubernetes Kubelet. Jul 13 21:11:06.621924 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.621908 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 21:11:06.622914 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.622899 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 13 21:11:06.627225 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.627193 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 21:11:06.627719 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.627687 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:06.628255 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.628235 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 21:11:06.628255 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.628257 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 21:11:06.628373 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.627293 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 21:11:06.628475 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.628462 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 21:11:06.628559 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.628549 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 13 21:11:06.628559 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.628558 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 13 21:11:06.628697 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.628680 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 21:11:06.629558 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.628131 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-160.ec2.internal.18c1f5b0af5c039e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-160.ec2.internal,UID:ip-10-0-136-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-160.ec2.internal,},FirstTimestamp:2026-07-13 21:11:06.620519326 +0000 UTC m=+0.377738783,LastTimestamp:2026-07-13 21:11:06.620519326 +0000 UTC m=+0.377738783,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-160.ec2.internal,}" Jul 13 21:11:06.629688 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.629612 2572 factory.go:55] Registering systemd factory Jul 13 21:11:06.629688 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.629630 2572 factory.go:223] Registration of the systemd container factory successfully Jul 13 21:11:06.630105 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.629839 2572 factory.go:153] Registering CRI-O factory Jul 13 21:11:06.630105 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.629858 2572 factory.go:223] Registration of the crio container factory successfully Jul 13 21:11:06.630105 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.629917 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 21:11:06.630105 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.629952 2572 factory.go:103] Registering Raw factory Jul 13 21:11:06.630105 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.629972 2572 manager.go:1196] Started watching for new ooms in manager Jul 13 21:11:06.630912 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.630896 2572 manager.go:349] Starting recovery of all containers Jul 13 21:11:06.635407 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.635380 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 21:11:06.635407 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.635379 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 21:11:06.641958 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.641939 2572 manager.go:354] Recovery completed Jul 13 21:11:06.644236 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.644150 2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 13 21:11:06.647295 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.647282 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:11:06.648327 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.648310 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-csrvv" Jul 13 21:11:06.649198 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.649179 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:11:06.649279 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.649213 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:11:06.649279 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.649224 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:11:06.649787 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.649773 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:11:06.649859 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.649776 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 21:11:06.649859 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.649834 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 21:11:06.649859 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.649851 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 13 21:11:06.650597 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.650579 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:11:06.650649 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.650605 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:11:06.650649 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.650615 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:11:06.650962 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.650893 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-160.ec2.internal.18c1f5b0b1119d4a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-160.ec2.internal,UID:ip-10-0-136-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-160.ec2.internal,},FirstTimestamp:2026-07-13 21:11:06.649197898 +0000 UTC m=+0.406417359,LastTimestamp:2026-07-13 21:11:06.649197898 +0000 UTC m=+0.406417359,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-160.ec2.internal,}" Jul 13 21:11:06.651390 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.651377 2572 policy_none.go:49] "None policy: Start" Jul 13 21:11:06.651436 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.651395 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 21:11:06.651436 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.651405 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 21:11:06.652487 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.652476 2572 policy_none.go:47] "Start" Jul 13 21:11:06.653913 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.653898 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-csrvv" Jul 13 21:11:06.687859 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.687840 2572 manager.go:337] "Starting Device Plugin manager" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.687883 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.687894 2572 server.go:87] "Starting device plugin registration server" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.688166 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.688180 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.688266 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.688343 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.688351 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.688876 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 21:11:06.698781 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.688924 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:06.789157 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.789114 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:11:06.791029 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.790981 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:11:06.791029 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.791034 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:11:06.791213 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.791045 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:11:06.791213 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.791071 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.797998 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.797945 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 21:11:06.799240 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.799222 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 21:11:06.799325 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.799267 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 21:11:06.799325 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.799297 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 21:11:06.799461 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.799340 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 21:11:06.801882 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.801823 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:11:06.802866 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.802854 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.802968 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.802874 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-160.ec2.internal\": node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:06.845025 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.844971 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:06.900388 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.900329 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal"] Jul 13 21:11:06.900558 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.900433 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:11:06.901592 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.901575 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:11:06.901648 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.901607 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:11:06.901648 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.901616 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:11:06.902927 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.902914 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:11:06.903064 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.903046 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.903124 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.903082 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:11:06.903786 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.903766 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:11:06.903884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.903771 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:11:06.903884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.903796 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:11:06.903884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.903806 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:11:06.903884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.903813 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:11:06.903884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.903826 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:11:06.904935 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.904922 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.904982 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.904948 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 21:11:06.905618 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.905605 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 21:11:06.905691 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.905628 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 21:11:06.905691 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.905638 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 21:11:06.930066 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.930036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a27247a1ef66aeabd5d85a7efb6422-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal\" (UID: \"48a27247a1ef66aeabd5d85a7efb6422\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.930195 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.930078 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d6f08ebb51da33ba85c19409801495d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-160.ec2.internal\" (UID: \"1d6f08ebb51da33ba85c19409801495d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.930195 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:06.930098 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48a27247a1ef66aeabd5d85a7efb6422-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal\" (UID: \"48a27247a1ef66aeabd5d85a7efb6422\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.933840 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.933823 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-160.ec2.internal\" not found" node="ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.937281 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.937266 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-160.ec2.internal\" not found" node="ip-10-0-136-160.ec2.internal" Jul 13 21:11:06.945535 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:06.945511 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:07.030201 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.030163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d6f08ebb51da33ba85c19409801495d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-160.ec2.internal\" (UID: \"1d6f08ebb51da33ba85c19409801495d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.030201 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.030197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48a27247a1ef66aeabd5d85a7efb6422-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal\" (UID: \"48a27247a1ef66aeabd5d85a7efb6422\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.030401 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.030217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a27247a1ef66aeabd5d85a7efb6422-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal\" (UID: \"48a27247a1ef66aeabd5d85a7efb6422\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.030401 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.030269 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d6f08ebb51da33ba85c19409801495d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-160.ec2.internal\" (UID: \"1d6f08ebb51da33ba85c19409801495d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.030401 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.030319 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48a27247a1ef66aeabd5d85a7efb6422-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal\" (UID: \"48a27247a1ef66aeabd5d85a7efb6422\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.030401 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.030351 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a27247a1ef66aeabd5d85a7efb6422-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal\" (UID: \"48a27247a1ef66aeabd5d85a7efb6422\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.046338 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.046308 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:07.147193 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.147120 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:07.235675 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.235633 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.240490 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.240471 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.248135 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.248113 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:07.348689 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.348646 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:07.449275 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.449197 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-160.ec2.internal\" not found" Jul 13 21:11:07.521882 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.521848 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:11:07.529952 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.529922 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.539914 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.539891 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 21:11:07.541765 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.541751 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" Jul 13 21:11:07.553531 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.553508 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 21:11:07.574697 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.574662 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 21:11:07.574880 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.574857 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 21:11:07.610283 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.610247 2572 apiserver.go:52] "Watching apiserver" Jul 13 21:11:07.619109 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.619077 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 21:11:07.620082 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.620062 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8","openshift-dns/node-resolver-6g59z","openshift-image-registry/node-ca-glv2s","openshift-multus/multus-additional-cni-plugins-fw94l","openshift-multus/network-metrics-daemon-dhdrv","openshift-network-diagnostics/network-check-target-pgd52","openshift-ovn-kubernetes/ovnkube-node-wq5hl","kube-system/global-pull-secret-syncer-vmb6b","kube-system/konnectivity-agent-vq8n7","openshift-cluster-node-tuning-operator/tuned-5q2hk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal","openshift-multus/multus-ch59v","openshift-network-operator/iptables-alerter-nnj8h"] Jul 13 21:11:07.621347 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.621328 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:07.621414 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.621395 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:07.622356 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.622341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.623306 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.623283 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.624323 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.624305 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.624791 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.624752 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 21:11:07.624912 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.624861 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 21:11:07.624912 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.624879 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pkztb\"" Jul 13 21:11:07.625029 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.624911 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 21:11:07.625386 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.625368 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 21:11:07.625386 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.625430 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 21:11:07.625607 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.625458 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 21:11:07.625607 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.625522 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:07.625743 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.625610 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 21:11:07.625743 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.625616 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:07.625743 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.625611 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 21:11:07.625743 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.625701 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j498h\"" Jul 13 21:11:07.625743 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.625730 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 21:11:07.628306 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.628282 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 21:11:07.628401 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.628300 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 21:11:07.628401 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.628352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.628517 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.628459 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 21:11:07.628517 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.628491 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 21:11:07.629191 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.629020 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 21:11:07.629191 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.629062 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6fkct\"" Jul 13 21:11:07.629370 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.629357 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 21:11:07.630173 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.630156 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.631289 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.631270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.631371 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.631327 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d8kvp\"" Jul 13 21:11:07.631371 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.631336 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:07.631639 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.631625 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 21:11:07.631839 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.631827 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 21:11:07.632235 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632222 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 21:11:07.632359 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632344 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4m5k4\"" Jul 13 21:11:07.632529 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632512 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:07.632529 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632523 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 21:11:07.632713 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632661 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 21:11:07.632848 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-992rv\" (UniqueName: \"kubernetes.io/projected/0f490020-e5a6-4a78-a256-55354cd3050a-kube-api-access-992rv\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:07.632930 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-slash\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.632930 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.632930 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-os-release\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74f7c\" (UniqueName: \"kubernetes.io/projected/f065e8ba-445e-42f0-8e97-1723a3402498-kube-api-access-74f7c\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-hosts-file\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.632983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-cni-bin\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-cni-netd\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-env-overrides\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44g65\" (UniqueName: \"kubernetes.io/projected/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-kube-api-access-44g65\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-systemd\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovnkube-config\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovn-node-metrics-cert\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovnkube-script-lib\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633182 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-system-cni-dir\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-tmp-dir\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633285 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl8tt\" (UniqueName: \"kubernetes.io/projected/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-kube-api-access-xl8tt\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-systemd-units\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-run-netns\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633388 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-device-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633451 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-kubelet\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-etc-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633510 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-ovn\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633531 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a727b5bb-2e2e-452a-af07-263e377a4c65-serviceca\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-socket-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.633595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633570 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-node-log\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-log-socket\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-cni-binary-copy\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633668 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-registration-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633710 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-sys-fs\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a727b5bb-2e2e-452a-af07-263e377a4c65-host\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633749 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-cnibin\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633777 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmcc\" (UniqueName: \"kubernetes.io/projected/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-kube-api-access-pcmcc\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-var-lib-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633895 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hbzm\" (UniqueName: \"kubernetes.io/projected/a727b5bb-2e2e-452a-af07-263e377a4c65-kube-api-access-5hbzm\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.633935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.634382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.634176 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.635129 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.634707 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 21:11:07.635129 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.634777 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zzfvv\"" Jul 13 21:11:07.635129 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.634801 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 21:11:07.635376 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.635359 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.636389 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.636367 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 21:11:07.636389 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.636398 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:11:07.636389 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.636404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kddds\"" Jul 13 21:11:07.636630 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.636615 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.637608 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.637594 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-knsbn\"" Jul 13 21:11:07.637692 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.637680 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 21:11:07.638928 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.638914 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 21:11:07.639549 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.639529 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:11:07.639637 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.639548 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 21:11:07.639637 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.639590 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vhcm9\"" Jul 13 21:11:07.642662 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.642644 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 21:11:07.656504 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.656459 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 21:06:06 +0000 UTC" deadline="2027-12-26 17:50:05.57738746 +0000 UTC" Jul 13 21:11:07.656504 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.656497 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12740h38m57.920893901s" Jul 13 21:11:07.665849 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.665823 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpnkm" Jul 13 21:11:07.674195 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.674175 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpnkm" Jul 13 21:11:07.729232 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.729206 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 21:11:07.734144 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmcc\" (UniqueName: \"kubernetes.io/projected/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-kube-api-access-pcmcc\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.734227 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-multus-certs\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.734227 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-etc-kubernetes\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.734227 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgg2f\" (UniqueName: \"kubernetes.io/projected/b8276b51-b16c-414a-8d19-b4ea57e0ab82-kube-api-access-xgg2f\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.734353 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-var-lib-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734353 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734353 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-k8s-cni-cncf-io\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.734353 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734301 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-dbus\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.734353 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-slash\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734353 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734344 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-var-lib-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734384 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734385 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-os-release\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734408 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-slash\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-hosts-file\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734463 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-conf-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734479 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-os-release\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-cni-bin\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734491 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-hosts-file\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734516 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-cni-bin\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-env-overrides\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734548 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44g65\" (UniqueName: \"kubernetes.io/projected/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-kube-api-access-44g65\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysctl-d\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-sys\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b8f4105-4312-4586-8725-acad2b352520-tmp\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.734647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734628 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-socket-dir-parent\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-daemon-config\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovn-node-metrics-cert\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734768 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovnkube-script-lib\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734794 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-kubelet\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-systemd-units\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-run-netns\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734870 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-systemd-units\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-device-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734920 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-run-netns\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734957 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-kubernetes\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.734982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b8f4105-4312-4586-8725-acad2b352520-etc-tuned\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-ovn\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735052 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-device-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735093 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-ovn\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.735416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a727b5bb-2e2e-452a-af07-263e377a4c65-serviceca\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735096 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-env-overrides\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735126 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-socket-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735172 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735196 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysctl-conf\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735222 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-lib-modules\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-host\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c85sz\" (UniqueName: \"kubernetes.io/projected/34e022a7-7f94-497c-9a95-6407f947e4eb-kube-api-access-c85sz\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735267 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-socket-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-node-log\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735337 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovnkube-script-lib\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735340 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-node-log\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735374 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-cni-binary-copy\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735386 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-registration-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735500 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a727b5bb-2e2e-452a-af07-263e377a4c65-serviceca\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.736127 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-sys-fs\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735545 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-registration-dir\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8276b51-b16c-414a-8d19-b4ea57e0ab82-iptables-alerter-script\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735565 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-sys-fs\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a727b5bb-2e2e-452a-af07-263e377a4c65-host\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735604 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a727b5bb-2e2e-452a-af07-263e377a4c65-host\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-var-lib-kubelet\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hbzm\" (UniqueName: \"kubernetes.io/projected/a727b5bb-2e2e-452a-af07-263e377a4c65-kube-api-access-5hbzm\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-992rv\" (UniqueName: \"kubernetes.io/projected/0f490020-e5a6-4a78-a256-55354cd3050a-kube-api-access-992rv\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-cni-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-os-release\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-cni-multus\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74f7c\" (UniqueName: \"kubernetes.io/projected/f065e8ba-445e-42f0-8e97-1723a3402498-kube-api-access-74f7c\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-cni-netd\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735873 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/010744c3-a370-44db-bf22-df19d606d9f5-agent-certs\") pod \"konnectivity-agent-vq8n7\" (UID: \"010744c3-a370-44db-bf22-df19d606d9f5\") " pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:07.736741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735851 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-cni-binary-copy\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/010744c3-a370-44db-bf22-df19d606d9f5-konnectivity-ca\") pod \"konnectivity-agent-vq8n7\" (UID: \"010744c3-a370-44db-bf22-df19d606d9f5\") " pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysconfig\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-systemd\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.735905 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-cni-netd\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736045 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-run-systemd\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736033 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovnkube-config\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736076 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-system-cni-dir\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736107 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-tmp-dir\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl8tt\" (UniqueName: \"kubernetes.io/projected/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-kube-api-access-xl8tt\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736148 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-system-cni-dir\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86ntn\" (UniqueName: \"kubernetes.io/projected/4b8f4105-4312-4586-8725-acad2b352520-kube-api-access-86ntn\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736179 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736201 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-cni-bin\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736280 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-run\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.737286 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.736348 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736355 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-system-cni-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.736417 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs podName:0f490020-e5a6-4a78-a256-55354cd3050a nodeName:}" failed. No retries permitted until 2026-07-13 21:11:08.236398445 +0000 UTC m=+1.993617919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs") pod "network-metrics-daemon-dhdrv" (UID: "0f490020-e5a6-4a78-a256-55354cd3050a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-kubelet-config\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736505 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-tmp-dir\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-kubelet\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-etc-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736576 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovnkube-config\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-host-kubelet\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736593 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-systemd\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736620 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-etc-openvswitch\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736619 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-cnibin\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34e022a7-7f94-497c-9a95-6407f947e4eb-cni-binary-copy\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8276b51-b16c-414a-8d19-b4ea57e0ab82-host-slash\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.737729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-log-socket\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736705 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-log-socket\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736722 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-modprobe-d\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-netns\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736794 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-hostroot\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-cnibin\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.736910 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f065e8ba-445e-42f0-8e97-1723a3402498-cnibin\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.737056 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.738199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.737095 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f065e8ba-445e-42f0-8e97-1723a3402498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.738471 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.738381 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-ovn-node-metrics-cert\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.746138 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.746113 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:11:07.746138 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.746141 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:11:07.746318 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.746155 2572 projected.go:196] Error preparing data for projected volume kube-api-access-85kn9 for pod openshift-network-diagnostics/network-check-target-pgd52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:07.746318 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.746235 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9 podName:173105cb-64c6-4bb3-9b3e-440f82133666 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:08.246214925 +0000 UTC m=+2.003434372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-85kn9" (UniqueName: "kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9") pod "network-check-target-pgd52" (UID: "173105cb-64c6-4bb3-9b3e-440f82133666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:07.748461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.748371 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl8tt\" (UniqueName: \"kubernetes.io/projected/879b543e-ae6b-47c9-a437-7b6cf22ce7d8-kube-api-access-xl8tt\") pod \"node-resolver-6g59z\" (UID: \"879b543e-ae6b-47c9-a437-7b6cf22ce7d8\") " pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:07.748461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.748397 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmcc\" (UniqueName: \"kubernetes.io/projected/88bcc7ef-08ec-42f8-a9c0-77e86e37f40c-kube-api-access-pcmcc\") pod \"aws-ebs-csi-driver-node-qf5z8\" (UID: \"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:07.748461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.748427 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hbzm\" (UniqueName: \"kubernetes.io/projected/a727b5bb-2e2e-452a-af07-263e377a4c65-kube-api-access-5hbzm\") pod \"node-ca-glv2s\" (UID: \"a727b5bb-2e2e-452a-af07-263e377a4c65\") " pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.748461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.748435 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44g65\" (UniqueName: \"kubernetes.io/projected/81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad-kube-api-access-44g65\") pod \"ovnkube-node-wq5hl\" (UID: \"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.748735 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.748672 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74f7c\" (UniqueName: \"kubernetes.io/projected/f065e8ba-445e-42f0-8e97-1723a3402498-kube-api-access-74f7c\") pod \"multus-additional-cni-plugins-fw94l\" (UID: \"f065e8ba-445e-42f0-8e97-1723a3402498\") " pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.749076 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.749061 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-992rv\" (UniqueName: \"kubernetes.io/projected/0f490020-e5a6-4a78-a256-55354cd3050a-kube-api-access-992rv\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:07.838115 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838076 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8276b51-b16c-414a-8d19-b4ea57e0ab82-iptables-alerter-script\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.838115 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-var-lib-kubelet\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-cni-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-os-release\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-cni-multus\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838265 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-var-lib-kubelet\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/010744c3-a370-44db-bf22-df19d606d9f5-agent-certs\") pod \"konnectivity-agent-vq8n7\" (UID: \"010744c3-a370-44db-bf22-df19d606d9f5\") " pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838310 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-os-release\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838323 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-cni-multus\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/010744c3-a370-44db-bf22-df19d606d9f5-konnectivity-ca\") pod \"konnectivity-agent-vq8n7\" (UID: \"010744c3-a370-44db-bf22-df19d606d9f5\") " pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838361 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-cni-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysconfig\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86ntn\" (UniqueName: \"kubernetes.io/projected/4b8f4105-4312-4586-8725-acad2b352520-kube-api-access-86ntn\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-cni-bin\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.838484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838485 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-run\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838499 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysconfig\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838509 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-system-cni-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-kubelet-config\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838560 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-system-cni-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838604 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-cni-bin\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838609 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-systemd\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838634 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-cnibin\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838647 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-run\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34e022a7-7f94-497c-9a95-6407f947e4eb-cni-binary-copy\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838688 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8276b51-b16c-414a-8d19-b4ea57e0ab82-iptables-alerter-script\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.838730 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838752 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-kubelet-config\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:07.838792 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret podName:c52b4863-bb7b-4548-bb4b-7b1d44cc55b2 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:08.33877497 +0000 UTC m=+2.095994420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret") pod "global-pull-secret-syncer-vmb6b" (UID: "c52b4863-bb7b-4548-bb4b-7b1d44cc55b2") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838804 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-systemd\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838809 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-cnibin\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838838 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8276b51-b16c-414a-8d19-b4ea57e0ab82-host-slash\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-modprobe-d\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838888 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-netns\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-hostroot\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838954 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-multus-certs\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838957 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/010744c3-a370-44db-bf22-df19d606d9f5-konnectivity-ca\") pod \"konnectivity-agent-vq8n7\" (UID: \"010744c3-a370-44db-bf22-df19d606d9f5\") " pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838972 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8276b51-b16c-414a-8d19-b4ea57e0ab82-host-slash\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838978 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-etc-kubernetes\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.838992 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-hostroot\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839031 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgg2f\" (UniqueName: \"kubernetes.io/projected/b8276b51-b16c-414a-8d19-b4ea57e0ab82-kube-api-access-xgg2f\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839043 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-etc-kubernetes\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-k8s-cni-cncf-io\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-dbus\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-conf-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839118 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-multus-certs\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysctl-d\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839146 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-modprobe-d\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-sys\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.839899 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839183 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b8f4105-4312-4586-8725-acad2b352520-tmp\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839192 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-conf-dir\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839206 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-socket-dir-parent\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-daemon-config\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839248 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-dbus\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839033 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-netns\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-kubelet\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839275 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysctl-d\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839249 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34e022a7-7f94-497c-9a95-6407f947e4eb-cni-binary-copy\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839315 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-socket-dir-parent\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839161 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-run-k8s-cni-cncf-io\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839331 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-sys\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839339 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34e022a7-7f94-497c-9a95-6407f947e4eb-host-var-lib-kubelet\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839360 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-kubernetes\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b8f4105-4312-4586-8725-acad2b352520-etc-tuned\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839416 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysctl-conf\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839439 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-lib-modules\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839446 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-kubernetes\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.840466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-host\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.841226 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c85sz\" (UniqueName: \"kubernetes.io/projected/34e022a7-7f94-497c-9a95-6407f947e4eb-kube-api-access-c85sz\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.841226 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839527 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-lib-modules\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.841226 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839657 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-host\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.841226 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839703 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34e022a7-7f94-497c-9a95-6407f947e4eb-multus-daemon-config\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.841226 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.839751 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b8f4105-4312-4586-8725-acad2b352520-etc-sysctl-conf\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.841226 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.840887 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/010744c3-a370-44db-bf22-df19d606d9f5-agent-certs\") pod \"konnectivity-agent-vq8n7\" (UID: \"010744c3-a370-44db-bf22-df19d606d9f5\") " pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:07.842236 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.842218 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b8f4105-4312-4586-8725-acad2b352520-etc-tuned\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.842309 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.842239 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b8f4105-4312-4586-8725-acad2b352520-tmp\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.853798 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.853765 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgg2f\" (UniqueName: \"kubernetes.io/projected/b8276b51-b16c-414a-8d19-b4ea57e0ab82-kube-api-access-xgg2f\") pod \"iptables-alerter-nnj8h\" (UID: \"b8276b51-b16c-414a-8d19-b4ea57e0ab82\") " pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:07.854462 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.854226 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:11:07.854984 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.854629 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c85sz\" (UniqueName: \"kubernetes.io/projected/34e022a7-7f94-497c-9a95-6407f947e4eb-kube-api-access-c85sz\") pod \"multus-ch59v\" (UID: \"34e022a7-7f94-497c-9a95-6407f947e4eb\") " pod="openshift-multus/multus-ch59v" Jul 13 21:11:07.854984 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.854803 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86ntn\" (UniqueName: \"kubernetes.io/projected/4b8f4105-4312-4586-8725-acad2b352520-kube-api-access-86ntn\") pod \"tuned-5q2hk\" (UID: \"4b8f4105-4312-4586-8725-acad2b352520\") " pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:07.906293 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:07.906245 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6f08ebb51da33ba85c19409801495d.slice/crio-c3529ea391c3ddd98362810abbf2c346b445de710326734e868cb8f69bd5c1fd WatchSource:0}: Error finding container c3529ea391c3ddd98362810abbf2c346b445de710326734e868cb8f69bd5c1fd: Status 404 returned error can't find the container with id c3529ea391c3ddd98362810abbf2c346b445de710326734e868cb8f69bd5c1fd Jul 13 21:11:07.906462 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:07.906450 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a27247a1ef66aeabd5d85a7efb6422.slice/crio-29fff6983748ab0766b8c28b9c895b0777a7a64abe7e03c26e9cecea5c1bf55c WatchSource:0}: Error finding container 29fff6983748ab0766b8c28b9c895b0777a7a64abe7e03c26e9cecea5c1bf55c: Status 404 returned error can't find the container with id 29fff6983748ab0766b8c28b9c895b0777a7a64abe7e03c26e9cecea5c1bf55c Jul 13 21:11:07.911070 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.911053 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:11:07.941868 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.941833 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:07.949962 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:07.949936 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f42c7f_f2fc_4fd1_b1a8_19122a5e5fad.slice/crio-2d69b9c40a05d5ad4cdddb6b8b1dd6aca54ee351e7cd71cbbc2c3438f6aee625 WatchSource:0}: Error finding container 2d69b9c40a05d5ad4cdddb6b8b1dd6aca54ee351e7cd71cbbc2c3438f6aee625: Status 404 returned error can't find the container with id 2d69b9c40a05d5ad4cdddb6b8b1dd6aca54ee351e7cd71cbbc2c3438f6aee625 Jul 13 21:11:07.955337 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.955315 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-glv2s" Jul 13 21:11:07.963085 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:07.963059 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda727b5bb_2e2e_452a_af07_263e377a4c65.slice/crio-8a8810ab503c9a8f309cfb34c7cf6381828b7af1190e6e463e7e14ae67e8d70b WatchSource:0}: Error finding container 8a8810ab503c9a8f309cfb34c7cf6381828b7af1190e6e463e7e14ae67e8d70b: Status 404 returned error can't find the container with id 8a8810ab503c9a8f309cfb34c7cf6381828b7af1190e6e463e7e14ae67e8d70b Jul 13 21:11:07.969213 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.969193 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fw94l" Jul 13 21:11:07.976044 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:07.975995 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf065e8ba_445e_42f0_8e97_1723a3402498.slice/crio-39f77267303d42788a0e94785f9040a552b1d5c8b2dcaab90d17ada68c143c57 WatchSource:0}: Error finding container 39f77267303d42788a0e94785f9040a552b1d5c8b2dcaab90d17ada68c143c57: Status 404 returned error can't find the container with id 39f77267303d42788a0e94785f9040a552b1d5c8b2dcaab90d17ada68c143c57 Jul 13 21:11:07.993789 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:07.993760 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6g59z" Jul 13 21:11:08.001205 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:08.001175 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879b543e_ae6b_47c9_a437_7b6cf22ce7d8.slice/crio-46cdf66ff0801a9372f3d73158fa1606fc557a79df64f92c22a47884d0c928d9 WatchSource:0}: Error finding container 46cdf66ff0801a9372f3d73158fa1606fc557a79df64f92c22a47884d0c928d9: Status 404 returned error can't find the container with id 46cdf66ff0801a9372f3d73158fa1606fc557a79df64f92c22a47884d0c928d9 Jul 13 21:11:08.009123 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.009102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" Jul 13 21:11:08.016792 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:08.016761 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88bcc7ef_08ec_42f8_a9c0_77e86e37f40c.slice/crio-b302470a444836d0d12f2cdb7d68a97d5d67e4539b3bab570da2f65bde02b746 WatchSource:0}: Error finding container b302470a444836d0d12f2cdb7d68a97d5d67e4539b3bab570da2f65bde02b746: Status 404 returned error can't find the container with id b302470a444836d0d12f2cdb7d68a97d5d67e4539b3bab570da2f65bde02b746 Jul 13 21:11:08.025681 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.025661 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:08.032557 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:08.032533 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010744c3_a370_44db_bf22_df19d606d9f5.slice/crio-7a132025b5e5f53daa062c98e97df48c0c38d7e5650582622c0d5fc307122697 WatchSource:0}: Error finding container 7a132025b5e5f53daa062c98e97df48c0c38d7e5650582622c0d5fc307122697: Status 404 returned error can't find the container with id 7a132025b5e5f53daa062c98e97df48c0c38d7e5650582622c0d5fc307122697 Jul 13 21:11:08.047998 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.047965 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" Jul 13 21:11:08.055386 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:08.055358 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8f4105_4312_4586_8725_acad2b352520.slice/crio-647b7da1a00512ecf0ef1ec58b0361f75a3010704dfcd746ff2c5053dfc5ae89 WatchSource:0}: Error finding container 647b7da1a00512ecf0ef1ec58b0361f75a3010704dfcd746ff2c5053dfc5ae89: Status 404 returned error can't find the container with id 647b7da1a00512ecf0ef1ec58b0361f75a3010704dfcd746ff2c5053dfc5ae89 Jul 13 21:11:08.070554 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.070529 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:11:08.071603 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.071583 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ch59v" Jul 13 21:11:08.077607 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.077589 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnj8h" Jul 13 21:11:08.079485 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:08.079457 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e022a7_7f94_497c_9a95_6407f947e4eb.slice/crio-9228dd9a8121ce75790e1922c491eb6dc42deb4b2a339026bf9d2a494f52f352 WatchSource:0}: Error finding container 9228dd9a8121ce75790e1922c491eb6dc42deb4b2a339026bf9d2a494f52f352: Status 404 returned error can't find the container with id 9228dd9a8121ce75790e1922c491eb6dc42deb4b2a339026bf9d2a494f52f352 Jul 13 21:11:08.084813 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:08.084790 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8276b51_b16c_414a_8d19_b4ea57e0ab82.slice/crio-bd2df7b2033cbc8d151305d45102897a7f49029ecb60eb06337772a7e3232b10 WatchSource:0}: Error finding container bd2df7b2033cbc8d151305d45102897a7f49029ecb60eb06337772a7e3232b10: Status 404 returned error can't find the container with id bd2df7b2033cbc8d151305d45102897a7f49029ecb60eb06337772a7e3232b10 Jul 13 21:11:08.086545 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.086529 2572 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-nnj8h_openshift-network-operator(b8276b51-b16c-414a-8d19-b4ea57e0ab82): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 13 21:11:08.086599 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.086557 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-nnj8h" podUID="b8276b51-b16c-414a-8d19-b4ea57e0ab82" Jul 13 21:11:08.242499 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.242463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:08.242671 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.242596 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:08.242671 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.242647 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs podName:0f490020-e5a6-4a78-a256-55354cd3050a nodeName:}" failed. No retries permitted until 2026-07-13 21:11:09.242634805 +0000 UTC m=+2.999854250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs") pod "network-metrics-daemon-dhdrv" (UID: "0f490020-e5a6-4a78-a256-55354cd3050a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:08.343161 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.343123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:08.343363 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.343236 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:08.343363 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.343291 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:11:08.343363 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.343310 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:11:08.343363 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.343322 2572 projected.go:196] Error preparing data for projected volume kube-api-access-85kn9 for pod openshift-network-diagnostics/network-check-target-pgd52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:08.343363 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.343345 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:08.343629 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.343385 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret podName:c52b4863-bb7b-4548-bb4b-7b1d44cc55b2 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:09.343369379 +0000 UTC m=+3.100588837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret") pod "global-pull-secret-syncer-vmb6b" (UID: "c52b4863-bb7b-4548-bb4b-7b1d44cc55b2") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:08.343629 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.343404 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9 podName:173105cb-64c6-4bb3-9b3e-440f82133666 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:09.34339515 +0000 UTC m=+3.100614596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-85kn9" (UniqueName: "kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9") pod "network-check-target-pgd52" (UID: "173105cb-64c6-4bb3-9b3e-440f82133666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:08.676930 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.676787 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:06:07 +0000 UTC" deadline="2028-04-14 19:23:47.137165362 +0000 UTC" Jul 13 21:11:08.676930 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.676879 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15382h12m38.460290168s" Jul 13 21:11:08.801323 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.800456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:08.801323 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.800615 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:08.801323 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.800456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:08.801323 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.801090 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:08.818033 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.817605 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnj8h" event={"ID":"b8276b51-b16c-414a-8d19-b4ea57e0ab82","Type":"ContainerStarted","Data":"bd2df7b2033cbc8d151305d45102897a7f49029ecb60eb06337772a7e3232b10"} Jul 13 21:11:08.820792 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:08.820755 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-nnj8h" podUID="b8276b51-b16c-414a-8d19-b4ea57e0ab82" Jul 13 21:11:08.830186 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.828893 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ch59v" event={"ID":"34e022a7-7f94-497c-9a95-6407f947e4eb","Type":"ContainerStarted","Data":"9228dd9a8121ce75790e1922c491eb6dc42deb4b2a339026bf9d2a494f52f352"} Jul 13 21:11:08.832148 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.832082 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" event={"ID":"4b8f4105-4312-4586-8725-acad2b352520","Type":"ContainerStarted","Data":"647b7da1a00512ecf0ef1ec58b0361f75a3010704dfcd746ff2c5053dfc5ae89"} Jul 13 21:11:08.835031 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.834154 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vq8n7" event={"ID":"010744c3-a370-44db-bf22-df19d606d9f5","Type":"ContainerStarted","Data":"7a132025b5e5f53daa062c98e97df48c0c38d7e5650582622c0d5fc307122697"} Jul 13 21:11:08.845355 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.845265 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6g59z" event={"ID":"879b543e-ae6b-47c9-a437-7b6cf22ce7d8","Type":"ContainerStarted","Data":"46cdf66ff0801a9372f3d73158fa1606fc557a79df64f92c22a47884d0c928d9"} Jul 13 21:11:08.855082 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.855049 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw94l" event={"ID":"f065e8ba-445e-42f0-8e97-1723a3402498","Type":"ContainerStarted","Data":"39f77267303d42788a0e94785f9040a552b1d5c8b2dcaab90d17ada68c143c57"} Jul 13 21:11:08.857061 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.857031 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-glv2s" event={"ID":"a727b5bb-2e2e-452a-af07-263e377a4c65","Type":"ContainerStarted","Data":"8a8810ab503c9a8f309cfb34c7cf6381828b7af1190e6e463e7e14ae67e8d70b"} Jul 13 21:11:08.860057 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.860030 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"2d69b9c40a05d5ad4cdddb6b8b1dd6aca54ee351e7cd71cbbc2c3438f6aee625"} Jul 13 21:11:08.862849 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.862792 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" event={"ID":"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c","Type":"ContainerStarted","Data":"b302470a444836d0d12f2cdb7d68a97d5d67e4539b3bab570da2f65bde02b746"} Jul 13 21:11:08.871960 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.871876 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" event={"ID":"48a27247a1ef66aeabd5d85a7efb6422","Type":"ContainerStarted","Data":"29fff6983748ab0766b8c28b9c895b0777a7a64abe7e03c26e9cecea5c1bf55c"} Jul 13 21:11:08.891355 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.891287 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" event={"ID":"1d6f08ebb51da33ba85c19409801495d","Type":"ContainerStarted","Data":"c3529ea391c3ddd98362810abbf2c346b445de710326734e868cb8f69bd5c1fd"} Jul 13 21:11:08.943573 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:08.943484 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 21:11:09.251845 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:09.251704 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:09.252071 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.251935 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:09.252071 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.252004 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs podName:0f490020-e5a6-4a78-a256-55354cd3050a nodeName:}" failed. No retries permitted until 2026-07-13 21:11:11.251986003 +0000 UTC m=+5.009205465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs") pod "network-metrics-daemon-dhdrv" (UID: "0f490020-e5a6-4a78-a256-55354cd3050a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:09.353583 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:09.352604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:09.353583 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:09.352683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:09.353583 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.352846 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:09.353583 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.352912 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret podName:c52b4863-bb7b-4548-bb4b-7b1d44cc55b2 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:11.352892693 +0000 UTC m=+5.110112157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret") pod "global-pull-secret-syncer-vmb6b" (UID: "c52b4863-bb7b-4548-bb4b-7b1d44cc55b2") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:09.353583 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.353413 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:11:09.353583 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.353439 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:11:09.353583 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.353452 2572 projected.go:196] Error preparing data for projected volume kube-api-access-85kn9 for pod openshift-network-diagnostics/network-check-target-pgd52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:09.353583 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.353505 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9 podName:173105cb-64c6-4bb3-9b3e-440f82133666 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:11.353487779 +0000 UTC m=+5.110707243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-85kn9" (UniqueName: "kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9") pod "network-check-target-pgd52" (UID: "173105cb-64c6-4bb3-9b3e-440f82133666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:09.678239 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:09.678132 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:06:07 +0000 UTC" deadline="2028-02-11 14:54:18.058106354 +0000 UTC" Jul 13 21:11:09.678239 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:09.678183 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13865h43m8.379928477s" Jul 13 21:11:09.800137 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:09.800104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:09.800332 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:09.800237 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:10.802669 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:10.802635 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:10.803165 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:10.802767 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:10.803230 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:10.803189 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:10.803321 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:10.803291 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:11.271996 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:11.271935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:11.272202 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.272143 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:11.272267 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.272209 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs podName:0f490020-e5a6-4a78-a256-55354cd3050a nodeName:}" failed. No retries permitted until 2026-07-13 21:11:15.272188571 +0000 UTC m=+9.029408019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs") pod "network-metrics-daemon-dhdrv" (UID: "0f490020-e5a6-4a78-a256-55354cd3050a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:11.373196 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:11.373036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:11.373196 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:11.373111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:11.373406 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.373231 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:11.373406 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.373252 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:11:11.373406 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.373280 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:11:11.373406 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.373292 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret podName:c52b4863-bb7b-4548-bb4b-7b1d44cc55b2 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:15.373273619 +0000 UTC m=+9.130493066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret") pod "global-pull-secret-syncer-vmb6b" (UID: "c52b4863-bb7b-4548-bb4b-7b1d44cc55b2") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:11.373406 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.373293 2572 projected.go:196] Error preparing data for projected volume kube-api-access-85kn9 for pod openshift-network-diagnostics/network-check-target-pgd52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:11.373406 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.373355 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9 podName:173105cb-64c6-4bb3-9b3e-440f82133666 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:15.373335907 +0000 UTC m=+9.130555375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-85kn9" (UniqueName: "kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9") pod "network-check-target-pgd52" (UID: "173105cb-64c6-4bb3-9b3e-440f82133666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:11.800504 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:11.800466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:11.800694 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:11.800609 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:12.801628 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:12.801108 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:12.801628 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:12.801253 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:12.801628 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:12.801519 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:12.802246 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:12.801676 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:13.799692 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:13.799655 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:13.799901 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:13.799810 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:14.800305 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:14.800273 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:14.800775 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:14.800396 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:14.800846 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:14.800282 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:14.801382 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:14.800936 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:15.309119 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:15.309059 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:15.309317 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.309217 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:15.309317 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.309294 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs podName:0f490020-e5a6-4a78-a256-55354cd3050a nodeName:}" failed. No retries permitted until 2026-07-13 21:11:23.309273339 +0000 UTC m=+17.066492792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs") pod "network-metrics-daemon-dhdrv" (UID: "0f490020-e5a6-4a78-a256-55354cd3050a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:15.409749 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:15.409551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:15.409749 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:15.409692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:15.409749 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.409749 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:11:15.410074 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.409774 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:11:15.410074 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.409788 2572 projected.go:196] Error preparing data for projected volume kube-api-access-85kn9 for pod openshift-network-diagnostics/network-check-target-pgd52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:15.410074 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.409809 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:15.410074 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.409848 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9 podName:173105cb-64c6-4bb3-9b3e-440f82133666 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:23.409826994 +0000 UTC m=+17.167046465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-85kn9" (UniqueName: "kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9") pod "network-check-target-pgd52" (UID: "173105cb-64c6-4bb3-9b3e-440f82133666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:15.410074 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.409869 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret podName:c52b4863-bb7b-4548-bb4b-7b1d44cc55b2 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:23.409859681 +0000 UTC m=+17.167079132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret") pod "global-pull-secret-syncer-vmb6b" (UID: "c52b4863-bb7b-4548-bb4b-7b1d44cc55b2") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:15.800194 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:15.800113 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:15.800376 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:15.800244 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:16.801224 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:16.801032 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:16.801224 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:16.801164 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:16.801757 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:16.801538 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:16.801757 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:16.801606 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:17.799980 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:17.799943 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:17.800192 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:17.800102 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:18.800505 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:18.800464 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:18.800975 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:18.800603 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:18.800975 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:18.800651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:18.800975 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:18.800772 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:19.800503 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:19.800473 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:19.800679 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:19.800594 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:20.800516 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:20.800484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:20.800710 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:20.800604 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:20.800710 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:20.800661 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:20.801110 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:20.800805 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:21.800409 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:21.800373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:21.800581 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:21.800506 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:22.800412 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:22.800377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:22.800858 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:22.800718 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:22.800973 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:22.800948 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:22.801115 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:22.801067 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:23.367334 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:23.367292 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:23.367540 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.367475 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:23.367602 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.367556 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs podName:0f490020-e5a6-4a78-a256-55354cd3050a nodeName:}" failed. No retries permitted until 2026-07-13 21:11:39.367535475 +0000 UTC m=+33.124754927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs") pod "network-metrics-daemon-dhdrv" (UID: "0f490020-e5a6-4a78-a256-55354cd3050a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:23.468477 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:23.468449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:23.468599 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:23.468497 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:23.468599 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.468591 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:23.468664 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.468612 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:11:23.468664 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.468634 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:11:23.468664 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.468638 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret podName:c52b4863-bb7b-4548-bb4b-7b1d44cc55b2 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:39.46862478 +0000 UTC m=+33.225844225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret") pod "global-pull-secret-syncer-vmb6b" (UID: "c52b4863-bb7b-4548-bb4b-7b1d44cc55b2") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:23.468664 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.468643 2572 projected.go:196] Error preparing data for projected volume kube-api-access-85kn9 for pod openshift-network-diagnostics/network-check-target-pgd52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:23.468805 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.468685 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9 podName:173105cb-64c6-4bb3-9b3e-440f82133666 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:39.468673049 +0000 UTC m=+33.225892508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-85kn9" (UniqueName: "kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9") pod "network-check-target-pgd52" (UID: "173105cb-64c6-4bb3-9b3e-440f82133666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:23.800536 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:23.800501 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:23.801017 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:23.800621 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:24.800552 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:24.800516 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:24.801048 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:24.800653 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:24.801048 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:24.800674 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:24.801048 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:24.800807 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:25.799600 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:25.799565 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:25.799790 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:25.799693 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:26.800713 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:26.800682 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:26.801224 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:26.800797 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:26.801224 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:26.800850 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:26.801224 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:26.800928 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:27.799526 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.799474 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:27.799657 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:27.799634 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:27.946022 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.945985 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:11:27.946467 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.946444 2572 generic.go:356] "Generic (PLEG): container finished" podID="81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad" containerID="3d66b26729f3d9985ecc9fd7333c888e9ee0896b703add3379828f4b018f4f0a" exitCode=1 Jul 13 21:11:27.946553 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.946526 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"b10602a512040b6095246c18970d0173bfb96d1c47847e65153579afbc60051d"} Jul 13 21:11:27.946608 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.946595 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerDied","Data":"3d66b26729f3d9985ecc9fd7333c888e9ee0896b703add3379828f4b018f4f0a"} Jul 13 21:11:27.946654 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.946630 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"f1d9032acf8d3216e5ea7b098715bcab33bb78aa2e33b3c4f0f30f175d42e1dc"} Jul 13 21:11:27.948485 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.948455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" event={"ID":"1d6f08ebb51da33ba85c19409801495d","Type":"ContainerStarted","Data":"d8eb80c4ef1cece81c4d572f37d041629903fe70d4bcc75e714e884679c8491b"} Jul 13 21:11:27.950180 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.950155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ch59v" event={"ID":"34e022a7-7f94-497c-9a95-6407f947e4eb","Type":"ContainerStarted","Data":"cc3649442a1beccf8728354c9ccba7e107069351cbc8c76672e9a3b05b986d69"} Jul 13 21:11:27.951868 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.951847 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" event={"ID":"4b8f4105-4312-4586-8725-acad2b352520","Type":"ContainerStarted","Data":"7e58bb7531db43da228be62a15daa862b7310713d5aa2a86c3b6b245f0b8b6bf"} Jul 13 21:11:27.962193 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.962142 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-160.ec2.internal" podStartSLOduration=20.962128865 podStartE2EDuration="20.962128865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:27.961869558 +0000 UTC m=+21.719089025" watchObservedRunningTime="2026-07-13 21:11:27.962128865 +0000 UTC m=+21.719348331" Jul 13 21:11:27.981442 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:27.978699 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5q2hk" podStartSLOduration=1.5952970149999999 podStartE2EDuration="20.978675375s" totalImagesPullingTime="19.38337836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:27.977341911 +0000 UTC m=+21.734561380" watchObservedRunningTime="2026-07-13 21:11:27.978675375 +0000 UTC m=+21.735894843" Jul 13 21:11:28.800390 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.800114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:28.800602 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.800115 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:28.800602 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:28.800455 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:28.800602 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:28.800545 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:28.955517 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.955481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vq8n7" event={"ID":"010744c3-a370-44db-bf22-df19d606d9f5","Type":"ContainerStarted","Data":"f9c506d2205edd5a3e83650f52a22b0557771720be3380e9a3ffe259e7b082be"} Jul 13 21:11:28.956951 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.956927 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6g59z" event={"ID":"879b543e-ae6b-47c9-a437-7b6cf22ce7d8","Type":"ContainerStarted","Data":"9712442db8696aa94d99f620d5e6910b73862429e61ba3a6d7cc53391f8dd4f8"} Jul 13 21:11:28.958405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.958381 2572 generic.go:356] "Generic (PLEG): container finished" podID="f065e8ba-445e-42f0-8e97-1723a3402498" containerID="ebcdc58ad70deb0f980cf38f423a0525605721efc334d4b7615827e4bc56b6b3" exitCode=0 Jul 13 21:11:28.958503 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.958453 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw94l" event={"ID":"f065e8ba-445e-42f0-8e97-1723a3402498","Type":"ContainerDied","Data":"ebcdc58ad70deb0f980cf38f423a0525605721efc334d4b7615827e4bc56b6b3"} Jul 13 21:11:28.959929 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.959900 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-glv2s" event={"ID":"a727b5bb-2e2e-452a-af07-263e377a4c65","Type":"ContainerStarted","Data":"8a9f00c70d122037da4d2eacfb3f5c699b1d8ed5a98d42553e6c6977141a6ca9"} Jul 13 21:11:28.962589 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.962568 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:11:28.962974 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.962942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"19037215d1d8d4d478c9c8b7c30b0890f8dfd846f2274bb755a804ea888299c4"} Jul 13 21:11:28.963079 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.963042 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"92bbd6e0b0a24de5dcdc02352e65bdd8d84648c2e63259c6ec1440a1617fa4b2"} Jul 13 21:11:28.963120 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.963099 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"0e06c6f0a96fb5548e209c264a277c60de9c6ff2a2651046376cc9c762898906"} Jul 13 21:11:28.964452 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.964430 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" event={"ID":"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c","Type":"ContainerStarted","Data":"277a6d4d1fc8a35d11f19f26d0fe6225e05ac72eaf496d872205ab789df9c329"} Jul 13 21:11:28.966316 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.966295 2572 generic.go:356] "Generic (PLEG): container finished" podID="48a27247a1ef66aeabd5d85a7efb6422" containerID="e9af4f9db0cdf3e1fedddae03d49b5fedb563d3cd9688d511d7142ced947a8f9" exitCode=0 Jul 13 21:11:28.966423 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.966401 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" event={"ID":"48a27247a1ef66aeabd5d85a7efb6422","Type":"ContainerDied","Data":"e9af4f9db0cdf3e1fedddae03d49b5fedb563d3cd9688d511d7142ced947a8f9"} Jul 13 21:11:28.969287 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.969247 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vq8n7" podStartSLOduration=2.5649599910000003 podStartE2EDuration="21.969230048s" totalImagesPullingTime="19.404270057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:28.968975832 +0000 UTC m=+22.726195292" watchObservedRunningTime="2026-07-13 21:11:28.969230048 +0000 UTC m=+22.726449516" Jul 13 21:11:28.969422 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.969403 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ch59v" podStartSLOduration=2.3237581130000002 podStartE2EDuration="21.969396284s" totalImagesPullingTime="19.645638171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:27.998048142 +0000 UTC m=+21.755267613" watchObservedRunningTime="2026-07-13 21:11:28.969396284 +0000 UTC m=+22.726615752" Jul 13 21:11:28.981915 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:28.981865 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-glv2s" podStartSLOduration=2.508268415 podStartE2EDuration="21.98185327s" totalImagesPullingTime="19.473584855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:28.981807607 +0000 UTC m=+22.739027078" watchObservedRunningTime="2026-07-13 21:11:28.98185327 +0000 UTC m=+22.739072736" Jul 13 21:11:29.035157 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.035107 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6g59z" podStartSLOduration=2.59928352 podStartE2EDuration="22.035087378s" totalImagesPullingTime="19.435803858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:29.035028211 +0000 UTC m=+22.792247672" watchObservedRunningTime="2026-07-13 21:11:29.035087378 +0000 UTC m=+22.792306847" Jul 13 21:11:29.339801 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.339772 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 21:11:29.703685 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.703525 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T21:11:29.339792616Z","UUID":"a3203a11-9cbf-4296-b169-d92342298366","Handler":null,"Name":"","Endpoint":""} Jul 13 21:11:29.705318 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.705290 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 21:11:29.705458 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.705332 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 21:11:29.800622 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.800588 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:29.800816 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:29.800722 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:29.971105 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.971015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" event={"ID":"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c","Type":"ContainerStarted","Data":"520b42654ef36e5d374a09edb15a1d94510ca1db56f01455fdc1cb18895f5f00"} Jul 13 21:11:29.973427 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.973374 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" event={"ID":"48a27247a1ef66aeabd5d85a7efb6422","Type":"ContainerStarted","Data":"bdaa9a6e710e6d6c695da000cf9cd5f0d419cb90862db9f675caff3e6cd895b2"} Jul 13 21:11:29.975435 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.975401 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnj8h" event={"ID":"b8276b51-b16c-414a-8d19-b4ea57e0ab82","Type":"ContainerStarted","Data":"33817f36d1b672e58f6b0f60feeff8ed9c30091ae7934de718a286652698dfbc"} Jul 13 21:11:29.988054 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:29.987979 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-160.ec2.internal" podStartSLOduration=22.987876727 podStartE2EDuration="22.987876727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:29.987498075 +0000 UTC m=+23.744717542" watchObservedRunningTime="2026-07-13 21:11:29.987876727 +0000 UTC m=+23.745096196" Jul 13 21:11:30.001680 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:30.001621 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nnj8h" podStartSLOduration=23.001598023 podStartE2EDuration="23.001598023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-13 21:11:30.001396646 +0000 UTC m=+23.758616113" watchObservedRunningTime="2026-07-13 21:11:30.001598023 +0000 UTC m=+23.758817493" Jul 13 21:11:30.800157 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:30.800121 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:30.800392 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:30.800121 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:30.800392 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:30.800264 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:30.800392 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:30.800343 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:30.982096 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:30.982066 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:11:30.982614 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:30.982585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"6f3f54ce63246538470cc542d3c96069375945c6338bba702e2b2d827bf469ac"} Jul 13 21:11:30.985677 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:30.985648 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" event={"ID":"88bcc7ef-08ec-42f8-a9c0-77e86e37f40c","Type":"ContainerStarted","Data":"b142f8a2e94642dee19bebee278387d183a480e89d285908b4a7e1e59e2d6c9a"} Jul 13 21:11:31.004741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:31.004669 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qf5z8" podStartSLOduration=2.258941417 podStartE2EDuration="24.004649986s" totalImagesPullingTime="21.745708569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:31.004318413 +0000 UTC m=+24.761537881" watchObservedRunningTime="2026-07-13 21:11:31.004649986 +0000 UTC m=+24.761869456" Jul 13 21:11:31.067598 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:31.067511 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:31.799974 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:31.799945 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:31.800179 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:31.800081 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:32.144622 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:32.144529 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:32.145271 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:32.145252 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:32.800257 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:32.800223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:32.800443 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:32.800332 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:32.800443 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:32.800364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:32.800556 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:32.800449 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:33.003326 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:33.003089 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vq8n7" Jul 13 21:11:33.800535 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:33.800501 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:33.801482 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:33.800628 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:33.994855 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:33.994822 2572 generic.go:356] "Generic (PLEG): container finished" podID="f065e8ba-445e-42f0-8e97-1723a3402498" containerID="26fc62356871ec907b0434f35077975bd735bfed5038ef69cb4e1f0804834676" exitCode=0 Jul 13 21:11:33.995082 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:33.994907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw94l" event={"ID":"f065e8ba-445e-42f0-8e97-1723a3402498","Type":"ContainerDied","Data":"26fc62356871ec907b0434f35077975bd735bfed5038ef69cb4e1f0804834676"} Jul 13 21:11:33.998357 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:33.998338 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:11:33.998758 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:33.998733 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"b216b630c30b7fd3b7c7d9542b01dd77c9170a82d720b686c792fa488aeca387"} Jul 13 21:11:33.999185 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:33.999170 2572 scope.go:117] "RemoveContainer" containerID="3d66b26729f3d9985ecc9fd7333c888e9ee0896b703add3379828f4b018f4f0a" Jul 13 21:11:34.799875 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:34.799654 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:34.800077 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:34.799654 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:34.800077 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:34.799968 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:34.800175 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:34.800086 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:35.006343 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.006312 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:11:35.006772 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.006742 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" event={"ID":"81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad","Type":"ContainerStarted","Data":"7470f48ca4adc6271a8571abb98773a0f72d14d2c9d3966e3bff0844549203d9"} Jul 13 21:11:35.011269 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.009992 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:35.011269 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.010154 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:35.011269 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.010224 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:35.030900 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.030762 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:35.030974 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.030912 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:11:35.041721 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.041670 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" podStartSLOduration=9.52257792 podStartE2EDuration="29.041652951s" totalImagesPullingTime="19.519075031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:35.041624508 +0000 UTC m=+28.798843975" watchObservedRunningTime="2026-07-13 21:11:35.041652951 +0000 UTC m=+28.798872396" Jul 13 21:11:35.471560 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.471475 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmb6b"] Jul 13 21:11:35.471709 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.471635 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:35.471773 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:35.471748 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:35.474812 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.474775 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgd52"] Jul 13 21:11:35.474930 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.474899 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:35.475044 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:35.475022 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:35.475451 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.475427 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhdrv"] Jul 13 21:11:35.475562 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:35.475525 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:35.475632 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:35.475614 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:36.011017 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:36.010981 2572 generic.go:356] "Generic (PLEG): container finished" podID="f065e8ba-445e-42f0-8e97-1723a3402498" containerID="20bfbec72a8f61e611a63bd04cb717d2342d1b428757a4dff3092d4e4037f99a" exitCode=0 Jul 13 21:11:36.011494 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:36.011069 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw94l" event={"ID":"f065e8ba-445e-42f0-8e97-1723a3402498","Type":"ContainerDied","Data":"20bfbec72a8f61e611a63bd04cb717d2342d1b428757a4dff3092d4e4037f99a"} Jul 13 21:11:36.805906 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:36.805875 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:36.806083 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:36.805875 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:36.806083 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:36.805988 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:36.806083 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:36.806057 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:37.799790 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:37.799748 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:37.800193 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:37.799877 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:38.017196 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:38.017165 2572 generic.go:356] "Generic (PLEG): container finished" podID="f065e8ba-445e-42f0-8e97-1723a3402498" containerID="8b731cca16235cbeb858d53f7bd531be7a5fdb14b951acf6c0c2092bae3a41eb" exitCode=0 Jul 13 21:11:38.017386 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:38.017234 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw94l" event={"ID":"f065e8ba-445e-42f0-8e97-1723a3402498","Type":"ContainerDied","Data":"8b731cca16235cbeb858d53f7bd531be7a5fdb14b951acf6c0c2092bae3a41eb"} Jul 13 21:11:38.803363 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:38.803329 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:38.803363 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:38.803359 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:38.803817 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:38.803446 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmb6b" podUID="c52b4863-bb7b-4548-bb4b-7b1d44cc55b2" Jul 13 21:11:38.803817 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:38.803578 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgd52" podUID="173105cb-64c6-4bb3-9b3e-440f82133666" Jul 13 21:11:39.391738 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:39.391700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:39.391899 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.391874 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:39.391965 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.391954 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs podName:0f490020-e5a6-4a78-a256-55354cd3050a nodeName:}" failed. No retries permitted until 2026-07-13 21:12:11.39193336 +0000 UTC m=+65.149152825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs") pod "network-metrics-daemon-dhdrv" (UID: "0f490020-e5a6-4a78-a256-55354cd3050a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 21:11:39.492503 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:39.492456 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:39.492684 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:39.492544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:39.492684 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.492624 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:39.492684 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.492668 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 21:11:39.492816 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.492688 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 21:11:39.492816 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.492698 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret podName:c52b4863-bb7b-4548-bb4b-7b1d44cc55b2 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:11.492678418 +0000 UTC m=+65.249897877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret") pod "global-pull-secret-syncer-vmb6b" (UID: "c52b4863-bb7b-4548-bb4b-7b1d44cc55b2") : object "kube-system"/"original-pull-secret" not registered Jul 13 21:11:39.492816 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.492702 2572 projected.go:196] Error preparing data for projected volume kube-api-access-85kn9 for pod openshift-network-diagnostics/network-check-target-pgd52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:39.492816 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.492754 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9 podName:173105cb-64c6-4bb3-9b3e-440f82133666 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:11.49273636 +0000 UTC m=+65.249955826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-85kn9" (UniqueName: "kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9") pod "network-check-target-pgd52" (UID: "173105cb-64c6-4bb3-9b3e-440f82133666") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 21:11:39.799517 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:39.799484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:39.799686 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:39.799614 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdrv" podUID="0f490020-e5a6-4a78-a256-55354cd3050a" Jul 13 21:11:40.550676 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.550413 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-160.ec2.internal" event="NodeReady" Jul 13 21:11:40.551130 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.550743 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 21:11:40.599614 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.599579 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm"] Jul 13 21:11:40.627157 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.627120 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bd7dcffb8-5nngz"] Jul 13 21:11:40.627319 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.627273 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm" Jul 13 21:11:40.631257 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.631220 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.631452 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.631430 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-94nmh\"" Jul 13 21:11:40.632210 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.631309 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.648614 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.648585 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl"] Jul 13 21:11:40.648780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.648735 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.652404 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.652186 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 21:11:40.652404 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.652248 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 21:11:40.652404 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.652198 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 21:11:40.652697 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.652545 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2ksct\"" Jul 13 21:11:40.658605 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.658576 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 21:11:40.668939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.668909 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5"] Jul 13 21:11:40.669111 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.669073 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.673391 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.672301 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xxwbt\"" Jul 13 21:11:40.673391 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.672385 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.673391 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.672619 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 13 21:11:40.673391 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.672824 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 13 21:11:40.673391 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.672952 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.686770 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.686737 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm"] Jul 13 21:11:40.686906 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.686880 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.690133 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.690071 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qsqnt\"" Jul 13 21:11:40.690267 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.690097 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.690342 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.690291 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.690608 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.690587 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 13 21:11:40.690825 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.690807 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 13 21:11:40.700812 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.700782 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm"] Jul 13 21:11:40.700961 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.700824 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n"] Jul 13 21:11:40.700961 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.700911 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:40.703538 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.703413 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 21:11:40.703538 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.703439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pwdd\" (UniqueName: \"kubernetes.io/projected/88d8ae4b-64db-4023-874e-59fd9547cf03-kube-api-access-8pwdd\") pod \"volume-data-source-validator-78495597f6-sjwnm\" (UID: \"88d8ae4b-64db-4023-874e-59fd9547cf03\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm" Jul 13 21:11:40.703538 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.703535 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m8tk7\"" Jul 13 21:11:40.703821 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.703552 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.703821 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.703537 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.717143 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.717105 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-cd8gg"] Jul 13 21:11:40.717389 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.717251 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.719827 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.719796 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 13 21:11:40.719988 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.719843 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.719988 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.719869 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.719988 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.719969 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9f5vs\"" Jul 13 21:11:40.720182 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.720124 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 13 21:11:40.733226 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.733185 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6nwhm"] Jul 13 21:11:40.733797 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.733730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.736606 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.736302 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.736606 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.736320 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 13 21:11:40.736606 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.736589 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 13 21:11:40.736897 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.736880 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.737191 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.737163 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-22b9m\"" Jul 13 21:11:40.741136 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.741107 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 13 21:11:40.747238 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.747196 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-648d4b6868-z7k6f"] Jul 13 21:11:40.747395 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.747365 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:40.749865 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.749840 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.749984 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.749945 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 21:11:40.750046 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.749997 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.750097 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.750070 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-47czm\"" Jul 13 21:11:40.750325 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.750308 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 21:11:40.758220 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.758115 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 21:11:40.759869 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.759846 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4gngg"] Jul 13 21:11:40.760104 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.760086 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:40.762403 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.762387 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 13 21:11:40.763096 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.763077 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8zklr\"" Jul 13 21:11:40.763205 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.763140 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.763276 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.763204 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 13 21:11:40.763276 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.763204 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 13 21:11:40.763276 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.763205 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.763412 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.763318 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 13 21:11:40.771476 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.771450 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk"] Jul 13 21:11:40.771609 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.771570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:40.773995 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.773973 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bt7cz\"" Jul 13 21:11:40.774335 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.774287 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 13 21:11:40.774461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.774446 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 13 21:11:40.783589 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5"] Jul 13 21:11:40.783589 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783592 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl"] Jul 13 21:11:40.783791 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783624 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm"] Jul 13 21:11:40.783791 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783686 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk" Jul 13 21:11:40.783791 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783736 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6nwhm"] Jul 13 21:11:40.783791 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783772 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-cd8gg"] Jul 13 21:11:40.784554 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783867 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n"] Jul 13 21:11:40.784554 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783893 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk"] Jul 13 21:11:40.784554 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783921 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd7dcffb8-5nngz"] Jul 13 21:11:40.784554 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.783938 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lzs6b"] Jul 13 21:11:40.786176 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.786134 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.786284 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.786134 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.786341 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.786161 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mmdff\"" Jul 13 21:11:40.797733 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.797705 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4gngg"] Jul 13 21:11:40.797891 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.797747 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-648d4b6868-z7k6f"] Jul 13 21:11:40.797891 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.797767 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lzs6b"] Jul 13 21:11:40.797891 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.797807 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z4c6t"] Jul 13 21:11:40.797891 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.797825 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:40.800201 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.800086 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 21:11:40.800201 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.800180 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 21:11:40.800385 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.800233 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-btz4g\"" Jul 13 21:11:40.804873 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.804766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59099ed0-78cd-4277-9bf9-4680ad390448-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.804873 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.804805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1598c97a-0b69-4ca6-ba64-a64b2c618e71-ca-trust-extracted\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.804873 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.804835 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-certificates\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.804873 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.804859 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-installation-pull-secrets\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.805180 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.804885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8f9b\" (UniqueName: \"kubernetes.io/projected/817e44a7-a117-473d-b165-127104540c8f-kube-api-access-b8f9b\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.805180 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.804923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-image-registry-private-configuration\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.805180 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76c22c6f-0ed5-477a-a251-9db873499e6c-config\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.805180 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9tkv\" (UniqueName: \"kubernetes.io/projected/76c22c6f-0ed5-477a-a251-9db873499e6c-kube-api-access-j9tkv\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.805180 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/326776ac-7b7a-427c-878b-717eb09a6c44-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.805180 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805137 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhpsw\" (UniqueName: \"kubernetes.io/projected/59099ed0-78cd-4277-9bf9-4680ad390448-kube-api-access-fhpsw\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.805466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805179 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-bound-sa-token\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.805466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805288 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62w85\" (UniqueName: \"kubernetes.io/projected/326776ac-7b7a-427c-878b-717eb09a6c44-kube-api-access-62w85\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.805466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805321 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.805466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:40.805466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9svc\" (UniqueName: \"kubernetes.io/projected/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-kube-api-access-c9svc\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:40.805466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805410 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gph\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-kube-api-access-b8gph\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.805466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/817e44a7-a117-473d-b165-127104540c8f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.805780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/817e44a7-a117-473d-b165-127104540c8f-config\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.805780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805545 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.805780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-trusted-ca\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.805780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76c22c6f-0ed5-477a-a251-9db873499e6c-serving-cert\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.805780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76c22c6f-0ed5-477a-a251-9db873499e6c-trusted-ca\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.805780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pwdd\" (UniqueName: \"kubernetes.io/projected/88d8ae4b-64db-4023-874e-59fd9547cf03-kube-api-access-8pwdd\") pod \"volume-data-source-validator-78495597f6-sjwnm\" (UID: \"88d8ae4b-64db-4023-874e-59fd9547cf03\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm" Jul 13 21:11:40.805780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.805737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59099ed0-78cd-4277-9bf9-4680ad390448-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.809918 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.809851 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:11:40.810065 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.809850 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4c6t" Jul 13 21:11:40.810065 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.809988 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:11:40.813306 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.813281 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 21:11:40.813446 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.813372 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gcwv8\"" Jul 13 21:11:40.813446 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.813419 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 21:11:40.813582 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.813419 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t2zb8\"" Jul 13 21:11:40.813582 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.813494 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 21:11:40.813582 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.813422 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 21:11:40.815558 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.815498 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4c6t"] Jul 13 21:11:40.820497 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.820469 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pwdd\" (UniqueName: \"kubernetes.io/projected/88d8ae4b-64db-4023-874e-59fd9547cf03-kube-api-access-8pwdd\") pod \"volume-data-source-validator-78495597f6-sjwnm\" (UID: \"88d8ae4b-64db-4023-874e-59fd9547cf03\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm" Jul 13 21:11:40.906112 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-stats-auth\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:40.906112 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/326776ac-7b7a-427c-878b-717eb09a6c44-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.906383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906175 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-bound-sa-token\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.906383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906231 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62w85\" (UniqueName: \"kubernetes.io/projected/326776ac-7b7a-427c-878b-717eb09a6c44-kube-api-access-62w85\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.906383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906270 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9svc\" (UniqueName: \"kubernetes.io/projected/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-kube-api-access-c9svc\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:40.906383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906299 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529b7467-81c9-4887-9e8c-8992a1d76c16-serving-cert\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:40.906383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff778486-44a6-4b83-b1eb-b4814c28c962-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:40.906383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906349 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.906656 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b7467-81c9-4887-9e8c-8992a1d76c16-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:40.906656 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:40.906441 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:40.906656 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906469 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:40.906656 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:40.906539 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls podName:326776ac-7b7a-427c-878b-717eb09a6c44 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:41.406518052 +0000 UTC m=+35.163737498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-97bg5" (UID: "326776ac-7b7a-427c-878b-717eb09a6c44") : secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:40.906656 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5s8\" (UniqueName: \"kubernetes.io/projected/529b7467-81c9-4887-9e8c-8992a1d76c16-kube-api-access-wb5s8\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:40.906656 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-trusted-ca\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76c22c6f-0ed5-477a-a251-9db873499e6c-trusted-ca\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906746 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76c22c6f-0ed5-477a-a251-9db873499e6c-serving-cert\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rlm9\" (UniqueName: \"kubernetes.io/projected/43d30a3a-1e8f-4ed4-850c-c537577cb12d-kube-api-access-4rlm9\") pod \"network-check-source-869dcfcdcd-dfqsk\" (UID: \"43d30a3a-1e8f-4ed4-850c-c537577cb12d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1598c97a-0b69-4ca6-ba64-a64b2c618e71-ca-trust-extracted\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-default-certificate\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906872 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8f9b\" (UniqueName: \"kubernetes.io/projected/817e44a7-a117-473d-b165-127104540c8f-kube-api-access-b8f9b\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-certificates\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.906939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-installation-pull-secrets\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-image-registry-private-configuration\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76c22c6f-0ed5-477a-a251-9db873499e6c-config\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9tkv\" (UniqueName: \"kubernetes.io/projected/76c22c6f-0ed5-477a-a251-9db873499e6c-kube-api-access-j9tkv\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fec4af-edef-4537-b2fe-5294b79ed89b-tmp-dir\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhpsw\" (UniqueName: \"kubernetes.io/projected/59099ed0-78cd-4277-9bf9-4680ad390448-kube-api-access-fhpsw\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gph\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-kube-api-access-b8gph\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/817e44a7-a117-473d-b165-127104540c8f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/817e44a7-a117-473d-b165-127104540c8f-config\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.907348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/529b7467-81c9-4887-9e8c-8992a1d76c16-snapshots\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qfv\" (UniqueName: \"kubernetes.io/projected/e9fec4af-edef-4537-b2fe-5294b79ed89b-kube-api-access-g5qfv\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/529b7467-81c9-4887-9e8c-8992a1d76c16-tmp\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b7467-81c9-4887-9e8c-8992a1d76c16-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86hpj\" (UniqueName: \"kubernetes.io/projected/76764d8f-c777-4838-aadf-459e551e821a-kube-api-access-86hpj\") pod \"ingress-canary-z4c6t\" (UID: \"76764d8f-c777-4838-aadf-459e551e821a\") " pod="openshift-ingress-canary/ingress-canary-z4c6t" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907500 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fec4af-edef-4537-b2fe-5294b79ed89b-config-volume\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59099ed0-78cd-4277-9bf9-4680ad390448-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907553 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1598c97a-0b69-4ca6-ba64-a64b2c618e71-ca-trust-extracted\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907568 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76c22c6f-0ed5-477a-a251-9db873499e6c-trusted-ca\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907638 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76c22c6f-0ed5-477a-a251-9db873499e6c-config\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:40.906816 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:40.907675 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd7dcffb8-5nngz: secret "image-registry-tls" not found Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.906872 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/326776ac-7b7a-427c-878b-717eb09a6c44-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59099ed0-78cd-4277-9bf9-4680ad390448-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76764d8f-c777-4838-aadf-459e551e821a-cert\") pod \"ingress-canary-z4c6t\" (UID: \"76764d8f-c777-4838-aadf-459e551e821a\") " pod="openshift-ingress-canary/ingress-canary-z4c6t" Jul 13 21:11:40.907806 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:40.907803 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 21:11:40.908638 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907825 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kctv\" (UniqueName: \"kubernetes.io/projected/9425fe2f-9987-418e-b031-6fa26d109a53-kube-api-access-8kctv\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:40.908638 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:40.907850 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls podName:202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:41.407834284 +0000 UTC m=+35.165053730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls") pod "cluster-samples-operator-65db858894-2xghm" (UID: "202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0") : secret "samples-operator-tls" not found Jul 13 21:11:40.908638 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.907915 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-certificates\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.908638 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.908248 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59099ed0-78cd-4277-9bf9-4680ad390448-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.908638 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.908274 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-trusted-ca\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.908638 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:40.908338 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls podName:1598c97a-0b69-4ca6-ba64-a64b2c618e71 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:41.408323274 +0000 UTC m=+35.165542719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls") pod "image-registry-5bd7dcffb8-5nngz" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71") : secret "image-registry-tls" not found Jul 13 21:11:40.908638 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.908518 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/817e44a7-a117-473d-b165-127104540c8f-config\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.909917 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.909888 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76c22c6f-0ed5-477a-a251-9db873499e6c-serving-cert\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.910604 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.910581 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-image-registry-private-configuration\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.910699 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.910625 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-installation-pull-secrets\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.910699 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.910635 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59099ed0-78cd-4277-9bf9-4680ad390448-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.910887 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.910866 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/817e44a7-a117-473d-b165-127104540c8f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.920864 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.920828 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9svc\" (UniqueName: \"kubernetes.io/projected/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-kube-api-access-c9svc\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:40.921356 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.921326 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-bound-sa-token\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.921869 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.921850 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhpsw\" (UniqueName: \"kubernetes.io/projected/59099ed0-78cd-4277-9bf9-4680ad390448-kube-api-access-fhpsw\") pod \"kube-storage-version-migrator-operator-799cb7f958-49b7n\" (UID: \"59099ed0-78cd-4277-9bf9-4680ad390448\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:40.921961 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.921926 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62w85\" (UniqueName: \"kubernetes.io/projected/326776ac-7b7a-427c-878b-717eb09a6c44-kube-api-access-62w85\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:40.922221 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.922188 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8f9b\" (UniqueName: \"kubernetes.io/projected/817e44a7-a117-473d-b165-127104540c8f-kube-api-access-b8f9b\") pod \"service-ca-operator-7695fc6c8c-xkmjl\" (UID: \"817e44a7-a117-473d-b165-127104540c8f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:40.922621 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.922594 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9tkv\" (UniqueName: \"kubernetes.io/projected/76c22c6f-0ed5-477a-a251-9db873499e6c-kube-api-access-j9tkv\") pod \"console-operator-7866497494-cd8gg\" (UID: \"76c22c6f-0ed5-477a-a251-9db873499e6c\") " pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:40.923675 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.923655 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gph\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-kube-api-access-b8gph\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:40.940721 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.940686 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm" Jul 13 21:11:40.981466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:40.981429 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" Jul 13 21:11:41.008893 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.008859 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rlm9\" (UniqueName: \"kubernetes.io/projected/43d30a3a-1e8f-4ed4-850c-c537577cb12d-kube-api-access-4rlm9\") pod \"network-check-source-869dcfcdcd-dfqsk\" (UID: \"43d30a3a-1e8f-4ed4-850c-c537577cb12d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk" Jul 13 21:11:41.008893 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.008901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-default-certificate\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.009136 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.008936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fec4af-edef-4537-b2fe-5294b79ed89b-tmp-dir\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:41.009136 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.009250 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/529b7467-81c9-4887-9e8c-8992a1d76c16-snapshots\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.009250 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:41.009354 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qfv\" (UniqueName: \"kubernetes.io/projected/e9fec4af-edef-4537-b2fe-5294b79ed89b-kube-api-access-g5qfv\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:41.009354 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/529b7467-81c9-4887-9e8c-8992a1d76c16-tmp\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.009354 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.009326 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:11:41.009486 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.009328 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:41.509306023 +0000 UTC m=+35.266525488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : configmap references non-existent config key: service-ca.crt Jul 13 21:11:41.009486 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.009394 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls podName:e9fec4af-edef-4537-b2fe-5294b79ed89b nodeName:}" failed. No retries permitted until 2026-07-13 21:11:41.509375071 +0000 UTC m=+35.266594516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls") pod "dns-default-lzs6b" (UID: "e9fec4af-edef-4537-b2fe-5294b79ed89b") : secret "dns-default-metrics-tls" not found Jul 13 21:11:41.009486 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009428 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b7467-81c9-4887-9e8c-8992a1d76c16-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.009486 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009438 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fec4af-edef-4537-b2fe-5294b79ed89b-tmp-dir\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:41.009486 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009456 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86hpj\" (UniqueName: \"kubernetes.io/projected/76764d8f-c777-4838-aadf-459e551e821a-kube-api-access-86hpj\") pod \"ingress-canary-z4c6t\" (UID: \"76764d8f-c777-4838-aadf-459e551e821a\") " pod="openshift-ingress-canary/ingress-canary-z4c6t" Jul 13 21:11:41.009486 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fec4af-edef-4537-b2fe-5294b79ed89b-config-volume\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:41.009771 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.009771 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76764d8f-c777-4838-aadf-459e551e821a-cert\") pod \"ingress-canary-z4c6t\" (UID: \"76764d8f-c777-4838-aadf-459e551e821a\") " pod="openshift-ingress-canary/ingress-canary-z4c6t" Jul 13 21:11:41.009771 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kctv\" (UniqueName: \"kubernetes.io/projected/9425fe2f-9987-418e-b031-6fa26d109a53-kube-api-access-8kctv\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.009771 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-stats-auth\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.009953 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.009861 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/529b7467-81c9-4887-9e8c-8992a1d76c16-snapshots\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.010085 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.009960 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 21:11:41.010085 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.010040 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:41.510025204 +0000 UTC m=+35.267244663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : secret "router-metrics-certs-default" not found Jul 13 21:11:41.010085 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010047 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fec4af-edef-4537-b2fe-5294b79ed89b-config-volume\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:41.010252 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529b7467-81c9-4887-9e8c-8992a1d76c16-serving-cert\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.010252 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010178 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff778486-44a6-4b83-b1eb-b4814c28c962-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:41.010252 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b7467-81c9-4887-9e8c-8992a1d76c16-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.010391 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:41.010443 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010419 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b7467-81c9-4887-9e8c-8992a1d76c16-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.010485 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5s8\" (UniqueName: \"kubernetes.io/projected/529b7467-81c9-4887-9e8c-8992a1d76c16-kube-api-access-wb5s8\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.010805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010771 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b7467-81c9-4887-9e8c-8992a1d76c16-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.010805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010772 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/529b7467-81c9-4887-9e8c-8992a1d76c16-tmp\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.010956 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.010858 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 21:11:41.010956 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.010903 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert podName:ff778486-44a6-4b83-b1eb-b4814c28c962 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:41.510888823 +0000 UTC m=+35.268108268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4gngg" (UID: "ff778486-44a6-4b83-b1eb-b4814c28c962") : secret "networking-console-plugin-cert" not found Jul 13 21:11:41.010956 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.010935 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff778486-44a6-4b83-b1eb-b4814c28c962-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:41.012430 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.012397 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-stats-auth\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.012512 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.012427 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-default-certificate\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.012648 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.012623 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529b7467-81c9-4887-9e8c-8992a1d76c16-serving-cert\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.013073 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.013048 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76764d8f-c777-4838-aadf-459e551e821a-cert\") pod \"ingress-canary-z4c6t\" (UID: \"76764d8f-c777-4838-aadf-459e551e821a\") " pod="openshift-ingress-canary/ingress-canary-z4c6t" Jul 13 21:11:41.018274 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.018155 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86hpj\" (UniqueName: \"kubernetes.io/projected/76764d8f-c777-4838-aadf-459e551e821a-kube-api-access-86hpj\") pod \"ingress-canary-z4c6t\" (UID: \"76764d8f-c777-4838-aadf-459e551e821a\") " pod="openshift-ingress-canary/ingress-canary-z4c6t" Jul 13 21:11:41.018274 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.018170 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qfv\" (UniqueName: \"kubernetes.io/projected/e9fec4af-edef-4537-b2fe-5294b79ed89b-kube-api-access-g5qfv\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:41.018274 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.018208 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rlm9\" (UniqueName: \"kubernetes.io/projected/43d30a3a-1e8f-4ed4-850c-c537577cb12d-kube-api-access-4rlm9\") pod \"network-check-source-869dcfcdcd-dfqsk\" (UID: \"43d30a3a-1e8f-4ed4-850c-c537577cb12d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk" Jul 13 21:11:41.018597 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.018577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5s8\" (UniqueName: \"kubernetes.io/projected/529b7467-81c9-4887-9e8c-8992a1d76c16-kube-api-access-wb5s8\") pod \"insights-operator-68d9dd94cf-6nwhm\" (UID: \"529b7467-81c9-4887-9e8c-8992a1d76c16\") " pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.019133 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.019116 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kctv\" (UniqueName: \"kubernetes.io/projected/9425fe2f-9987-418e-b031-6fa26d109a53-kube-api-access-8kctv\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.028111 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.028089 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" Jul 13 21:11:41.046461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.046433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:11:41.059015 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.058988 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" Jul 13 21:11:41.095137 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.095095 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk" Jul 13 21:11:41.136594 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.136553 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4c6t" Jul 13 21:11:41.414646 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.414553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:41.414812 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.414682 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:41.414812 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.414727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:41.414812 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.414725 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 21:11:41.414812 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.414786 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:41.414974 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.414844 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls podName:202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:42.414824023 +0000 UTC m=+36.172043722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls") pod "cluster-samples-operator-65db858894-2xghm" (UID: "202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0") : secret "samples-operator-tls" not found Jul 13 21:11:41.414974 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.414858 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls podName:326776ac-7b7a-427c-878b-717eb09a6c44 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:42.414852107 +0000 UTC m=+36.172071552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-97bg5" (UID: "326776ac-7b7a-427c-878b-717eb09a6c44") : secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:41.414974 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.414892 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 21:11:41.414974 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.414912 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd7dcffb8-5nngz: secret "image-registry-tls" not found Jul 13 21:11:41.414974 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.414973 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls podName:1598c97a-0b69-4ca6-ba64-a64b2c618e71 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:42.414958505 +0000 UTC m=+36.172177955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls") pod "image-registry-5bd7dcffb8-5nngz" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71") : secret "image-registry-tls" not found Jul 13 21:11:41.515972 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.515931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.516171 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.515986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:41.516171 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.516054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:41.516171 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.516144 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:42.516119995 +0000 UTC m=+36.273339442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : configmap references non-existent config key: service-ca.crt Jul 13 21:11:41.516352 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.516177 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:11:41.516352 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.516185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:41.516352 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.516228 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls podName:e9fec4af-edef-4537-b2fe-5294b79ed89b nodeName:}" failed. No retries permitted until 2026-07-13 21:11:42.516214238 +0000 UTC m=+36.273433689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls") pod "dns-default-lzs6b" (UID: "e9fec4af-edef-4537-b2fe-5294b79ed89b") : secret "dns-default-metrics-tls" not found Jul 13 21:11:41.516352 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.516177 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 21:11:41.516352 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.516288 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 21:11:41.516352 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.516334 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert podName:ff778486-44a6-4b83-b1eb-b4814c28c962 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:42.516320237 +0000 UTC m=+36.273539683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4gngg" (UID: "ff778486-44a6-4b83-b1eb-b4814c28c962") : secret "networking-console-plugin-cert" not found Jul 13 21:11:41.516641 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:41.516367 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:42.516349316 +0000 UTC m=+36.273568764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : secret "router-metrics-certs-default" not found Jul 13 21:11:41.799819 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.799778 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:11:41.802421 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.802388 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 21:11:41.802421 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:41.802388 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vxg2k\"" Jul 13 21:11:42.337119 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.337032 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-cd8gg"] Jul 13 21:11:42.339142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.339116 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n"] Jul 13 21:11:42.344458 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:42.344425 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59099ed0_78cd_4277_9bf9_4680ad390448.slice/crio-9af4e3e09ad5d5a7ce2bf9f5d271e6a2744562f8a504070ec072d7778a7290e1 WatchSource:0}: Error finding container 9af4e3e09ad5d5a7ce2bf9f5d271e6a2744562f8a504070ec072d7778a7290e1: Status 404 returned error can't find the container with id 9af4e3e09ad5d5a7ce2bf9f5d271e6a2744562f8a504070ec072d7778a7290e1 Jul 13 21:11:42.345141 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:42.345106 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c22c6f_0ed5_477a_a251_9db873499e6c.slice/crio-8a1d8686d2ee80bc37477de73ddc0abe0b78ad1a23d3b8475c2bae05637c4ea2 WatchSource:0}: Error finding container 8a1d8686d2ee80bc37477de73ddc0abe0b78ad1a23d3b8475c2bae05637c4ea2: Status 404 returned error can't find the container with id 8a1d8686d2ee80bc37477de73ddc0abe0b78ad1a23d3b8475c2bae05637c4ea2 Jul 13 21:11:42.357346 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.357065 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk"] Jul 13 21:11:42.358934 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.358833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm"] Jul 13 21:11:42.359860 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.359838 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6nwhm"] Jul 13 21:11:42.361466 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:42.361438 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d30a3a_1e8f_4ed4_850c_c537577cb12d.slice/crio-175c84d6ef02c20afb5904609de1528f71c9072198725af1beaed6525768d244 WatchSource:0}: Error finding container 175c84d6ef02c20afb5904609de1528f71c9072198725af1beaed6525768d244: Status 404 returned error can't find the container with id 175c84d6ef02c20afb5904609de1528f71c9072198725af1beaed6525768d244 Jul 13 21:11:42.362295 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:42.362223 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d8ae4b_64db_4023_874e_59fd9547cf03.slice/crio-c0cdfcafe89bd5527b6ecf16960f435e1f78b5110b3d3e4b1d734a07f66eabd6 WatchSource:0}: Error finding container c0cdfcafe89bd5527b6ecf16960f435e1f78b5110b3d3e4b1d734a07f66eabd6: Status 404 returned error can't find the container with id c0cdfcafe89bd5527b6ecf16960f435e1f78b5110b3d3e4b1d734a07f66eabd6 Jul 13 21:11:42.363159 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:42.363137 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529b7467_81c9_4887_9e8c_8992a1d76c16.slice/crio-f543d318bdea43fbc338ae33c7387994a5ff5e17d157e8a10b99adbc2adf640d WatchSource:0}: Error finding container f543d318bdea43fbc338ae33c7387994a5ff5e17d157e8a10b99adbc2adf640d: Status 404 returned error can't find the container with id f543d318bdea43fbc338ae33c7387994a5ff5e17d157e8a10b99adbc2adf640d Jul 13 21:11:42.367749 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.367726 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4c6t"] Jul 13 21:11:42.370851 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:42.370824 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76764d8f_c777_4838_aadf_459e551e821a.slice/crio-31eff126136eedb30ae7f690c269634502de532b60bbfae245c94fbf5a866761 WatchSource:0}: Error finding container 31eff126136eedb30ae7f690c269634502de532b60bbfae245c94fbf5a866761: Status 404 returned error can't find the container with id 31eff126136eedb30ae7f690c269634502de532b60bbfae245c94fbf5a866761 Jul 13 21:11:42.370973 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.370954 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl"] Jul 13 21:11:42.374110 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:11:42.374086 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817e44a7_a117_473d_b165_127104540c8f.slice/crio-ab485c6c24c3927567a1ff048b2427517235ae37ed3434f039d27580f3c9927f WatchSource:0}: Error finding container ab485c6c24c3927567a1ff048b2427517235ae37ed3434f039d27580f3c9927f: Status 404 returned error can't find the container with id ab485c6c24c3927567a1ff048b2427517235ae37ed3434f039d27580f3c9927f Jul 13 21:11:42.435282 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.435246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:42.435411 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.435362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:42.435411 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.435400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:42.435512 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.435418 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 21:11:42.435512 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.435486 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls podName:202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:44.435462768 +0000 UTC m=+38.192682216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls") pod "cluster-samples-operator-65db858894-2xghm" (UID: "202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0") : secret "samples-operator-tls" not found Jul 13 21:11:42.435512 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.435508 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:42.435618 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.435511 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 21:11:42.435618 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.435559 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls podName:326776ac-7b7a-427c-878b-717eb09a6c44 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:44.435545404 +0000 UTC m=+38.192764862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-97bg5" (UID: "326776ac-7b7a-427c-878b-717eb09a6c44") : secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:42.435618 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.435564 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd7dcffb8-5nngz: secret "image-registry-tls" not found Jul 13 21:11:42.435618 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.435610 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls podName:1598c97a-0b69-4ca6-ba64-a64b2c618e71 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:44.435598346 +0000 UTC m=+38.192817801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls") pod "image-registry-5bd7dcffb8-5nngz" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71") : secret "image-registry-tls" not found Jul 13 21:11:42.536699 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.536673 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:42.536776 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.536740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:42.536831 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.536817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:42.536865 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.536841 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 21:11:42.536907 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.536891 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 21:11:42.536952 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.536908 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:11:42.536952 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.536916 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:44.536895474 +0000 UTC m=+38.294114920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : secret "router-metrics-certs-default" not found Jul 13 21:11:42.536952 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:42.536851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:42.536952 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.536946 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert podName:ff778486-44a6-4b83-b1eb-b4814c28c962 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:44.536930762 +0000 UTC m=+38.294150229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4gngg" (UID: "ff778486-44a6-4b83-b1eb-b4814c28c962") : secret "networking-console-plugin-cert" not found Jul 13 21:11:42.537196 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.536967 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls podName:e9fec4af-edef-4537-b2fe-5294b79ed89b nodeName:}" failed. No retries permitted until 2026-07-13 21:11:44.536958448 +0000 UTC m=+38.294177899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls") pod "dns-default-lzs6b" (UID: "e9fec4af-edef-4537-b2fe-5294b79ed89b") : secret "dns-default-metrics-tls" not found Jul 13 21:11:42.537196 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:42.536984 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:44.536975687 +0000 UTC m=+38.294195134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : configmap references non-existent config key: service-ca.crt Jul 13 21:11:43.031811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.031735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" event={"ID":"529b7467-81c9-4887-9e8c-8992a1d76c16","Type":"ContainerStarted","Data":"f543d318bdea43fbc338ae33c7387994a5ff5e17d157e8a10b99adbc2adf640d"} Jul 13 21:11:43.034204 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.034131 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cd8gg" event={"ID":"76c22c6f-0ed5-477a-a251-9db873499e6c","Type":"ContainerStarted","Data":"8a1d8686d2ee80bc37477de73ddc0abe0b78ad1a23d3b8475c2bae05637c4ea2"} Jul 13 21:11:43.036891 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.036862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4c6t" event={"ID":"76764d8f-c777-4838-aadf-459e551e821a","Type":"ContainerStarted","Data":"31eff126136eedb30ae7f690c269634502de532b60bbfae245c94fbf5a866761"} Jul 13 21:11:43.038237 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.038183 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" event={"ID":"59099ed0-78cd-4277-9bf9-4680ad390448","Type":"ContainerStarted","Data":"9af4e3e09ad5d5a7ce2bf9f5d271e6a2744562f8a504070ec072d7778a7290e1"} Jul 13 21:11:43.041239 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.041200 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk" event={"ID":"43d30a3a-1e8f-4ed4-850c-c537577cb12d","Type":"ContainerStarted","Data":"175c84d6ef02c20afb5904609de1528f71c9072198725af1beaed6525768d244"} Jul 13 21:11:43.047283 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.047250 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" event={"ID":"817e44a7-a117-473d-b165-127104540c8f","Type":"ContainerStarted","Data":"ab485c6c24c3927567a1ff048b2427517235ae37ed3434f039d27580f3c9927f"} Jul 13 21:11:43.049240 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.049212 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm" event={"ID":"88d8ae4b-64db-4023-874e-59fd9547cf03","Type":"ContainerStarted","Data":"c0cdfcafe89bd5527b6ecf16960f435e1f78b5110b3d3e4b1d734a07f66eabd6"} Jul 13 21:11:43.057144 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.056185 2572 generic.go:356] "Generic (PLEG): container finished" podID="f065e8ba-445e-42f0-8e97-1723a3402498" containerID="df7b1ad7de5f5d0feebce633786e3d9c2d0ff26e3c31bc259e09cf87f0d185c8" exitCode=0 Jul 13 21:11:43.057144 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:43.056245 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw94l" event={"ID":"f065e8ba-445e-42f0-8e97-1723a3402498","Type":"ContainerDied","Data":"df7b1ad7de5f5d0feebce633786e3d9c2d0ff26e3c31bc259e09cf87f0d185c8"} Jul 13 21:11:44.079873 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.079792 2572 generic.go:356] "Generic (PLEG): container finished" podID="f065e8ba-445e-42f0-8e97-1723a3402498" containerID="92c07907c0fbd061e45b94d7080ede50fcb5c2ff2a377df4cc92062278f964a9" exitCode=0 Jul 13 21:11:44.080445 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.079888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw94l" event={"ID":"f065e8ba-445e-42f0-8e97-1723a3402498","Type":"ContainerDied","Data":"92c07907c0fbd061e45b94d7080ede50fcb5c2ff2a377df4cc92062278f964a9"} Jul 13 21:11:44.456920 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.456798 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:44.456920 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.456878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:44.457169 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.456951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:44.457224 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.457171 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 21:11:44.457282 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.457236 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls podName:202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:48.457216904 +0000 UTC m=+42.214436355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls") pod "cluster-samples-operator-65db858894-2xghm" (UID: "202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0") : secret "samples-operator-tls" not found Jul 13 21:11:44.457655 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.457633 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:44.457757 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.457691 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls podName:326776ac-7b7a-427c-878b-717eb09a6c44 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:48.457675229 +0000 UTC m=+42.214894673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-97bg5" (UID: "326776ac-7b7a-427c-878b-717eb09a6c44") : secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:44.457895 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.457873 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 21:11:44.457965 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.457898 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd7dcffb8-5nngz: secret "image-registry-tls" not found Jul 13 21:11:44.457965 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.457951 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls podName:1598c97a-0b69-4ca6-ba64-a64b2c618e71 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:48.457934042 +0000 UTC m=+42.215153495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls") pod "image-registry-5bd7dcffb8-5nngz" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71") : secret "image-registry-tls" not found Jul 13 21:11:44.558149 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.558097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:44.558330 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.558229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:44.558330 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.558265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:44.558330 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.558270 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 21:11:44.558330 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:44.558309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:44.558528 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.558377 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert podName:ff778486-44a6-4b83-b1eb-b4814c28c962 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:48.558324102 +0000 UTC m=+42.315543638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4gngg" (UID: "ff778486-44a6-4b83-b1eb-b4814c28c962") : secret "networking-console-plugin-cert" not found Jul 13 21:11:44.558528 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.558400 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 21:11:44.558528 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.558449 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:48.558433675 +0000 UTC m=+42.315653120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : secret "router-metrics-certs-default" not found Jul 13 21:11:44.558689 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.558565 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:48.558552689 +0000 UTC m=+42.315772136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : configmap references non-existent config key: service-ca.crt Jul 13 21:11:44.558689 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.558624 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:11:44.558689 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:44.558652 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls podName:e9fec4af-edef-4537-b2fe-5294b79ed89b nodeName:}" failed. No retries permitted until 2026-07-13 21:11:48.558642004 +0000 UTC m=+42.315861452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls") pod "dns-default-lzs6b" (UID: "e9fec4af-edef-4537-b2fe-5294b79ed89b") : secret "dns-default-metrics-tls" not found Jul 13 21:11:45.087399 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:45.087131 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm" event={"ID":"88d8ae4b-64db-4023-874e-59fd9547cf03","Type":"ContainerStarted","Data":"a3382182d39f6c512324d0cdeabff7518e4cefecc36d62380ffc3590f237fefd"} Jul 13 21:11:45.093869 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:45.093835 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw94l" event={"ID":"f065e8ba-445e-42f0-8e97-1723a3402498","Type":"ContainerStarted","Data":"9ddc35166b859e57ddffe9c72b957ee7412fd61dae0c15c915a3a77089da36ec"} Jul 13 21:11:45.125710 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:45.125639 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fw94l" podStartSLOduration=7.664733015 podStartE2EDuration="38.125614236s" totalImagesPullingTime="30.460881221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:45.124658059 +0000 UTC m=+38.881877528" watchObservedRunningTime="2026-07-13 21:11:45.125614236 +0000 UTC m=+38.882833709" Jul 13 21:11:45.126649 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:45.125845 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-sjwnm" podStartSLOduration=11.303607954 podStartE2EDuration="13.125834524s" totalImagesPullingTime="1.82222657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:45.104175823 +0000 UTC m=+38.861395292" watchObservedRunningTime="2026-07-13 21:11:45.125834524 +0000 UTC m=+38.883053971" Jul 13 21:11:48.495710 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:48.495670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.495872 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:48.495893 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.495955 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls podName:202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:56.495932499 +0000 UTC m=+50.253151947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls") pod "cluster-samples-operator-65db858894-2xghm" (UID: "202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0") : secret "samples-operator-tls" not found Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.495995 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:48.496020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.496066 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls podName:326776ac-7b7a-427c-878b-717eb09a6c44 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:56.496047653 +0000 UTC m=+50.253267103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-97bg5" (UID: "326776ac-7b7a-427c-878b-717eb09a6c44") : secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.496123 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.496145 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd7dcffb8-5nngz: secret "image-registry-tls" not found Jul 13 21:11:48.496184 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.496191 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls podName:1598c97a-0b69-4ca6-ba64-a64b2c618e71 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:56.496177359 +0000 UTC m=+50.253396806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls") pod "image-registry-5bd7dcffb8-5nngz" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71") : secret "image-registry-tls" not found Jul 13 21:11:48.597275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:48.597237 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:48.597461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:48.597328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:48.597461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:48.597350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:48.597461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:48.597375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:48.597461 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.597403 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 21:11:48.597627 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.597477 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert podName:ff778486-44a6-4b83-b1eb-b4814c28c962 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:56.597460921 +0000 UTC m=+50.354680484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4gngg" (UID: "ff778486-44a6-4b83-b1eb-b4814c28c962") : secret "networking-console-plugin-cert" not found Jul 13 21:11:48.597627 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.597507 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:56.597490241 +0000 UTC m=+50.354709703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : configmap references non-existent config key: service-ca.crt Jul 13 21:11:48.597627 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.597507 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:11:48.597627 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.597548 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls podName:e9fec4af-edef-4537-b2fe-5294b79ed89b nodeName:}" failed. No retries permitted until 2026-07-13 21:11:56.597537862 +0000 UTC m=+50.354757307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls") pod "dns-default-lzs6b" (UID: "e9fec4af-edef-4537-b2fe-5294b79ed89b") : secret "dns-default-metrics-tls" not found Jul 13 21:11:48.597627 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.597569 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 21:11:48.597627 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:48.597607 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:56.597595941 +0000 UTC m=+50.354815391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : secret "router-metrics-certs-default" not found Jul 13 21:11:51.111830 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.111794 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk" event={"ID":"43d30a3a-1e8f-4ed4-850c-c537577cb12d","Type":"ContainerStarted","Data":"7831c016444b30de77aeec1dc8d9f456c217dec180479e7832f62b2c66fe254a"} Jul 13 21:11:51.113558 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.113530 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" event={"ID":"817e44a7-a117-473d-b165-127104540c8f","Type":"ContainerStarted","Data":"61819bc3deb8ecd27c4e658e145fc3a2f8f1feb25efd69b219b45957c1b66795"} Jul 13 21:11:51.115580 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.115218 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" event={"ID":"529b7467-81c9-4887-9e8c-8992a1d76c16","Type":"ContainerStarted","Data":"1ef6d6141b0c284acfbdb23f8c54054d0951075eec79afec5f75a57fc997f654"} Jul 13 21:11:51.117159 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.117129 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/0.log" Jul 13 21:11:51.117282 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.117173 2572 generic.go:356] "Generic (PLEG): container finished" podID="76c22c6f-0ed5-477a-a251-9db873499e6c" containerID="48bf9976157e2981c7b84c6adb009ead908049874955c62b36dcc8f906ecfd19" exitCode=255 Jul 13 21:11:51.117282 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.117244 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cd8gg" event={"ID":"76c22c6f-0ed5-477a-a251-9db873499e6c","Type":"ContainerDied","Data":"48bf9976157e2981c7b84c6adb009ead908049874955c62b36dcc8f906ecfd19"} Jul 13 21:11:51.117422 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.117403 2572 scope.go:117] "RemoveContainer" containerID="48bf9976157e2981c7b84c6adb009ead908049874955c62b36dcc8f906ecfd19" Jul 13 21:11:51.119037 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.118978 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4c6t" event={"ID":"76764d8f-c777-4838-aadf-459e551e821a","Type":"ContainerStarted","Data":"47a4ec2f9a66773b0841b72eec75b50d73787d2f80868a92a8a69e27fb00fae3"} Jul 13 21:11:51.120656 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.120636 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" event={"ID":"59099ed0-78cd-4277-9bf9-4680ad390448","Type":"ContainerStarted","Data":"c116f8010bf388816ecaec81a664cd286537bbdcd9f22082c27f12f9079f1809"} Jul 13 21:11:51.131525 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.131483 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dfqsk" podStartSLOduration=11.401525097 podStartE2EDuration="19.131468453s" totalImagesPullingTime="7.729943356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:51.129884467 +0000 UTC m=+44.887103933" watchObservedRunningTime="2026-07-13 21:11:51.131468453 +0000 UTC m=+44.888687919" Jul 13 21:11:51.161663 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.161602 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" podStartSLOduration=11.445027465 podStartE2EDuration="19.16158121s" totalImagesPullingTime="7.716553745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:51.160660068 +0000 UTC m=+44.917879536" watchObservedRunningTime="2026-07-13 21:11:51.16158121 +0000 UTC m=+44.918800675" Jul 13 21:11:51.201729 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.201672 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" podStartSLOduration=10.454260822 podStartE2EDuration="18.20165006s" totalImagesPullingTime="7.747389238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:51.180560404 +0000 UTC m=+44.937779872" watchObservedRunningTime="2026-07-13 21:11:51.20165006 +0000 UTC m=+44.958869529" Jul 13 21:11:51.202185 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.202154 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" podStartSLOduration=10.468512452 podStartE2EDuration="18.202140231s" totalImagesPullingTime="7.733627779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:51.195403676 +0000 UTC m=+44.952623144" watchObservedRunningTime="2026-07-13 21:11:51.202140231 +0000 UTC m=+44.959359699" Jul 13 21:11:51.212342 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.212195 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z4c6t" podStartSLOduration=3.491378743 podStartE2EDuration="11.212178763s" totalImagesPullingTime="7.72080002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:11:51.211574791 +0000 UTC m=+44.968794259" watchObservedRunningTime="2026-07-13 21:11:51.212178763 +0000 UTC m=+44.969398231" Jul 13 21:11:51.686349 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.686310 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5qzp7"] Jul 13 21:11:51.722599 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.722561 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5qzp7"] Jul 13 21:11:51.722780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.722731 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.725382 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.725351 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 21:11:51.725532 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.725366 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 21:11:51.725598 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.725551 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hmn24\"" Jul 13 21:11:51.828552 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.828509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db658736-ac46-440e-96d2-65c1365bb9b4-crio-socket\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.828734 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.828584 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.828734 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.828702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.828865 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.828774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db658736-ac46-440e-96d2-65c1365bb9b4-data-volume\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.828925 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.828887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kblc8\" (UniqueName: \"kubernetes.io/projected/db658736-ac46-440e-96d2-65c1365bb9b4-kube-api-access-kblc8\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.930192 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.930151 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.930370 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.930223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.930370 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.930268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db658736-ac46-440e-96d2-65c1365bb9b4-data-volume\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.930370 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:51.930285 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 21:11:51.930370 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:51.930349 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:52.430331762 +0000 UTC m=+46.187551208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : configmap "kube-rbac-proxy" not found Jul 13 21:11:51.930565 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:51.930392 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:11:51.930565 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.930418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblc8\" (UniqueName: \"kubernetes.io/projected/db658736-ac46-440e-96d2-65c1365bb9b4-kube-api-access-kblc8\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.930565 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:51.930452 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:52.430436322 +0000 UTC m=+46.187655774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : secret "insights-runtime-extractor-tls" not found Jul 13 21:11:51.930565 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.930492 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db658736-ac46-440e-96d2-65c1365bb9b4-crio-socket\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.930736 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.930646 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db658736-ac46-440e-96d2-65c1365bb9b4-data-volume\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.930771 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.930750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db658736-ac46-440e-96d2-65c1365bb9b4-crio-socket\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:51.940754 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:51.940682 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kblc8\" (UniqueName: \"kubernetes.io/projected/db658736-ac46-440e-96d2-65c1365bb9b4-kube-api-access-kblc8\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:52.125374 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:52.125343 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:11:52.125743 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:52.125723 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/0.log" Jul 13 21:11:52.125819 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:52.125754 2572 generic.go:356] "Generic (PLEG): container finished" podID="76c22c6f-0ed5-477a-a251-9db873499e6c" containerID="0d9d5797dc09a46f7f481cc91ad2a3eee13d3482538a3c42fcef0c34550b6f11" exitCode=255 Jul 13 21:11:52.125890 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:52.125864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cd8gg" event={"ID":"76c22c6f-0ed5-477a-a251-9db873499e6c","Type":"ContainerDied","Data":"0d9d5797dc09a46f7f481cc91ad2a3eee13d3482538a3c42fcef0c34550b6f11"} Jul 13 21:11:52.125945 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:52.125922 2572 scope.go:117] "RemoveContainer" containerID="48bf9976157e2981c7b84c6adb009ead908049874955c62b36dcc8f906ecfd19" Jul 13 21:11:52.126234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:52.126216 2572 scope.go:117] "RemoveContainer" containerID="0d9d5797dc09a46f7f481cc91ad2a3eee13d3482538a3c42fcef0c34550b6f11" Jul 13 21:11:52.126416 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:52.126388 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cd8gg_openshift-console-operator(76c22c6f-0ed5-477a-a251-9db873499e6c)\"" pod="openshift-console-operator/console-operator-7866497494-cd8gg" podUID="76c22c6f-0ed5-477a-a251-9db873499e6c" Jul 13 21:11:52.436647 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:52.436603 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:52.436868 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:52.436667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:52.436868 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:52.436748 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 21:11:52.436868 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:52.436822 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:53.436803394 +0000 UTC m=+47.194022852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : configmap "kube-rbac-proxy" not found Jul 13 21:11:52.436868 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:52.436757 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:11:52.436868 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:52.436858 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:53.436849725 +0000 UTC m=+47.194069175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : secret "insights-runtime-extractor-tls" not found Jul 13 21:11:53.079774 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:53.079742 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6g59z_879b543e-ae6b-47c9-a437-7b6cf22ce7d8/dns-node-resolver/0.log" Jul 13 21:11:53.130813 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:53.130782 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:11:53.131203 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:53.131125 2572 scope.go:117] "RemoveContainer" containerID="0d9d5797dc09a46f7f481cc91ad2a3eee13d3482538a3c42fcef0c34550b6f11" Jul 13 21:11:53.131317 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:53.131296 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cd8gg_openshift-console-operator(76c22c6f-0ed5-477a-a251-9db873499e6c)\"" pod="openshift-console-operator/console-operator-7866497494-cd8gg" podUID="76c22c6f-0ed5-477a-a251-9db873499e6c" Jul 13 21:11:53.447824 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:53.447734 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:53.447824 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:53.447794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:53.448096 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:53.447884 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 21:11:53.448096 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:53.447966 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:55.447943933 +0000 UTC m=+49.205163398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : configmap "kube-rbac-proxy" not found Jul 13 21:11:53.448096 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:53.447897 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:11:53.448096 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:53.448051 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:55.448038066 +0000 UTC m=+49.205257511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : secret "insights-runtime-extractor-tls" not found Jul 13 21:11:54.280171 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:54.280143 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-glv2s_a727b5bb-2e2e-452a-af07-263e377a4c65/node-ca/0.log" Jul 13 21:11:55.080659 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:55.080631 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4c6t_76764d8f-c777-4838-aadf-459e551e821a/serve-healthcheck-canary/0.log" Jul 13 21:11:55.465738 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:55.465643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:55.466211 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:55.465780 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 21:11:55.466211 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:55.465824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:55.466211 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:55.465860 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:59.465839778 +0000 UTC m=+53.223059250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : configmap "kube-rbac-proxy" not found Jul 13 21:11:55.466211 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:55.465913 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:11:55.466211 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:55.465960 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:11:59.465947792 +0000 UTC m=+53.223167245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : secret "insights-runtime-extractor-tls" not found Jul 13 21:11:56.576038 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:56.575981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:56.576077 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.576140 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.576213 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:56.576155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.576231 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bd7dcffb8-5nngz: secret "image-registry-tls" not found Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.576216 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls podName:326776ac-7b7a-427c-878b-717eb09a6c44 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:12.576195817 +0000 UTC m=+66.333415265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-97bg5" (UID: "326776ac-7b7a-427c-878b-717eb09a6c44") : secret "cluster-monitoring-operator-tls" not found Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.576236 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.576331 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls podName:1598c97a-0b69-4ca6-ba64-a64b2c618e71 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:12.576313498 +0000 UTC m=+66.333532958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls") pod "image-registry-5bd7dcffb8-5nngz" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71") : secret "image-registry-tls" not found Jul 13 21:11:56.576513 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.576359 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls podName:202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:12.5763501 +0000 UTC m=+66.333569547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls") pod "cluster-samples-operator-65db858894-2xghm" (UID: "202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0") : secret "samples-operator-tls" not found Jul 13 21:11:56.677555 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:56.677514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:11:56.677736 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:56.677622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:56.677736 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:56.677647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:11:56.677736 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.677668 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 21:11:56.677861 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.677737 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert podName:ff778486-44a6-4b83-b1eb-b4814c28c962 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:12.677721099 +0000 UTC m=+66.434940568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4gngg" (UID: "ff778486-44a6-4b83-b1eb-b4814c28c962") : secret "networking-console-plugin-cert" not found Jul 13 21:11:56.677861 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.677754 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 21:11:56.677861 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.677771 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 21:11:56.677861 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:56.677678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:11:56.677861 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.677776 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:12.677760088 +0000 UTC m=+66.434979541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : configmap references non-existent config key: service-ca.crt Jul 13 21:11:56.677861 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.677850 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs podName:9425fe2f-9987-418e-b031-6fa26d109a53 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:12.67781932 +0000 UTC m=+66.435038773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs") pod "router-default-648d4b6868-z7k6f" (UID: "9425fe2f-9987-418e-b031-6fa26d109a53") : secret "router-metrics-certs-default" not found Jul 13 21:11:56.678132 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:56.677881 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls podName:e9fec4af-edef-4537-b2fe-5294b79ed89b nodeName:}" failed. No retries permitted until 2026-07-13 21:12:12.677870312 +0000 UTC m=+66.435089759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls") pod "dns-default-lzs6b" (UID: "e9fec4af-edef-4537-b2fe-5294b79ed89b") : secret "dns-default-metrics-tls" not found Jul 13 21:11:59.504534 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:59.504475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:59.505080 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:59.504559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:11:59.505080 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:59.504703 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 21:11:59.505080 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:11:59.504771 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls podName:db658736-ac46-440e-96d2-65c1365bb9b4 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:07.504755024 +0000 UTC m=+61.261974474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qzp7" (UID: "db658736-ac46-440e-96d2-65c1365bb9b4") : secret "insights-runtime-extractor-tls" not found Jul 13 21:11:59.505265 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:11:59.505243 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db658736-ac46-440e-96d2-65c1365bb9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:12:01.046745 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:01.046703 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:12:01.047330 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:01.046768 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:12:01.047330 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:01.047136 2572 scope.go:117] "RemoveContainer" containerID="0d9d5797dc09a46f7f481cc91ad2a3eee13d3482538a3c42fcef0c34550b6f11" Jul 13 21:12:01.047330 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:12:01.047301 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cd8gg_openshift-console-operator(76c22c6f-0ed5-477a-a251-9db873499e6c)\"" pod="openshift-console-operator/console-operator-7866497494-cd8gg" podUID="76c22c6f-0ed5-477a-a251-9db873499e6c" Jul 13 21:12:07.024381 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:07.024350 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq5hl" Jul 13 21:12:07.576682 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:07.576645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:12:07.578939 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:07.578910 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db658736-ac46-440e-96d2-65c1365bb9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qzp7\" (UID: \"db658736-ac46-440e-96d2-65c1365bb9b4\") " pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:12:07.636745 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:07.636709 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hmn24\"" Jul 13 21:12:07.644825 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:07.644784 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5qzp7" Jul 13 21:12:07.782586 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:07.782554 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5qzp7"] Jul 13 21:12:07.785770 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:07.785731 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb658736_ac46_440e_96d2_65c1365bb9b4.slice/crio-68923151b447ec0f6e92d3e2d4bc4c1ee274f44951b6e4ff0bc5d80c05b0b676 WatchSource:0}: Error finding container 68923151b447ec0f6e92d3e2d4bc4c1ee274f44951b6e4ff0bc5d80c05b0b676: Status 404 returned error can't find the container with id 68923151b447ec0f6e92d3e2d4bc4c1ee274f44951b6e4ff0bc5d80c05b0b676 Jul 13 21:12:08.180252 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:08.180219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5qzp7" event={"ID":"db658736-ac46-440e-96d2-65c1365bb9b4","Type":"ContainerStarted","Data":"68923151b447ec0f6e92d3e2d4bc4c1ee274f44951b6e4ff0bc5d80c05b0b676"} Jul 13 21:12:11.419168 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.419120 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:12:11.422123 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.422087 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 21:12:11.431873 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.431835 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f490020-e5a6-4a78-a256-55354cd3050a-metrics-certs\") pod \"network-metrics-daemon-dhdrv\" (UID: \"0f490020-e5a6-4a78-a256-55354cd3050a\") " pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:12:11.513996 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.513961 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vxg2k\"" Jul 13 21:12:11.520440 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.520386 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:12:11.520622 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.520591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:12:11.521435 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.521412 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdrv" Jul 13 21:12:11.523102 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.523079 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 21:12:11.523924 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.523889 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85kn9\" (UniqueName: \"kubernetes.io/projected/173105cb-64c6-4bb3-9b3e-440f82133666-kube-api-access-85kn9\") pod \"network-check-target-pgd52\" (UID: \"173105cb-64c6-4bb3-9b3e-440f82133666\") " pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:12:11.534154 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.534116 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c52b4863-bb7b-4548-bb4b-7b1d44cc55b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmb6b\" (UID: \"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2\") " pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:12:11.713409 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.713328 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhdrv"] Jul 13 21:12:11.716114 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:11.716087 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f490020_e5a6_4a78_a256_55354cd3050a.slice/crio-701ce3635030d1afd2bd6ee65d5bdd7bc2a9fd056956b5b50d65297c9925e8d7 WatchSource:0}: Error finding container 701ce3635030d1afd2bd6ee65d5bdd7bc2a9fd056956b5b50d65297c9925e8d7: Status 404 returned error can't find the container with id 701ce3635030d1afd2bd6ee65d5bdd7bc2a9fd056956b5b50d65297c9925e8d7 Jul 13 21:12:11.731489 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.731455 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t2zb8\"" Jul 13 21:12:11.739454 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.739427 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:12:11.742748 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.742721 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmb6b" Jul 13 21:12:11.800755 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:11.800729 2572 scope.go:117] "RemoveContainer" containerID="0d9d5797dc09a46f7f481cc91ad2a3eee13d3482538a3c42fcef0c34550b6f11" Jul 13 21:12:12.090239 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.090196 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgd52"] Jul 13 21:12:12.115884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.115710 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmb6b"] Jul 13 21:12:12.118762 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:12.118705 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52b4863_bb7b_4548_bb4b_7b1d44cc55b2.slice/crio-50e21386450fe43119c6de01cf0cc63489ce8fac464ea45ecad23f13b77f51cc WatchSource:0}: Error finding container 50e21386450fe43119c6de01cf0cc63489ce8fac464ea45ecad23f13b77f51cc: Status 404 returned error can't find the container with id 50e21386450fe43119c6de01cf0cc63489ce8fac464ea45ecad23f13b77f51cc Jul 13 21:12:12.195802 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.195779 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:12:12.195951 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.195868 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cd8gg" event={"ID":"76c22c6f-0ed5-477a-a251-9db873499e6c","Type":"ContainerStarted","Data":"3be280b599987292c1deb4b120ae7b02ac6d9b9872297853f8911054a9f9abc0"} Jul 13 21:12:12.196289 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.196196 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:12:12.197501 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.197475 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5qzp7" event={"ID":"db658736-ac46-440e-96d2-65c1365bb9b4","Type":"ContainerStarted","Data":"289570ee590482d24757f68e506fe429921b7652743a04a63bc303129e965e42"} Jul 13 21:12:12.198605 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.198583 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmb6b" event={"ID":"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2","Type":"ContainerStarted","Data":"50e21386450fe43119c6de01cf0cc63489ce8fac464ea45ecad23f13b77f51cc"} Jul 13 21:12:12.199895 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.199874 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgd52" event={"ID":"173105cb-64c6-4bb3-9b3e-440f82133666","Type":"ContainerStarted","Data":"c463d5a57ad1cf9fb3c3ded00f833d1ef0e3b7911f4b0799b5c888ef947d4ab6"} Jul 13 21:12:12.199978 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.199913 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgd52" event={"ID":"173105cb-64c6-4bb3-9b3e-440f82133666","Type":"ContainerStarted","Data":"bd713d560b86c2bf1f03f29f0db0d4b842dcd13cd01875dc3436c77815dc6e8a"} Jul 13 21:12:12.200954 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.200935 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhdrv" event={"ID":"0f490020-e5a6-4a78-a256-55354cd3050a","Type":"ContainerStarted","Data":"701ce3635030d1afd2bd6ee65d5bdd7bc2a9fd056956b5b50d65297c9925e8d7"} Jul 13 21:12:12.213959 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.213819 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-cd8gg" podStartSLOduration=31.466284497 podStartE2EDuration="39.213799246s" totalImagesPullingTime="7.747514749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:12.213031981 +0000 UTC m=+65.970251440" watchObservedRunningTime="2026-07-13 21:12:12.213799246 +0000 UTC m=+65.971018714" Jul 13 21:12:12.562574 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.562542 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-cd8gg" Jul 13 21:12:12.631454 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.631412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:12:12.631639 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.631528 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:12:12.631706 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.631640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:12:12.634459 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.634398 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/326776ac-7b7a-427c-878b-717eb09a6c44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-97bg5\" (UID: \"326776ac-7b7a-427c-878b-717eb09a6c44\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:12:12.634608 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.634514 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"image-registry-5bd7dcffb8-5nngz\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:12:12.635176 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.635151 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2xghm\" (UID: \"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:12:12.732998 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.732957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:12.733203 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.733040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:12:12.733203 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.733084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:12.733203 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.733136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:12:12.734313 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.734248 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9425fe2f-9987-418e-b031-6fa26d109a53-service-ca-bundle\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:12.736891 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.736833 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9425fe2f-9987-418e-b031-6fa26d109a53-metrics-certs\") pod \"router-default-648d4b6868-z7k6f\" (UID: \"9425fe2f-9987-418e-b031-6fa26d109a53\") " pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:12.736891 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.736860 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fec4af-edef-4537-b2fe-5294b79ed89b-metrics-tls\") pod \"dns-default-lzs6b\" (UID: \"e9fec4af-edef-4537-b2fe-5294b79ed89b\") " pod="openshift-dns/dns-default-lzs6b" Jul 13 21:12:12.737547 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.737519 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff778486-44a6-4b83-b1eb-b4814c28c962-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4gngg\" (UID: \"ff778486-44a6-4b83-b1eb-b4814c28c962\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:12:12.765405 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.765361 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2ksct\"" Jul 13 21:12:12.772907 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.772865 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:12:12.801685 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.801605 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qsqnt\"" Jul 13 21:12:12.807603 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.807528 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" Jul 13 21:12:12.823421 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.823353 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m8tk7\"" Jul 13 21:12:12.830798 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.830759 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" Jul 13 21:12:12.874845 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.874790 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8zklr\"" Jul 13 21:12:12.882604 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.882339 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:12.903031 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.902741 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bt7cz\"" Jul 13 21:12:12.903031 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.902755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" Jul 13 21:12:12.913083 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.912918 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-btz4g\"" Jul 13 21:12:12.920737 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.920431 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lzs6b" Jul 13 21:12:12.962665 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.962628 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt"] Jul 13 21:12:12.965281 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.965178 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:12.973295 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.969909 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 21:12:12.973295 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.970447 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 21:12:12.973295 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.970952 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 13 21:12:12.973295 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.971319 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 21:12:12.991942 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.988120 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd7dcffb8-5nngz"] Jul 13 21:12:12.993922 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:12.993375 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt"] Jul 13 21:12:12.999625 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:12.999590 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1598c97a_0b69_4ca6_ba64_a64b2c618e71.slice/crio-e9b690655b591ee3d73760a0188c637acc995ac2c9ddc35702820a2ddca2d9a7 WatchSource:0}: Error finding container e9b690655b591ee3d73760a0188c637acc995ac2c9ddc35702820a2ddca2d9a7: Status 404 returned error can't find the container with id e9b690655b591ee3d73760a0188c637acc995ac2c9ddc35702820a2ddca2d9a7 Jul 13 21:12:13.037432 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.037399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjhd\" (UniqueName: \"kubernetes.io/projected/bcaa27d0-5816-4a79-a482-931bd298c4da-kube-api-access-zpjhd\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.037525 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.037467 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcaa27d0-5816-4a79-a482-931bd298c4da-klusterlet-config\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.037525 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.037517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcaa27d0-5816-4a79-a482-931bd298c4da-tmp\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.057410 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.055174 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-26fl7"] Jul 13 21:12:13.111880 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.111849 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-26fl7"] Jul 13 21:12:13.113162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.112083 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-26fl7" Jul 13 21:12:13.128619 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.128587 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 21:12:13.132376 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.128989 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7vgq4\"" Jul 13 21:12:13.132376 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.129244 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 21:12:13.145567 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.138252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjhd\" (UniqueName: \"kubernetes.io/projected/bcaa27d0-5816-4a79-a482-931bd298c4da-kube-api-access-zpjhd\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.145567 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.138314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcaa27d0-5816-4a79-a482-931bd298c4da-klusterlet-config\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.145567 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.138403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcaa27d0-5816-4a79-a482-931bd298c4da-tmp\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.145567 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.138817 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcaa27d0-5816-4a79-a482-931bd298c4da-tmp\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.157525 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.155438 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5"] Jul 13 21:12:13.168808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.167668 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjhd\" (UniqueName: \"kubernetes.io/projected/bcaa27d0-5816-4a79-a482-931bd298c4da-kube-api-access-zpjhd\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.183849 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.183818 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcaa27d0-5816-4a79-a482-931bd298c4da-klusterlet-config\") pod \"klusterlet-addon-workmgr-8ccbbbfcf-jtjpt\" (UID: \"bcaa27d0-5816-4a79-a482-931bd298c4da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.214262 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.214171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5qzp7" event={"ID":"db658736-ac46-440e-96d2-65c1365bb9b4","Type":"ContainerStarted","Data":"fb2d75f54d1e780c688c3d051be6948d82e92bed055d9b3caa8d1298d69e9802"} Jul 13 21:12:13.219082 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.218993 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" event={"ID":"326776ac-7b7a-427c-878b-717eb09a6c44","Type":"ContainerStarted","Data":"f4cca97edd6d48759f10227d6c5b3e34cfa7ce1ac86d1ae28636f8fb5716df9c"} Jul 13 21:12:13.228174 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.227178 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" event={"ID":"1598c97a-0b69-4ca6-ba64-a64b2c618e71","Type":"ContainerStarted","Data":"2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02"} Jul 13 21:12:13.228174 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.227257 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" event={"ID":"1598c97a-0b69-4ca6-ba64-a64b2c618e71","Type":"ContainerStarted","Data":"e9b690655b591ee3d73760a0188c637acc995ac2c9ddc35702820a2ddca2d9a7"} Jul 13 21:12:13.228174 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.228123 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:12:13.232961 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.232847 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhdrv" event={"ID":"0f490020-e5a6-4a78-a256-55354cd3050a","Type":"ContainerStarted","Data":"a7d65d98a969b27b52bf9bf7489e4708b4435390e1cd3206e30c85045ad49d1b"} Jul 13 21:12:13.233632 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.233340 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:12:13.239769 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.239689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz5jw\" (UniqueName: \"kubernetes.io/projected/b79570b6-4af0-4959-95e5-9088fc3ae678-kube-api-access-tz5jw\") pod \"downloads-68c9cbb497-26fl7\" (UID: \"b79570b6-4af0-4959-95e5-9088fc3ae678\") " pod="openshift-console/downloads-68c9cbb497-26fl7" Jul 13 21:12:13.258883 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.258797 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lzs6b"] Jul 13 21:12:13.261416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.261282 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" podStartSLOduration=66.261257715 podStartE2EDuration="1m6.261257715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:13.255813896 +0000 UTC m=+67.013033363" watchObservedRunningTime="2026-07-13 21:12:13.261257715 +0000 UTC m=+67.018477179" Jul 13 21:12:13.285298 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.284534 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pgd52" podStartSLOduration=67.284510651 podStartE2EDuration="1m7.284510651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:13.282360083 +0000 UTC m=+67.039579552" watchObservedRunningTime="2026-07-13 21:12:13.284510651 +0000 UTC m=+67.041730120" Jul 13 21:12:13.286488 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.286280 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4gngg"] Jul 13 21:12:13.289880 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:13.289846 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff778486_44a6_4b83_b1eb_b4814c28c962.slice/crio-b70838234361215ef274b8071a70af57508d910590a3ddaca203516ecb1f4223 WatchSource:0}: Error finding container b70838234361215ef274b8071a70af57508d910590a3ddaca203516ecb1f4223: Status 404 returned error can't find the container with id b70838234361215ef274b8071a70af57508d910590a3ddaca203516ecb1f4223 Jul 13 21:12:13.293225 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.292982 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:13.304202 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.304172 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-648d4b6868-z7k6f"] Jul 13 21:12:13.306531 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:13.306420 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9425fe2f_9987_418e_b031_6fa26d109a53.slice/crio-0e9e431bd918a46a7eab5160d1d04a83a766320042438a1a6564296fe00bc91c WatchSource:0}: Error finding container 0e9e431bd918a46a7eab5160d1d04a83a766320042438a1a6564296fe00bc91c: Status 404 returned error can't find the container with id 0e9e431bd918a46a7eab5160d1d04a83a766320042438a1a6564296fe00bc91c Jul 13 21:12:13.315117 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.315042 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm"] Jul 13 21:12:13.341125 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.340562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz5jw\" (UniqueName: \"kubernetes.io/projected/b79570b6-4af0-4959-95e5-9088fc3ae678-kube-api-access-tz5jw\") pod \"downloads-68c9cbb497-26fl7\" (UID: \"b79570b6-4af0-4959-95e5-9088fc3ae678\") " pod="openshift-console/downloads-68c9cbb497-26fl7" Jul 13 21:12:13.352344 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.352280 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz5jw\" (UniqueName: \"kubernetes.io/projected/b79570b6-4af0-4959-95e5-9088fc3ae678-kube-api-access-tz5jw\") pod \"downloads-68c9cbb497-26fl7\" (UID: \"b79570b6-4af0-4959-95e5-9088fc3ae678\") " pod="openshift-console/downloads-68c9cbb497-26fl7" Jul 13 21:12:13.484305 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.484260 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-26fl7" Jul 13 21:12:13.493591 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.493553 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt"] Jul 13 21:12:13.497655 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:13.497611 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcaa27d0_5816_4a79_a482_931bd298c4da.slice/crio-99effd45d0a925ebe677bd19a5a10e82ae2bc0ede619c2e524ff5b3d7be48654 WatchSource:0}: Error finding container 99effd45d0a925ebe677bd19a5a10e82ae2bc0ede619c2e524ff5b3d7be48654: Status 404 returned error can't find the container with id 99effd45d0a925ebe677bd19a5a10e82ae2bc0ede619c2e524ff5b3d7be48654 Jul 13 21:12:13.647311 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:13.647158 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-26fl7"] Jul 13 21:12:13.651083 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:13.651033 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79570b6_4af0_4959_95e5_9088fc3ae678.slice/crio-6e6d505d004b88e5537b2fe08bfbb4ae47a474005974105e05a8b2dc6fb2495e WatchSource:0}: Error finding container 6e6d505d004b88e5537b2fe08bfbb4ae47a474005974105e05a8b2dc6fb2495e: Status 404 returned error can't find the container with id 6e6d505d004b88e5537b2fe08bfbb4ae47a474005974105e05a8b2dc6fb2495e Jul 13 21:12:14.247383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.247339 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" event={"ID":"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0","Type":"ContainerStarted","Data":"0132d4b8b98c121881b42098db966079387149a14851de2a4cdf9d099ec1ef2d"} Jul 13 21:12:14.255398 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.255356 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-26fl7" event={"ID":"b79570b6-4af0-4959-95e5-9088fc3ae678","Type":"ContainerStarted","Data":"6e6d505d004b88e5537b2fe08bfbb4ae47a474005974105e05a8b2dc6fb2495e"} Jul 13 21:12:14.264667 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.264627 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhdrv" event={"ID":"0f490020-e5a6-4a78-a256-55354cd3050a","Type":"ContainerStarted","Data":"1a1cb952c2af895da422d36ce66ffe133f1371ec8865884d9bf3f68f16c7204e"} Jul 13 21:12:14.269827 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.269793 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzs6b" event={"ID":"e9fec4af-edef-4537-b2fe-5294b79ed89b","Type":"ContainerStarted","Data":"afbf7c3d93eeff1ebec5d43139e3d486ff479c875174df0f948ea84ad20cb970"} Jul 13 21:12:14.281245 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.280039 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dhdrv" podStartSLOduration=66.064111427 podStartE2EDuration="1m7.279987427s" totalImagesPullingTime="1.215876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:14.279340375 +0000 UTC m=+68.036559843" watchObservedRunningTime="2026-07-13 21:12:14.279987427 +0000 UTC m=+68.037206895" Jul 13 21:12:14.282225 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.282127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" event={"ID":"ff778486-44a6-4b83-b1eb-b4814c28c962","Type":"ContainerStarted","Data":"b70838234361215ef274b8071a70af57508d910590a3ddaca203516ecb1f4223"} Jul 13 21:12:14.285964 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.285882 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" event={"ID":"bcaa27d0-5816-4a79-a482-931bd298c4da","Type":"ContainerStarted","Data":"99effd45d0a925ebe677bd19a5a10e82ae2bc0ede619c2e524ff5b3d7be48654"} Jul 13 21:12:14.294878 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.293949 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-648d4b6868-z7k6f" event={"ID":"9425fe2f-9987-418e-b031-6fa26d109a53","Type":"ContainerStarted","Data":"64b35daecd26e161976ca4853d8303f967d1a8775b528cb8b57e30052811df03"} Jul 13 21:12:14.296141 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.296080 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-648d4b6868-z7k6f" event={"ID":"9425fe2f-9987-418e-b031-6fa26d109a53","Type":"ContainerStarted","Data":"0e9e431bd918a46a7eab5160d1d04a83a766320042438a1a6564296fe00bc91c"} Jul 13 21:12:14.318997 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.318794 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-648d4b6868-z7k6f" podStartSLOduration=41.318769667 podStartE2EDuration="41.318769667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:14.316983527 +0000 UTC m=+68.074202995" watchObservedRunningTime="2026-07-13 21:12:14.318769667 +0000 UTC m=+68.075989116" Jul 13 21:12:14.883121 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.883042 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:14.886105 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:14.885825 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:15.306814 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:15.306666 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:15.308597 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:15.308349 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-648d4b6868-z7k6f" Jul 13 21:12:25.357083 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.356988 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmb6b" event={"ID":"c52b4863-bb7b-4548-bb4b-7b1d44cc55b2","Type":"ContainerStarted","Data":"65f8b3dfd24eec85bb9ed4dfdd4dd0f066aeda4b877b1460684b152bda1e076c"} Jul 13 21:12:25.358763 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.358727 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" event={"ID":"326776ac-7b7a-427c-878b-717eb09a6c44","Type":"ContainerStarted","Data":"fc1da0b658406f79d1cc86c78c5a6fedcdf67f7d58d110ac5e1337364363c259"} Jul 13 21:12:25.361294 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.361265 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" event={"ID":"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0","Type":"ContainerStarted","Data":"922f077dd62a18886a6a95bd1b3b08a441aff787929077a2700f3d31cd163859"} Jul 13 21:12:25.361458 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.361326 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" event={"ID":"202d9ae3-a5a8-4cd2-8af0-871f2a04b8e0","Type":"ContainerStarted","Data":"c0b322125918e8342cbeec7656495fe51931a22a36dbd8987fc4dbb041d4cfca"} Jul 13 21:12:25.363640 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.363611 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5qzp7" event={"ID":"db658736-ac46-440e-96d2-65c1365bb9b4","Type":"ContainerStarted","Data":"4fee5ad117d59faf668d9f61247e45d166019b937f76887c5734c1cb3d0ee6db"} Jul 13 21:12:25.365711 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.365676 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzs6b" event={"ID":"e9fec4af-edef-4537-b2fe-5294b79ed89b","Type":"ContainerStarted","Data":"5cc3d189b6283ae7761cab69f52b12687b1fc10ddb86b4c4c6058e2b9a9211e7"} Jul 13 21:12:25.365838 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.365727 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lzs6b" Jul 13 21:12:25.365838 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.365750 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzs6b" event={"ID":"e9fec4af-edef-4537-b2fe-5294b79ed89b","Type":"ContainerStarted","Data":"5724e84c8db101e0b9914238fc123c449e9ec27362d25120a9273b437533c61b"} Jul 13 21:12:25.367609 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.367579 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" event={"ID":"ff778486-44a6-4b83-b1eb-b4814c28c962","Type":"ContainerStarted","Data":"2ffadee7396d2f8769b349a67cd4fbedbd17ff4eb0ea6d69544233c928511d6c"} Jul 13 21:12:25.369275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.369250 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" event={"ID":"bcaa27d0-5816-4a79-a482-931bd298c4da","Type":"ContainerStarted","Data":"a3a83c8d8b31218c9af0aa6a40ce3885f6c8842f1abd20987a4f4d0037ab1842"} Jul 13 21:12:25.369478 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.369460 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:25.370667 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.370618 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vmb6b" podStartSLOduration=66.284670582 podStartE2EDuration="1m18.370602979s" totalImagesPullingTime="12.085932397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:25.370460712 +0000 UTC m=+79.127680179" watchObservedRunningTime="2026-07-13 21:12:25.370602979 +0000 UTC m=+79.127822447" Jul 13 21:12:25.371494 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.371471 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" Jul 13 21:12:25.385932 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.385833 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-97bg5" podStartSLOduration=41.355421307 podStartE2EDuration="52.385810985s" totalImagesPullingTime="11.030389678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:25.385787555 +0000 UTC m=+79.143007023" watchObservedRunningTime="2026-07-13 21:12:25.385810985 +0000 UTC m=+79.143030453" Jul 13 21:12:25.401974 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.401895 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2xghm" podStartSLOduration=42.569655298 podStartE2EDuration="53.401877789s" totalImagesPullingTime="10.832222491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:25.40104916 +0000 UTC m=+79.158268630" watchObservedRunningTime="2026-07-13 21:12:25.401877789 +0000 UTC m=+79.159097257" Jul 13 21:12:25.420381 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.420317 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5qzp7" podStartSLOduration=18.337681142 podStartE2EDuration="34.420298903s" totalImagesPullingTime="16.082617761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:11:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:25.419124928 +0000 UTC m=+79.176344396" watchObservedRunningTime="2026-07-13 21:12:25.420298903 +0000 UTC m=+79.177518371" Jul 13 21:12:25.439633 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.439560 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lzs6b" podStartSLOduration=34.495171656 podStartE2EDuration="45.439538279s" totalImagesPullingTime="10.944366623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:25.438847187 +0000 UTC m=+79.196066653" watchObservedRunningTime="2026-07-13 21:12:25.439538279 +0000 UTC m=+79.196757753" Jul 13 21:12:25.454165 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.454078 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8ccbbbfcf-jtjpt" podStartSLOduration=2.329623588 podStartE2EDuration="13.454054043s" totalImagesPullingTime="11.124430455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:25.452756115 +0000 UTC m=+79.209975583" watchObservedRunningTime="2026-07-13 21:12:25.454054043 +0000 UTC m=+79.211273513" Jul 13 21:12:25.468426 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:25.468360 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-4gngg" podStartSLOduration=36.554596592 podStartE2EDuration="47.468336322s" totalImagesPullingTime="10.91373973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:25.466894486 +0000 UTC m=+79.224113953" watchObservedRunningTime="2026-07-13 21:12:25.468336322 +0000 UTC m=+79.225555791" Jul 13 21:12:32.777875 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:32.777742 2572 patch_prober.go:28] interesting pod/image-registry-5bd7dcffb8-5nngz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 13 21:12:32.777875 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:32.777835 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" podUID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 21:12:34.297038 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.296978 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6htp2"] Jul 13 21:12:34.307741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.307707 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.310650 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.310462 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nphg5\"" Jul 13 21:12:34.310650 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.310553 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 21:12:34.310888 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.310636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 21:12:34.310888 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.310762 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 21:12:34.311587 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.311563 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 21:12:34.409737 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.409693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-26fl7" event={"ID":"b79570b6-4af0-4959-95e5-9088fc3ae678","Type":"ContainerStarted","Data":"02cb34b3af54175fba989291dc91b71e777e8276ffe32acf8ca9cb567434b790"} Jul 13 21:12:34.409943 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.409893 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-26fl7" Jul 13 21:12:34.426573 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.426512 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-26fl7" podStartSLOduration=1.311663056 podStartE2EDuration="21.426487199s" totalImagesPullingTime="20.114824143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:34.425220836 +0000 UTC m=+88.182440327" watchObservedRunningTime="2026-07-13 21:12:34.426487199 +0000 UTC m=+88.183706667" Jul 13 21:12:34.432464 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.432438 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-26fl7" Jul 13 21:12:34.440984 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.440932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-tls\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.441190 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.441024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.441190 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.441096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.441190 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.441133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55cf2240-4c52-4632-a54a-d570118687d4-metrics-client-ca\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.441190 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.441163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-textfile\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.441413 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.441234 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-sys\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.441413 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.441271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-root\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.441413 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.441294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-wtmp\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.441413 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.441338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9k5z\" (UniqueName: \"kubernetes.io/projected/55cf2240-4c52-4632-a54a-d570118687d4-kube-api-access-l9k5z\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542316 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542261 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542508 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542508 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542370 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55cf2240-4c52-4632-a54a-d570118687d4-metrics-client-ca\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542508 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-textfile\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542508 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-sys\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542508 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-root\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542508 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-wtmp\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9k5z\" (UniqueName: \"kubernetes.io/projected/55cf2240-4c52-4632-a54a-d570118687d4-kube-api-access-l9k5z\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542553 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-sys\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.542833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-tls\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.543020 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.542981 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-textfile\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.543125 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.543093 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.543125 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:12:34.543112 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 21:12:34.543260 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.543159 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-root\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.543260 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:12:34.543195 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-tls podName:55cf2240-4c52-4632-a54a-d570118687d4 nodeName:}" failed. No retries permitted until 2026-07-13 21:12:35.043174309 +0000 UTC m=+88.800393759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-tls") pod "node-exporter-6htp2" (UID: "55cf2240-4c52-4632-a54a-d570118687d4") : secret "node-exporter-tls" not found Jul 13 21:12:34.543386 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.543287 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-wtmp\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.543858 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.543834 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55cf2240-4c52-4632-a54a-d570118687d4-metrics-client-ca\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.545794 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.545765 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:34.552677 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:34.552604 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9k5z\" (UniqueName: \"kubernetes.io/projected/55cf2240-4c52-4632-a54a-d570118687d4-kube-api-access-l9k5z\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:35.047370 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:35.047325 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-tls\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:35.050282 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:35.050253 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55cf2240-4c52-4632-a54a-d570118687d4-node-exporter-tls\") pod \"node-exporter-6htp2\" (UID: \"55cf2240-4c52-4632-a54a-d570118687d4\") " pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:35.218655 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:35.218618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6htp2" Jul 13 21:12:35.251598 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:12:35.251554 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cf2240_4c52_4632_a54a_d570118687d4.slice/crio-da3c9eb67bffb448413ab4d9ae7784816368c2ae90a79c84cbc9720a8edf535a WatchSource:0}: Error finding container da3c9eb67bffb448413ab4d9ae7784816368c2ae90a79c84cbc9720a8edf535a: Status 404 returned error can't find the container with id da3c9eb67bffb448413ab4d9ae7784816368c2ae90a79c84cbc9720a8edf535a Jul 13 21:12:35.314479 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:35.314398 2572 patch_prober.go:28] interesting pod/image-registry-5bd7dcffb8-5nngz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 13 21:12:35.314479 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:35.314458 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" podUID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 21:12:35.377501 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:35.377468 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lzs6b" Jul 13 21:12:35.419187 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:35.419139 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6htp2" event={"ID":"55cf2240-4c52-4632-a54a-d570118687d4","Type":"ContainerStarted","Data":"da3c9eb67bffb448413ab4d9ae7784816368c2ae90a79c84cbc9720a8edf535a"} Jul 13 21:12:37.431909 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:37.431869 2572 generic.go:356] "Generic (PLEG): container finished" podID="55cf2240-4c52-4632-a54a-d570118687d4" containerID="a7a3a4cd7e14b993add8f028833f4c5549664eef9f1a0129af89d8a48137d191" exitCode=0 Jul 13 21:12:37.432384 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:37.431964 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6htp2" event={"ID":"55cf2240-4c52-4632-a54a-d570118687d4","Type":"ContainerDied","Data":"a7a3a4cd7e14b993add8f028833f4c5549664eef9f1a0129af89d8a48137d191"} Jul 13 21:12:38.439282 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:38.439235 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6htp2" event={"ID":"55cf2240-4c52-4632-a54a-d570118687d4","Type":"ContainerStarted","Data":"69eafc73b673d44be7b0bea73c9a49ed185cf1892c3bf59550dd3e263e7e9fdf"} Jul 13 21:12:38.439736 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:38.439351 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6htp2" event={"ID":"55cf2240-4c52-4632-a54a-d570118687d4","Type":"ContainerStarted","Data":"d59462f6760deaf5dc6110245bc54b686accddb334f3056f62b281c853ece917"} Jul 13 21:12:38.460319 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:38.460257 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6htp2" podStartSLOduration=2.546860832 podStartE2EDuration="4.460238208s" totalImagesPullingTime="1.804447473s" totalInitContainerRuntime="108.929903ms" isStatefulPod=true podCreationTimestamp="2026-07-13 21:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:12:38.458053925 +0000 UTC m=+92.215273394" watchObservedRunningTime="2026-07-13 21:12:38.460238208 +0000 UTC m=+92.217457682" Jul 13 21:12:42.778368 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:42.778326 2572 patch_prober.go:28] interesting pod/image-registry-5bd7dcffb8-5nngz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 13 21:12:42.778911 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:42.778399 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" podUID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 21:12:44.297394 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:44.297355 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pgd52" Jul 13 21:12:45.310441 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:45.310409 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:12:46.552982 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:46.552945 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bd7dcffb8-5nngz"] Jul 13 21:12:56.514660 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:56.514622 2572 generic.go:356] "Generic (PLEG): container finished" podID="817e44a7-a117-473d-b165-127104540c8f" containerID="61819bc3deb8ecd27c4e658e145fc3a2f8f1feb25efd69b219b45957c1b66795" exitCode=0 Jul 13 21:12:56.515179 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:56.514671 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" event={"ID":"817e44a7-a117-473d-b165-127104540c8f","Type":"ContainerDied","Data":"61819bc3deb8ecd27c4e658e145fc3a2f8f1feb25efd69b219b45957c1b66795"} Jul 13 21:12:56.515179 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:56.514975 2572 scope.go:117] "RemoveContainer" containerID="61819bc3deb8ecd27c4e658e145fc3a2f8f1feb25efd69b219b45957c1b66795" Jul 13 21:12:57.520108 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:12:57.520071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xkmjl" event={"ID":"817e44a7-a117-473d-b165-127104540c8f","Type":"ContainerStarted","Data":"10fb1f09c4533965614911516a1d84afe0878238d74b9c43806ac631452d9eb2"} Jul 13 21:13:11.576248 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.576211 2572 generic.go:356] "Generic (PLEG): container finished" podID="529b7467-81c9-4887-9e8c-8992a1d76c16" containerID="1ef6d6141b0c284acfbdb23f8c54054d0951075eec79afec5f75a57fc997f654" exitCode=0 Jul 13 21:13:11.576664 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.576283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" event={"ID":"529b7467-81c9-4887-9e8c-8992a1d76c16","Type":"ContainerDied","Data":"1ef6d6141b0c284acfbdb23f8c54054d0951075eec79afec5f75a57fc997f654"} Jul 13 21:13:11.576720 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.576703 2572 scope.go:117] "RemoveContainer" containerID="1ef6d6141b0c284acfbdb23f8c54054d0951075eec79afec5f75a57fc997f654" Jul 13 21:13:11.581448 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.581398 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" podUID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" containerName="registry" containerID="cri-o://2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02" gracePeriod=30 Jul 13 21:13:11.865675 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.865636 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:13:11.968423 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.968384 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-image-registry-private-configuration\") pod \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " Jul 13 21:13:11.968599 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.968438 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-certificates\") pod \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " Jul 13 21:13:11.968599 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.968494 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-installation-pull-secrets\") pod \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " Jul 13 21:13:11.968599 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.968531 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-trusted-ca\") pod \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " Jul 13 21:13:11.968599 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.968577 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1598c97a-0b69-4ca6-ba64-a64b2c618e71-ca-trust-extracted\") pod \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " Jul 13 21:13:11.968789 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.968622 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8gph\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-kube-api-access-b8gph\") pod \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " Jul 13 21:13:11.968789 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.968650 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") pod \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " Jul 13 21:13:11.968789 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.968694 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-bound-sa-token\") pod \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\" (UID: \"1598c97a-0b69-4ca6-ba64-a64b2c618e71\") " Jul 13 21:13:11.969110 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.969041 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1598c97a-0b69-4ca6-ba64-a64b2c618e71" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:13:11.969510 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.969467 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1598c97a-0b69-4ca6-ba64-a64b2c618e71" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:13:11.971744 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.971684 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-kube-api-access-b8gph" (OuterVolumeSpecName: "kube-api-access-b8gph") pod "1598c97a-0b69-4ca6-ba64-a64b2c618e71" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71"). InnerVolumeSpecName "kube-api-access-b8gph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:13:11.971744 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.971705 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1598c97a-0b69-4ca6-ba64-a64b2c618e71" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:13:11.971929 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.971745 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1598c97a-0b69-4ca6-ba64-a64b2c618e71" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:13:11.971929 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.971837 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1598c97a-0b69-4ca6-ba64-a64b2c618e71" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:13:11.971929 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.971873 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1598c97a-0b69-4ca6-ba64-a64b2c618e71" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:13:11.979495 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:11.979457 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1598c97a-0b69-4ca6-ba64-a64b2c618e71-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1598c97a-0b69-4ca6-ba64-a64b2c618e71" (UID: "1598c97a-0b69-4ca6-ba64-a64b2c618e71"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:13:12.069569 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.069530 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8gph\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-kube-api-access-b8gph\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:13:12.069569 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.069565 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:13:12.069569 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.069576 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1598c97a-0b69-4ca6-ba64-a64b2c618e71-bound-sa-token\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:13:12.069795 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.069586 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-image-registry-private-configuration\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:13:12.069795 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.069596 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-registry-certificates\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:13:12.069795 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.069605 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1598c97a-0b69-4ca6-ba64-a64b2c618e71-installation-pull-secrets\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:13:12.069795 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.069613 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1598c97a-0b69-4ca6-ba64-a64b2c618e71-trusted-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:13:12.069795 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.069621 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1598c97a-0b69-4ca6-ba64-a64b2c618e71-ca-trust-extracted\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:13:12.184587 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.184502 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648d4b6868-z7k6f_9425fe2f-9987-418e-b031-6fa26d109a53/router/0.log" Jul 13 21:13:12.202138 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.202111 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4c6t_76764d8f-c777-4838-aadf-459e551e821a/serve-healthcheck-canary/0.log" Jul 13 21:13:12.582242 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.582204 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6nwhm" event={"ID":"529b7467-81c9-4887-9e8c-8992a1d76c16","Type":"ContainerStarted","Data":"7e80be37b70d8066c734f6bab3f980fc1fe1a89be7ca36d4af1805173144bb16"} Jul 13 21:13:12.583571 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.583541 2572 generic.go:356] "Generic (PLEG): container finished" podID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" containerID="2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02" exitCode=0 Jul 13 21:13:12.583692 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.583589 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" Jul 13 21:13:12.583692 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.583627 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" event={"ID":"1598c97a-0b69-4ca6-ba64-a64b2c618e71","Type":"ContainerDied","Data":"2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02"} Jul 13 21:13:12.583692 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.583674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd7dcffb8-5nngz" event={"ID":"1598c97a-0b69-4ca6-ba64-a64b2c618e71","Type":"ContainerDied","Data":"e9b690655b591ee3d73760a0188c637acc995ac2c9ddc35702820a2ddca2d9a7"} Jul 13 21:13:12.583825 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.583695 2572 scope.go:117] "RemoveContainer" containerID="2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02" Jul 13 21:13:12.592515 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.592498 2572 scope.go:117] "RemoveContainer" containerID="2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02" Jul 13 21:13:12.592790 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:13:12.592773 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02\": container with ID starting with 2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02 not found: ID does not exist" containerID="2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02" Jul 13 21:13:12.592841 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.592797 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02"} err="failed to get container status \"2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02\": rpc error: code = NotFound desc = could not find container \"2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02\": container with ID starting with 2033cd192f15f8b9750707d91c413a4ed73df4d6eb7104be926535db78c35c02 not found: ID does not exist" Jul 13 21:13:12.617358 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.617323 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bd7dcffb8-5nngz"] Jul 13 21:13:12.628804 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.628774 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bd7dcffb8-5nngz"] Jul 13 21:13:12.805132 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:12.805100 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" path="/var/lib/kubelet/pods/1598c97a-0b69-4ca6-ba64-a64b2c618e71/volumes" Jul 13 21:13:16.601650 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:16.601615 2572 generic.go:356] "Generic (PLEG): container finished" podID="59099ed0-78cd-4277-9bf9-4680ad390448" containerID="c116f8010bf388816ecaec81a664cd286537bbdcd9f22082c27f12f9079f1809" exitCode=0 Jul 13 21:13:16.602053 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:16.601677 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" event={"ID":"59099ed0-78cd-4277-9bf9-4680ad390448","Type":"ContainerDied","Data":"c116f8010bf388816ecaec81a664cd286537bbdcd9f22082c27f12f9079f1809"} Jul 13 21:13:16.602053 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:16.601985 2572 scope.go:117] "RemoveContainer" containerID="c116f8010bf388816ecaec81a664cd286537bbdcd9f22082c27f12f9079f1809" Jul 13 21:13:17.609935 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:13:17.609896 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-49b7n" event={"ID":"59099ed0-78cd-4277-9bf9-4680ad390448","Type":"ContainerStarted","Data":"40d25b6eebfc35917b6521842cf755aab454284216e13019321529bd5c94d41b"} Jul 13 21:15:02.449120 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.449086 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt"] Jul 13 21:15:02.449579 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.449378 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" containerName="registry" Jul 13 21:15:02.449579 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.449393 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" containerName="registry" Jul 13 21:15:02.449579 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.449454 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1598c97a-0b69-4ca6-ba64-a64b2c618e71" containerName="registry" Jul 13 21:15:02.451376 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.451355 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.453829 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.453808 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 21:15:02.454085 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.454061 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 21:15:02.455012 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.454986 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fshvp\"" Jul 13 21:15:02.466928 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.466898 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt"] Jul 13 21:15:02.524241 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.524202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5v54\" (UniqueName: \"kubernetes.io/projected/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-kube-api-access-d5v54\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.524444 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.524255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.524444 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.524354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.624885 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.624840 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.625094 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.624896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.625094 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.624931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5v54\" (UniqueName: \"kubernetes.io/projected/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-kube-api-access-d5v54\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.625379 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.625354 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.625421 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.625354 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.633866 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.633835 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5v54\" (UniqueName: \"kubernetes.io/projected/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-kube-api-access-d5v54\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.760790 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.760747 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:02.894685 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:02.894661 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt"] Jul 13 21:15:02.897177 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:15:02.897138 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1cc2f1_01f9_486d_a7d8_cb0129bd5db1.slice/crio-6bc5973177325468663e56f65151fd6aaf61726d536d5b1f957c6090797ed823 WatchSource:0}: Error finding container 6bc5973177325468663e56f65151fd6aaf61726d536d5b1f957c6090797ed823: Status 404 returned error can't find the container with id 6bc5973177325468663e56f65151fd6aaf61726d536d5b1f957c6090797ed823 Jul 13 21:15:03.003286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:03.003249 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" event={"ID":"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1","Type":"ContainerStarted","Data":"6bc5973177325468663e56f65151fd6aaf61726d536d5b1f957c6090797ed823"} Jul 13 21:15:11.037711 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:11.037669 2572 generic.go:356] "Generic (PLEG): container finished" podID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerID="a82161540f75865f5d95d4e1e9c5eee752e748bf162853d277ec4bf5acf2efc9" exitCode=0 Jul 13 21:15:11.038196 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:11.037752 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" event={"ID":"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1","Type":"ContainerDied","Data":"a82161540f75865f5d95d4e1e9c5eee752e748bf162853d277ec4bf5acf2efc9"} Jul 13 21:15:32.119420 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:32.119381 2572 generic.go:356] "Generic (PLEG): container finished" podID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerID="9cb62f4f6c06df085ba1c72bfa650c3eaad6973258d4131dd42ab97475215a95" exitCode=0 Jul 13 21:15:32.119921 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:32.119478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" event={"ID":"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1","Type":"ContainerDied","Data":"9cb62f4f6c06df085ba1c72bfa650c3eaad6973258d4131dd42ab97475215a95"} Jul 13 21:15:40.160397 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:40.160356 2572 generic.go:356] "Generic (PLEG): container finished" podID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerID="f391f1ff5bcae91712e46550c6e710125d08e739373b19f40246982547e9d33d" exitCode=0 Jul 13 21:15:40.160397 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:40.160401 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" event={"ID":"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1","Type":"ContainerDied","Data":"f391f1ff5bcae91712e46550c6e710125d08e739373b19f40246982547e9d33d"} Jul 13 21:15:41.288780 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.288753 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:41.443598 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.443503 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-util\") pod \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " Jul 13 21:15:41.443598 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.443551 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5v54\" (UniqueName: \"kubernetes.io/projected/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-kube-api-access-d5v54\") pod \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " Jul 13 21:15:41.443598 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.443593 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-bundle\") pod \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\" (UID: \"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1\") " Jul 13 21:15:41.444387 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.444352 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-bundle" (OuterVolumeSpecName: "bundle") pod "7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" (UID: "7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:15:41.445812 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.445785 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-kube-api-access-d5v54" (OuterVolumeSpecName: "kube-api-access-d5v54") pod "7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" (UID: "7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1"). InnerVolumeSpecName "kube-api-access-d5v54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:15:41.447606 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.447577 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-util" (OuterVolumeSpecName: "util") pod "7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" (UID: "7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:15:41.545261 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.545219 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-util\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:15:41.545261 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.545258 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5v54\" (UniqueName: \"kubernetes.io/projected/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-kube-api-access-d5v54\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:15:41.545457 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:41.545276 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1-bundle\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:15:42.169996 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:42.169954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" event={"ID":"7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1","Type":"ContainerDied","Data":"6bc5973177325468663e56f65151fd6aaf61726d536d5b1f957c6090797ed823"} Jul 13 21:15:42.170192 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:42.169976 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdfrt" Jul 13 21:15:42.170192 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:42.170064 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bc5973177325468663e56f65151fd6aaf61726d536d5b1f957c6090797ed823" Jul 13 21:15:45.536801 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.536762 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4"] Jul 13 21:15:45.537234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.537070 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerName="extract" Jul 13 21:15:45.537234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.537082 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerName="extract" Jul 13 21:15:45.537234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.537092 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerName="util" Jul 13 21:15:45.537234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.537097 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerName="util" Jul 13 21:15:45.537234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.537103 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerName="pull" Jul 13 21:15:45.537234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.537109 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerName="pull" Jul 13 21:15:45.537234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.537156 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1cc2f1-01f9-486d-a7d8-cb0129bd5db1" containerName="extract" Jul 13 21:15:45.539372 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.539352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" Jul 13 21:15:45.542146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.542118 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:15:45.542291 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.542170 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4xpm6\"" Jul 13 21:15:45.542291 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.542201 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 21:15:45.551500 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.551469 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4"] Jul 13 21:15:45.677021 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.676959 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj67v\" (UniqueName: \"kubernetes.io/projected/14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed-kube-api-access-mj67v\") pod \"cert-manager-operator-controller-manager-55c444bf86-nhgd4\" (UID: \"14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" Jul 13 21:15:45.677021 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.677026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nhgd4\" (UID: \"14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" Jul 13 21:15:45.777877 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.777837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj67v\" (UniqueName: \"kubernetes.io/projected/14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed-kube-api-access-mj67v\") pod \"cert-manager-operator-controller-manager-55c444bf86-nhgd4\" (UID: \"14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" Jul 13 21:15:45.777877 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.777874 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nhgd4\" (UID: \"14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" Jul 13 21:15:45.778275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.778259 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nhgd4\" (UID: \"14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" Jul 13 21:15:45.785945 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.785923 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj67v\" (UniqueName: \"kubernetes.io/projected/14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed-kube-api-access-mj67v\") pod \"cert-manager-operator-controller-manager-55c444bf86-nhgd4\" (UID: \"14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" Jul 13 21:15:45.850029 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.849912 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" Jul 13 21:15:45.987491 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:45.987463 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4"] Jul 13 21:15:45.990421 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:15:45.990389 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fcf0b3_5ef3_4bb2_b3d9_c2915f7ad1ed.slice/crio-bb34d7fafa33247f6f9a71e9c389c60a85b0968c145d0c909ea74e70fb2f568d WatchSource:0}: Error finding container bb34d7fafa33247f6f9a71e9c389c60a85b0968c145d0c909ea74e70fb2f568d: Status 404 returned error can't find the container with id bb34d7fafa33247f6f9a71e9c389c60a85b0968c145d0c909ea74e70fb2f568d Jul 13 21:15:46.191130 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:46.191035 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" event={"ID":"14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed","Type":"ContainerStarted","Data":"bb34d7fafa33247f6f9a71e9c389c60a85b0968c145d0c909ea74e70fb2f568d"} Jul 13 21:15:48.201906 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:48.201864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" event={"ID":"14fcf0b3-5ef3-4bb2-b3d9-c2915f7ad1ed","Type":"ContainerStarted","Data":"4dd8d52f5fae733a33b1491ad75d16e22803cf538a37d5371a894d65e1d01c26"} Jul 13 21:15:48.223403 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:48.223346 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nhgd4" podStartSLOduration=1.661720275 podStartE2EDuration="3.22332841s" totalImagesPullingTime="1.561608135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:15:48.221102513 +0000 UTC m=+281.978321985" watchObservedRunningTime="2026-07-13 21:15:48.22332841 +0000 UTC m=+281.980547876" Jul 13 21:15:49.245870 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.245830 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4"] Jul 13 21:15:49.249393 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.249371 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.252043 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.251996 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 21:15:49.252210 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.252061 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fshvp\"" Jul 13 21:15:49.252995 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.252973 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 21:15:49.257473 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.257447 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4"] Jul 13 21:15:49.408825 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.408758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.408990 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.408879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.408990 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.408932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrnjq\" (UniqueName: \"kubernetes.io/projected/7c040511-c22a-445f-a1fe-f8f5aa2a0434-kube-api-access-jrnjq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.509458 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.509364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.509458 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.509416 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.509458 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.509444 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrnjq\" (UniqueName: \"kubernetes.io/projected/7c040511-c22a-445f-a1fe-f8f5aa2a0434-kube-api-access-jrnjq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.509796 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.509773 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.509833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.509813 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.520564 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.520528 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrnjq\" (UniqueName: \"kubernetes.io/projected/7c040511-c22a-445f-a1fe-f8f5aa2a0434-kube-api-access-jrnjq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.560562 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.560521 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:49.711707 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:49.711680 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4"] Jul 13 21:15:49.714458 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:15:49.714426 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c040511_c22a_445f_a1fe_f8f5aa2a0434.slice/crio-c2bcea9467d1799cf73685fc4036686c1de6d90312ecb079f2404c7beb4b0f75 WatchSource:0}: Error finding container c2bcea9467d1799cf73685fc4036686c1de6d90312ecb079f2404c7beb4b0f75: Status 404 returned error can't find the container with id c2bcea9467d1799cf73685fc4036686c1de6d90312ecb079f2404c7beb4b0f75 Jul 13 21:15:50.212138 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:50.212043 2572 generic.go:356] "Generic (PLEG): container finished" podID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerID="59db9e11c3840a9a91ba8ce1409f9f9a87d3d8536cb2782831b0fcdd7b902a09" exitCode=0 Jul 13 21:15:50.212138 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:50.212089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" event={"ID":"7c040511-c22a-445f-a1fe-f8f5aa2a0434","Type":"ContainerDied","Data":"59db9e11c3840a9a91ba8ce1409f9f9a87d3d8536cb2782831b0fcdd7b902a09"} Jul 13 21:15:50.212138 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:50.212133 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" event={"ID":"7c040511-c22a-445f-a1fe-f8f5aa2a0434","Type":"ContainerStarted","Data":"c2bcea9467d1799cf73685fc4036686c1de6d90312ecb079f2404c7beb4b0f75"} Jul 13 21:15:53.227117 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:53.227083 2572 generic.go:356] "Generic (PLEG): container finished" podID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerID="005af77fa78047b9c68aeaff10665b661d391aaa262601321a83971863324547" exitCode=0 Jul 13 21:15:53.227502 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:53.227139 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" event={"ID":"7c040511-c22a-445f-a1fe-f8f5aa2a0434","Type":"ContainerDied","Data":"005af77fa78047b9c68aeaff10665b661d391aaa262601321a83971863324547"} Jul 13 21:15:54.233514 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:54.233470 2572 generic.go:356] "Generic (PLEG): container finished" podID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerID="76b68358ebf6cca9605d9541b343cbce02f94e9ffac28bda05d6955ab5318b8b" exitCode=0 Jul 13 21:15:54.233901 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:54.233559 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" event={"ID":"7c040511-c22a-445f-a1fe-f8f5aa2a0434","Type":"ContainerDied","Data":"76b68358ebf6cca9605d9541b343cbce02f94e9ffac28bda05d6955ab5318b8b"} Jul 13 21:15:55.373317 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.373286 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:15:55.460566 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.460525 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrnjq\" (UniqueName: \"kubernetes.io/projected/7c040511-c22a-445f-a1fe-f8f5aa2a0434-kube-api-access-jrnjq\") pod \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " Jul 13 21:15:55.460713 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.460592 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-bundle\") pod \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " Jul 13 21:15:55.460713 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.460623 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-util\") pod \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\" (UID: \"7c040511-c22a-445f-a1fe-f8f5aa2a0434\") " Jul 13 21:15:55.460988 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.460958 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-bundle" (OuterVolumeSpecName: "bundle") pod "7c040511-c22a-445f-a1fe-f8f5aa2a0434" (UID: "7c040511-c22a-445f-a1fe-f8f5aa2a0434"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:15:55.462655 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.462627 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c040511-c22a-445f-a1fe-f8f5aa2a0434-kube-api-access-jrnjq" (OuterVolumeSpecName: "kube-api-access-jrnjq") pod "7c040511-c22a-445f-a1fe-f8f5aa2a0434" (UID: "7c040511-c22a-445f-a1fe-f8f5aa2a0434"). InnerVolumeSpecName "kube-api-access-jrnjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:15:55.465208 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.465180 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-util" (OuterVolumeSpecName: "util") pod "7c040511-c22a-445f-a1fe-f8f5aa2a0434" (UID: "7c040511-c22a-445f-a1fe-f8f5aa2a0434"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:15:55.561404 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.561311 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrnjq\" (UniqueName: \"kubernetes.io/projected/7c040511-c22a-445f-a1fe-f8f5aa2a0434-kube-api-access-jrnjq\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:15:55.561404 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.561346 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-bundle\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:15:55.561404 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:55.561354 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c040511-c22a-445f-a1fe-f8f5aa2a0434-util\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:15:56.244147 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:56.244106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" event={"ID":"7c040511-c22a-445f-a1fe-f8f5aa2a0434","Type":"ContainerDied","Data":"c2bcea9467d1799cf73685fc4036686c1de6d90312ecb079f2404c7beb4b0f75"} Jul 13 21:15:56.244350 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:56.244160 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2bcea9467d1799cf73685fc4036686c1de6d90312ecb079f2404c7beb4b0f75" Jul 13 21:15:56.244350 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:15:56.244160 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9lmn4" Jul 13 21:16:02.898755 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.898719 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk"] Jul 13 21:16:02.899214 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.899025 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerName="pull" Jul 13 21:16:02.899214 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.899037 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerName="pull" Jul 13 21:16:02.899214 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.899050 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerName="extract" Jul 13 21:16:02.899214 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.899056 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerName="extract" Jul 13 21:16:02.899214 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.899071 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerName="util" Jul 13 21:16:02.899214 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.899077 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerName="util" Jul 13 21:16:02.899214 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.899122 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c040511-c22a-445f-a1fe-f8f5aa2a0434" containerName="extract" Jul 13 21:16:02.970752 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.970714 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk"] Jul 13 21:16:02.971219 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.971192 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" Jul 13 21:16:02.977203 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.977173 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 21:16:02.977394 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.977231 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wqh9s\"" Jul 13 21:16:02.978358 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:02.978338 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 21:16:03.075807 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.075773 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jj6m8"] Jul 13 21:16:03.098138 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.098098 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jj6m8"] Jul 13 21:16:03.098271 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.098194 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jj6m8" Jul 13 21:16:03.101144 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.101118 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 21:16:03.101284 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.101150 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 21:16:03.101284 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.101179 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-58pgv\"" Jul 13 21:16:03.122851 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.122810 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shbsz\" (UniqueName: \"kubernetes.io/projected/151147b9-c1d1-46f6-a1f1-2d0ad231174e-kube-api-access-shbsz\") pod \"openshift-lws-operator-fd8ccff4c-dt9pk\" (UID: \"151147b9-c1d1-46f6-a1f1-2d0ad231174e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" Jul 13 21:16:03.122851 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.122851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151147b9-c1d1-46f6-a1f1-2d0ad231174e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dt9pk\" (UID: \"151147b9-c1d1-46f6-a1f1-2d0ad231174e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" Jul 13 21:16:03.224052 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.223941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e0d960-84ab-4424-94f4-6d24dbc2b9e1-bound-sa-token\") pod \"cert-manager-55b4d954d5-jj6m8\" (UID: \"e6e0d960-84ab-4424-94f4-6d24dbc2b9e1\") " pod="cert-manager/cert-manager-55b4d954d5-jj6m8" Jul 13 21:16:03.224052 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.223975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2v4j\" (UniqueName: \"kubernetes.io/projected/e6e0d960-84ab-4424-94f4-6d24dbc2b9e1-kube-api-access-j2v4j\") pod \"cert-manager-55b4d954d5-jj6m8\" (UID: \"e6e0d960-84ab-4424-94f4-6d24dbc2b9e1\") " pod="cert-manager/cert-manager-55b4d954d5-jj6m8" Jul 13 21:16:03.224052 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.224000 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shbsz\" (UniqueName: \"kubernetes.io/projected/151147b9-c1d1-46f6-a1f1-2d0ad231174e-kube-api-access-shbsz\") pod \"openshift-lws-operator-fd8ccff4c-dt9pk\" (UID: \"151147b9-c1d1-46f6-a1f1-2d0ad231174e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" Jul 13 21:16:03.224052 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.224050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151147b9-c1d1-46f6-a1f1-2d0ad231174e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dt9pk\" (UID: \"151147b9-c1d1-46f6-a1f1-2d0ad231174e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" Jul 13 21:16:03.224414 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.224395 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151147b9-c1d1-46f6-a1f1-2d0ad231174e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dt9pk\" (UID: \"151147b9-c1d1-46f6-a1f1-2d0ad231174e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" Jul 13 21:16:03.234773 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.234739 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shbsz\" (UniqueName: \"kubernetes.io/projected/151147b9-c1d1-46f6-a1f1-2d0ad231174e-kube-api-access-shbsz\") pod \"openshift-lws-operator-fd8ccff4c-dt9pk\" (UID: \"151147b9-c1d1-46f6-a1f1-2d0ad231174e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" Jul 13 21:16:03.296474 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.296446 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" Jul 13 21:16:03.324858 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.324827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e0d960-84ab-4424-94f4-6d24dbc2b9e1-bound-sa-token\") pod \"cert-manager-55b4d954d5-jj6m8\" (UID: \"e6e0d960-84ab-4424-94f4-6d24dbc2b9e1\") " pod="cert-manager/cert-manager-55b4d954d5-jj6m8" Jul 13 21:16:03.325048 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.324863 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2v4j\" (UniqueName: \"kubernetes.io/projected/e6e0d960-84ab-4424-94f4-6d24dbc2b9e1-kube-api-access-j2v4j\") pod \"cert-manager-55b4d954d5-jj6m8\" (UID: \"e6e0d960-84ab-4424-94f4-6d24dbc2b9e1\") " pod="cert-manager/cert-manager-55b4d954d5-jj6m8" Jul 13 21:16:03.334183 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.334152 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6e0d960-84ab-4424-94f4-6d24dbc2b9e1-bound-sa-token\") pod \"cert-manager-55b4d954d5-jj6m8\" (UID: \"e6e0d960-84ab-4424-94f4-6d24dbc2b9e1\") " pod="cert-manager/cert-manager-55b4d954d5-jj6m8" Jul 13 21:16:03.334183 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.334171 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2v4j\" (UniqueName: \"kubernetes.io/projected/e6e0d960-84ab-4424-94f4-6d24dbc2b9e1-kube-api-access-j2v4j\") pod \"cert-manager-55b4d954d5-jj6m8\" (UID: \"e6e0d960-84ab-4424-94f4-6d24dbc2b9e1\") " pod="cert-manager/cert-manager-55b4d954d5-jj6m8" Jul 13 21:16:03.407361 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.407319 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jj6m8" Jul 13 21:16:03.456334 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.456307 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk"] Jul 13 21:16:03.458752 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:16:03.458720 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod151147b9_c1d1_46f6_a1f1_2d0ad231174e.slice/crio-1a473ebbd5addfb2986187c70ea940318917d6b8772a34b2ceda15a4f3fcf7b9 WatchSource:0}: Error finding container 1a473ebbd5addfb2986187c70ea940318917d6b8772a34b2ceda15a4f3fcf7b9: Status 404 returned error can't find the container with id 1a473ebbd5addfb2986187c70ea940318917d6b8772a34b2ceda15a4f3fcf7b9 Jul 13 21:16:03.600549 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:03.600513 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jj6m8"] Jul 13 21:16:03.603590 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:16:03.603559 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6e0d960_84ab_4424_94f4_6d24dbc2b9e1.slice/crio-009580a5f25fa012a3a567b31af876bc2e6dda0457f5d636088a81ce849391fd WatchSource:0}: Error finding container 009580a5f25fa012a3a567b31af876bc2e6dda0457f5d636088a81ce849391fd: Status 404 returned error can't find the container with id 009580a5f25fa012a3a567b31af876bc2e6dda0457f5d636088a81ce849391fd Jul 13 21:16:04.281151 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:04.281109 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jj6m8" event={"ID":"e6e0d960-84ab-4424-94f4-6d24dbc2b9e1","Type":"ContainerStarted","Data":"009580a5f25fa012a3a567b31af876bc2e6dda0457f5d636088a81ce849391fd"} Jul 13 21:16:04.282733 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:04.282701 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" event={"ID":"151147b9-c1d1-46f6-a1f1-2d0ad231174e","Type":"ContainerStarted","Data":"1a473ebbd5addfb2986187c70ea940318917d6b8772a34b2ceda15a4f3fcf7b9"} Jul 13 21:16:06.652701 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:06.652670 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:16:06.653927 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:06.653769 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:16:06.664985 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:06.664964 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:16:06.665529 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:06.665503 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:16:06.668281 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:06.668261 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 21:16:07.300997 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:07.300946 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jj6m8" event={"ID":"e6e0d960-84ab-4424-94f4-6d24dbc2b9e1","Type":"ContainerStarted","Data":"980d677d714bb6bd28dbec4d1bdd4dd78c29565d4088c9d2e7a9e5cc6bb20f8a"} Jul 13 21:16:07.302932 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:07.302903 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" event={"ID":"151147b9-c1d1-46f6-a1f1-2d0ad231174e","Type":"ContainerStarted","Data":"d7bcba2145807d03fbf6b389e4b2e243cafab956b65b7d13ee734182b010d3e0"} Jul 13 21:16:07.318140 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:07.318084 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jj6m8" podStartSLOduration=1.328823652 podStartE2EDuration="4.318066392s" totalImagesPullingTime="2.98924274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:07.316982182 +0000 UTC m=+301.074201650" watchObservedRunningTime="2026-07-13 21:16:07.318066392 +0000 UTC m=+301.075285860" Jul 13 21:16:07.335827 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:07.335759 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dt9pk" podStartSLOduration=2.204688568 podStartE2EDuration="5.335735303s" totalImagesPullingTime="3.131046735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:07.333940424 +0000 UTC m=+301.091159903" watchObservedRunningTime="2026-07-13 21:16:07.335735303 +0000 UTC m=+301.092954772" Jul 13 21:16:09.651814 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.651772 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq"] Jul 13 21:16:09.654162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.654141 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.660171 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.660139 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 21:16:09.660333 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.660220 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fshvp\"" Jul 13 21:16:09.660333 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.660220 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 21:16:09.667856 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.667821 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq"] Jul 13 21:16:09.674130 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.674080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9dqk\" (UniqueName: \"kubernetes.io/projected/0c340404-b96d-4d61-b7e1-9a43fa05b127-kube-api-access-l9dqk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.674290 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.674189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.674290 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.674243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.774627 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.774586 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.774789 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.774646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.774789 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.774682 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9dqk\" (UniqueName: \"kubernetes.io/projected/0c340404-b96d-4d61-b7e1-9a43fa05b127-kube-api-access-l9dqk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.775066 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.775042 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.775129 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.775087 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.783295 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.783260 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9dqk\" (UniqueName: \"kubernetes.io/projected/0c340404-b96d-4d61-b7e1-9a43fa05b127-kube-api-access-l9dqk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:09.963754 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:09.963659 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:10.101098 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:10.101072 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq"] Jul 13 21:16:10.103385 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:16:10.103344 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c340404_b96d_4d61_b7e1_9a43fa05b127.slice/crio-cf809de4e743bad2c0c8034a03b782e67c10294b3deb5600ba8f724630662791 WatchSource:0}: Error finding container cf809de4e743bad2c0c8034a03b782e67c10294b3deb5600ba8f724630662791: Status 404 returned error can't find the container with id cf809de4e743bad2c0c8034a03b782e67c10294b3deb5600ba8f724630662791 Jul 13 21:16:10.320487 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:10.320453 2572 generic.go:356] "Generic (PLEG): container finished" podID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerID="cad293f0bdbb74e39f56184457a3bcfbae2cd15427aa711c25f64e0f6315eb3a" exitCode=0 Jul 13 21:16:10.320660 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:10.320541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" event={"ID":"0c340404-b96d-4d61-b7e1-9a43fa05b127","Type":"ContainerDied","Data":"cad293f0bdbb74e39f56184457a3bcfbae2cd15427aa711c25f64e0f6315eb3a"} Jul 13 21:16:10.320660 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:10.320594 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" event={"ID":"0c340404-b96d-4d61-b7e1-9a43fa05b127","Type":"ContainerStarted","Data":"cf809de4e743bad2c0c8034a03b782e67c10294b3deb5600ba8f724630662791"} Jul 13 21:16:10.321102 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:10.321085 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:16:11.326613 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:11.326522 2572 generic.go:356] "Generic (PLEG): container finished" podID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerID="423639eda27c5a4413a0e4711121ac6c36046cf6dc0dcc13365d8024788cbdd5" exitCode=0 Jul 13 21:16:11.326988 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:11.326651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" event={"ID":"0c340404-b96d-4d61-b7e1-9a43fa05b127","Type":"ContainerDied","Data":"423639eda27c5a4413a0e4711121ac6c36046cf6dc0dcc13365d8024788cbdd5"} Jul 13 21:16:12.333492 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:12.333459 2572 generic.go:356] "Generic (PLEG): container finished" podID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerID="e0f3ac9836bc9c78242c82acc1b51d318e059e4e72bd9ebf7ed3d27b83a249bb" exitCode=0 Jul 13 21:16:12.333889 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:12.333559 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" event={"ID":"0c340404-b96d-4d61-b7e1-9a43fa05b127","Type":"ContainerDied","Data":"e0f3ac9836bc9c78242c82acc1b51d318e059e4e72bd9ebf7ed3d27b83a249bb"} Jul 13 21:16:13.468077 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.468049 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:13.502741 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.502706 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-bundle\") pod \"0c340404-b96d-4d61-b7e1-9a43fa05b127\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " Jul 13 21:16:13.502917 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.502772 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9dqk\" (UniqueName: \"kubernetes.io/projected/0c340404-b96d-4d61-b7e1-9a43fa05b127-kube-api-access-l9dqk\") pod \"0c340404-b96d-4d61-b7e1-9a43fa05b127\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " Jul 13 21:16:13.502917 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.502819 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-util\") pod \"0c340404-b96d-4d61-b7e1-9a43fa05b127\" (UID: \"0c340404-b96d-4d61-b7e1-9a43fa05b127\") " Jul 13 21:16:13.503736 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.503699 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-bundle" (OuterVolumeSpecName: "bundle") pod "0c340404-b96d-4d61-b7e1-9a43fa05b127" (UID: "0c340404-b96d-4d61-b7e1-9a43fa05b127"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:16:13.505208 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.505178 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c340404-b96d-4d61-b7e1-9a43fa05b127-kube-api-access-l9dqk" (OuterVolumeSpecName: "kube-api-access-l9dqk") pod "0c340404-b96d-4d61-b7e1-9a43fa05b127" (UID: "0c340404-b96d-4d61-b7e1-9a43fa05b127"). InnerVolumeSpecName "kube-api-access-l9dqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:16:13.508612 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.508580 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-util" (OuterVolumeSpecName: "util") pod "0c340404-b96d-4d61-b7e1-9a43fa05b127" (UID: "0c340404-b96d-4d61-b7e1-9a43fa05b127"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:16:13.604106 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.603998 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9dqk\" (UniqueName: \"kubernetes.io/projected/0c340404-b96d-4d61-b7e1-9a43fa05b127-kube-api-access-l9dqk\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:16:13.604106 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.604050 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-util\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:16:13.604106 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:13.604060 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c340404-b96d-4d61-b7e1-9a43fa05b127-bundle\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:16:14.344507 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:14.344471 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" event={"ID":"0c340404-b96d-4d61-b7e1-9a43fa05b127","Type":"ContainerDied","Data":"cf809de4e743bad2c0c8034a03b782e67c10294b3deb5600ba8f724630662791"} Jul 13 21:16:14.344707 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:14.344520 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf809de4e743bad2c0c8034a03b782e67c10294b3deb5600ba8f724630662791" Jul 13 21:16:14.344707 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:14.344519 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc8chq" Jul 13 21:16:23.777565 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.777527 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l"] Jul 13 21:16:23.777967 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.777848 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerName="util" Jul 13 21:16:23.777967 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.777859 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerName="util" Jul 13 21:16:23.777967 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.777867 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerName="pull" Jul 13 21:16:23.777967 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.777873 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerName="pull" Jul 13 21:16:23.777967 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.777887 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerName="extract" Jul 13 21:16:23.777967 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.777893 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerName="extract" Jul 13 21:16:23.777967 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.777945 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c340404-b96d-4d61-b7e1-9a43fa05b127" containerName="extract" Jul 13 21:16:23.780176 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.780156 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.787523 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.787284 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 21:16:23.787523 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.787337 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q5mf8\"" Jul 13 21:16:23.787523 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.787407 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 21:16:23.787523 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.787343 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 21:16:23.787963 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.787948 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 21:16:23.800971 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.800939 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l"] Jul 13 21:16:23.886248 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.886207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb539ff-df7c-4f32-aead-b28e6b3f7920-tmp\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.886431 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.886274 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cb539ff-df7c-4f32-aead-b28e6b3f7920-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.886431 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.886333 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2cb539ff-df7c-4f32-aead-b28e6b3f7920-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.886431 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.886352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2cb539ff-df7c-4f32-aead-b28e6b3f7920-manifests\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.886431 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.886372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qqb9\" (UniqueName: \"kubernetes.io/projected/2cb539ff-df7c-4f32-aead-b28e6b3f7920-kube-api-access-5qqb9\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.987528 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.987486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cb539ff-df7c-4f32-aead-b28e6b3f7920-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.987732 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.987542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2cb539ff-df7c-4f32-aead-b28e6b3f7920-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.987732 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.987564 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2cb539ff-df7c-4f32-aead-b28e6b3f7920-manifests\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.987732 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.987583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qqb9\" (UniqueName: \"kubernetes.io/projected/2cb539ff-df7c-4f32-aead-b28e6b3f7920-kube-api-access-5qqb9\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.987732 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.987619 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb539ff-df7c-4f32-aead-b28e6b3f7920-tmp\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.988142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.988103 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2cb539ff-df7c-4f32-aead-b28e6b3f7920-manifests\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.990015 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.989978 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb539ff-df7c-4f32-aead-b28e6b3f7920-tmp\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.990142 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.990091 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2cb539ff-df7c-4f32-aead-b28e6b3f7920-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.990206 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.990136 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cb539ff-df7c-4f32-aead-b28e6b3f7920-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:23.996479 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:23.996442 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qqb9\" (UniqueName: \"kubernetes.io/projected/2cb539ff-df7c-4f32-aead-b28e6b3f7920-kube-api-access-5qqb9\") pod \"opendatahub-operator-controller-manager-6bd76fcbc5-df78l\" (UID: \"2cb539ff-df7c-4f32-aead-b28e6b3f7920\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:24.090862 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:24.090755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:24.235335 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:24.235306 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l"] Jul 13 21:16:24.238484 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:16:24.238450 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb539ff_df7c_4f32_aead_b28e6b3f7920.slice/crio-f2e1b34aac1eb5d6e9dc0573ef21d4a3c020eb3ad0e5ada66a4eccd9b1c7fd76 WatchSource:0}: Error finding container f2e1b34aac1eb5d6e9dc0573ef21d4a3c020eb3ad0e5ada66a4eccd9b1c7fd76: Status 404 returned error can't find the container with id f2e1b34aac1eb5d6e9dc0573ef21d4a3c020eb3ad0e5ada66a4eccd9b1c7fd76 Jul 13 21:16:24.390851 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:24.390758 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" event={"ID":"2cb539ff-df7c-4f32-aead-b28e6b3f7920","Type":"ContainerStarted","Data":"f2e1b34aac1eb5d6e9dc0573ef21d4a3c020eb3ad0e5ada66a4eccd9b1c7fd76"} Jul 13 21:16:28.412466 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:28.412416 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" event={"ID":"2cb539ff-df7c-4f32-aead-b28e6b3f7920","Type":"ContainerStarted","Data":"1b95cb6f7eebf6b31a8cdcd763997335721bda5c7f36ab12c3a79656ba447090"} Jul 13 21:16:29.418925 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:29.418890 2572 generic.go:356] "Generic (PLEG): container finished" podID="2cb539ff-df7c-4f32-aead-b28e6b3f7920" containerID="1b95cb6f7eebf6b31a8cdcd763997335721bda5c7f36ab12c3a79656ba447090" exitCode=0 Jul 13 21:16:29.419342 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:29.418931 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" event={"ID":"2cb539ff-df7c-4f32-aead-b28e6b3f7920","Type":"ContainerDied","Data":"1b95cb6f7eebf6b31a8cdcd763997335721bda5c7f36ab12c3a79656ba447090"} Jul 13 21:16:30.426155 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:30.426121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" event={"ID":"2cb539ff-df7c-4f32-aead-b28e6b3f7920","Type":"ContainerStarted","Data":"974250f095d686085e8d3052b3d7163dab289c305ea8e29a15b22654e52b95e6"} Jul 13 21:16:30.426529 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:30.426273 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:30.450693 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:30.450633 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" podStartSLOduration=2.596050721 podStartE2EDuration="7.450614773s" totalImagesPullingTime="3.760320443s" totalInitContainerRuntime="1.094243609s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:30.44836258 +0000 UTC m=+324.205582041" watchObservedRunningTime="2026-07-13 21:16:30.450614773 +0000 UTC m=+324.207834240" Jul 13 21:16:41.433390 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:41.433357 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bd76fcbc5-df78l" Jul 13 21:16:44.431211 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.431173 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f"] Jul 13 21:16:44.436841 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.436813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.440275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.440243 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 21:16:44.441265 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.441244 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tnsdf\"" Jul 13 21:16:44.441265 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.441254 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 21:16:44.442160 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.442143 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 21:16:44.464957 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.464918 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f"] Jul 13 21:16:44.572710 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.572672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44faa201-8946-4e02-b159-fe24d60d617b-cert\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.572918 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.572716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44faa201-8946-4e02-b159-fe24d60d617b-manager-config\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.572918 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.572804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpchm\" (UniqueName: \"kubernetes.io/projected/44faa201-8946-4e02-b159-fe24d60d617b-kube-api-access-cpchm\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.572918 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.572875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44faa201-8946-4e02-b159-fe24d60d617b-metrics-cert\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.674338 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.674290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44faa201-8946-4e02-b159-fe24d60d617b-metrics-cert\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.674540 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.674354 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44faa201-8946-4e02-b159-fe24d60d617b-cert\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.674540 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.674391 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44faa201-8946-4e02-b159-fe24d60d617b-manager-config\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.674540 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.674444 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpchm\" (UniqueName: \"kubernetes.io/projected/44faa201-8946-4e02-b159-fe24d60d617b-kube-api-access-cpchm\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.675337 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.675310 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44faa201-8946-4e02-b159-fe24d60d617b-manager-config\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.676984 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.676960 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44faa201-8946-4e02-b159-fe24d60d617b-metrics-cert\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.677094 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.676998 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44faa201-8946-4e02-b159-fe24d60d617b-cert\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.685092 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.684995 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpchm\" (UniqueName: \"kubernetes.io/projected/44faa201-8946-4e02-b159-fe24d60d617b-kube-api-access-cpchm\") pod \"lws-controller-manager-575f94fb69-8b74f\" (UID: \"44faa201-8946-4e02-b159-fe24d60d617b\") " pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.746454 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.746417 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:44.916697 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:44.916665 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f"] Jul 13 21:16:44.919236 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:16:44.919204 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44faa201_8946_4e02_b159_fe24d60d617b.slice/crio-ed8899d279fe7487b966021068e45b7112e9a43c9311e7b0ceca4b20fca27fc0 WatchSource:0}: Error finding container ed8899d279fe7487b966021068e45b7112e9a43c9311e7b0ceca4b20fca27fc0: Status 404 returned error can't find the container with id ed8899d279fe7487b966021068e45b7112e9a43c9311e7b0ceca4b20fca27fc0 Jul 13 21:16:45.495553 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:45.495507 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" event={"ID":"44faa201-8946-4e02-b159-fe24d60d617b","Type":"ContainerStarted","Data":"ed8899d279fe7487b966021068e45b7112e9a43c9311e7b0ceca4b20fca27fc0"} Jul 13 21:16:47.506736 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:47.506696 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" event={"ID":"44faa201-8946-4e02-b159-fe24d60d617b","Type":"ContainerStarted","Data":"181e07faa007e2f29ccaaea2ac0a5b8dd2cd29f6c924d145503a6b8aa1025b7a"} Jul 13 21:16:47.507144 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:47.506824 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:16:47.523070 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:47.522980 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" podStartSLOduration=1.956315176 podStartE2EDuration="3.522961327s" totalImagesPullingTime="1.566646151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:47.522823407 +0000 UTC m=+341.280042900" watchObservedRunningTime="2026-07-13 21:16:47.522961327 +0000 UTC m=+341.280180794" Jul 13 21:16:52.590724 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.590682 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz"] Jul 13 21:16:52.593136 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.593115 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.595969 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.595941 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 21:16:52.596098 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.595952 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nhhz5\"" Jul 13 21:16:52.596410 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.596393 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 21:16:52.596695 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.596682 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 21:16:52.598056 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.598042 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 21:16:52.607842 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.607813 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz"] Jul 13 21:16:52.744307 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.744263 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.744496 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.744315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.744496 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.744347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.744496 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.744399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b362f14-9725-4e52-8404-32bcf18e63c7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.744496 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.744443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvfxf\" (UniqueName: \"kubernetes.io/projected/1b362f14-9725-4e52-8404-32bcf18e63c7-kube-api-access-xvfxf\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.744496 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.744478 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.744690 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.744573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.845724 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.845628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.845724 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.845706 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.845724 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.845727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.846036 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.845748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.846036 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.845770 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.846036 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.845800 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b362f14-9725-4e52-8404-32bcf18e63c7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.846036 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.845831 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvfxf\" (UniqueName: \"kubernetes.io/projected/1b362f14-9725-4e52-8404-32bcf18e63c7-kube-api-access-xvfxf\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.846583 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.846557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.848144 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.848114 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b362f14-9725-4e52-8404-32bcf18e63c7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.848311 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.848292 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.848461 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.848444 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.848513 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.848494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.857437 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.857407 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvfxf\" (UniqueName: \"kubernetes.io/projected/1b362f14-9725-4e52-8404-32bcf18e63c7-kube-api-access-xvfxf\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.863275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.863248 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b362f14-9725-4e52-8404-32bcf18e63c7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5wqmz\" (UID: \"1b362f14-9725-4e52-8404-32bcf18e63c7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:52.902830 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:52.902795 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:53.064446 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:53.064408 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz"] Jul 13 21:16:53.068054 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:16:53.068018 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b362f14_9725_4e52_8404_32bcf18e63c7.slice/crio-53ea443eb7268988c21bd15312ab707f95dbc144b49c94281e72f1acbee0eeab WatchSource:0}: Error finding container 53ea443eb7268988c21bd15312ab707f95dbc144b49c94281e72f1acbee0eeab: Status 404 returned error can't find the container with id 53ea443eb7268988c21bd15312ab707f95dbc144b49c94281e72f1acbee0eeab Jul 13 21:16:53.536385 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:53.536349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" event={"ID":"1b362f14-9725-4e52-8404-32bcf18e63c7","Type":"ContainerStarted","Data":"53ea443eb7268988c21bd15312ab707f95dbc144b49c94281e72f1acbee0eeab"} Jul 13 21:16:55.597065 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:55.596968 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 21:16:55.597354 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:55.597121 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 21:16:56.555384 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:56.555333 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" event={"ID":"1b362f14-9725-4e52-8404-32bcf18e63c7","Type":"ContainerStarted","Data":"a19ad5227f855169422fe61e0a0c6f705ea2759ca27763a3264ee1cee2672954"} Jul 13 21:16:56.555601 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:56.555504 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:56.557303 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:56.557280 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" Jul 13 21:16:56.642634 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:56.642570 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5wqmz" podStartSLOduration=2.116011054 podStartE2EDuration="4.642550751s" totalImagesPullingTime="2.526539697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:16:56.605313887 +0000 UTC m=+350.362533354" watchObservedRunningTime="2026-07-13 21:16:56.642550751 +0000 UTC m=+350.399770217" Jul 13 21:16:58.514434 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:16:58.514348 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-575f94fb69-8b74f" Jul 13 21:17:56.942725 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.942680 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7"] Jul 13 21:17:56.946267 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.946246 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:56.948836 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.948782 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v2h48\"" Jul 13 21:17:56.948836 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.948783 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 21:17:56.949883 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.949863 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 21:17:56.954022 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.953984 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7"] Jul 13 21:17:56.993942 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.993903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:56.994124 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.993956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4t64\" (UniqueName: \"kubernetes.io/projected/07e916e0-5017-4d92-9c2e-0ef10ea00e49-kube-api-access-p4t64\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:56.994124 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:56.994067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:57.095312 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.095268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:57.095488 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.095331 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:57.095488 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.095358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4t64\" (UniqueName: \"kubernetes.io/projected/07e916e0-5017-4d92-9c2e-0ef10ea00e49-kube-api-access-p4t64\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:57.095708 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.095687 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:57.095748 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.095704 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:57.103672 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.103635 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4t64\" (UniqueName: \"kubernetes.io/projected/07e916e0-5017-4d92-9c2e-0ef10ea00e49-kube-api-access-p4t64\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:57.257164 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.257126 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:17:57.400960 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.400933 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7"] Jul 13 21:17:57.403759 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:17:57.403733 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e916e0_5017_4d92_9c2e_0ef10ea00e49.slice/crio-755a527215cc5dc44bc5f003ce6ff971ec83e65ee411cb694e642c7342b023e0 WatchSource:0}: Error finding container 755a527215cc5dc44bc5f003ce6ff971ec83e65ee411cb694e642c7342b023e0: Status 404 returned error can't find the container with id 755a527215cc5dc44bc5f003ce6ff971ec83e65ee411cb694e642c7342b023e0 Jul 13 21:17:57.553696 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.553656 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q"] Jul 13 21:17:57.557077 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.557055 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.565318 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.565288 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q"] Jul 13 21:17:57.598184 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.598153 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.598369 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.598210 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.598369 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.598238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktbz6\" (UniqueName: \"kubernetes.io/projected/548c5568-8459-426f-b804-048d29e612fd-kube-api-access-ktbz6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.699145 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.699104 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.699318 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.699187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.699318 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.699221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktbz6\" (UniqueName: \"kubernetes.io/projected/548c5568-8459-426f-b804-048d29e612fd-kube-api-access-ktbz6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.699575 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.699550 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.699640 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.699586 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.707576 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.707542 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktbz6\" (UniqueName: \"kubernetes.io/projected/548c5568-8459-426f-b804-048d29e612fd-kube-api-access-ktbz6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:57.859594 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.859503 2572 generic.go:356] "Generic (PLEG): container finished" podID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerID="0863d8f5cffc0338010e1d927f6fe1e8da0f329c2c47e678acf70ad77b4649c4" exitCode=0 Jul 13 21:17:57.859758 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.859586 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" event={"ID":"07e916e0-5017-4d92-9c2e-0ef10ea00e49","Type":"ContainerDied","Data":"0863d8f5cffc0338010e1d927f6fe1e8da0f329c2c47e678acf70ad77b4649c4"} Jul 13 21:17:57.859758 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.859666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" event={"ID":"07e916e0-5017-4d92-9c2e-0ef10ea00e49","Type":"ContainerStarted","Data":"755a527215cc5dc44bc5f003ce6ff971ec83e65ee411cb694e642c7342b023e0"} Jul 13 21:17:57.886373 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:57.886336 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:17:58.023929 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.023896 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q"] Jul 13 21:17:58.025390 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:17:58.025360 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548c5568_8459_426f_b804_048d29e612fd.slice/crio-d2fb9c0ab16024da301765fe398019a4e8ff3c5e3e6e04e7e4a17d5eaba1c383 WatchSource:0}: Error finding container d2fb9c0ab16024da301765fe398019a4e8ff3c5e3e6e04e7e4a17d5eaba1c383: Status 404 returned error can't find the container with id d2fb9c0ab16024da301765fe398019a4e8ff3c5e3e6e04e7e4a17d5eaba1c383 Jul 13 21:17:58.143861 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.143827 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf"] Jul 13 21:17:58.147221 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.147201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.155572 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.155540 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf"] Jul 13 21:17:58.202582 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.202548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.202751 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.202591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmvqj\" (UniqueName: \"kubernetes.io/projected/239044cd-dffb-4534-ad8f-cee56f3218a7-kube-api-access-nmvqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.202751 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.202611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.303691 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.303648 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.303691 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.303694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvqj\" (UniqueName: \"kubernetes.io/projected/239044cd-dffb-4534-ad8f-cee56f3218a7-kube-api-access-nmvqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.303949 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.303713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.304098 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.304082 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.304227 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.304205 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.312906 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.312879 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmvqj\" (UniqueName: \"kubernetes.io/projected/239044cd-dffb-4534-ad8f-cee56f3218a7-kube-api-access-nmvqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.492449 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.492411 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:17:58.647565 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.647539 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf"] Jul 13 21:17:58.649769 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:17:58.649745 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239044cd_dffb_4534_ad8f_cee56f3218a7.slice/crio-d840d12a2285adaac9545a20a3bfa7722fd4e11a2be7579508945f2fbfc74f15 WatchSource:0}: Error finding container d840d12a2285adaac9545a20a3bfa7722fd4e11a2be7579508945f2fbfc74f15: Status 404 returned error can't find the container with id d840d12a2285adaac9545a20a3bfa7722fd4e11a2be7579508945f2fbfc74f15 Jul 13 21:17:58.749364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.749333 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf"] Jul 13 21:17:58.752937 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.752914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.761665 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.761631 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf"] Jul 13 21:17:58.808742 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.808699 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.808903 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.808778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w7mh\" (UniqueName: \"kubernetes.io/projected/c686c4df-c581-4d1d-bb7b-cb8b175024f7-kube-api-access-2w7mh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.808903 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.808815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.866531 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.866495 2572 generic.go:356] "Generic (PLEG): container finished" podID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerID="2aa1049cea6f80262d6154ec3dc25a865bb4c5047fc7aa0fbeee48a25c125018" exitCode=0 Jul 13 21:17:58.866720 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.866588 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" event={"ID":"239044cd-dffb-4534-ad8f-cee56f3218a7","Type":"ContainerDied","Data":"2aa1049cea6f80262d6154ec3dc25a865bb4c5047fc7aa0fbeee48a25c125018"} Jul 13 21:17:58.866720 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.866645 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" event={"ID":"239044cd-dffb-4534-ad8f-cee56f3218a7","Type":"ContainerStarted","Data":"d840d12a2285adaac9545a20a3bfa7722fd4e11a2be7579508945f2fbfc74f15"} Jul 13 21:17:58.868269 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.868246 2572 generic.go:356] "Generic (PLEG): container finished" podID="548c5568-8459-426f-b804-048d29e612fd" containerID="7b3c92301346336cf608cf7c4150ec8936925d4ff59b5a242178d76d98a7adf7" exitCode=0 Jul 13 21:17:58.868374 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.868330 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" event={"ID":"548c5568-8459-426f-b804-048d29e612fd","Type":"ContainerDied","Data":"7b3c92301346336cf608cf7c4150ec8936925d4ff59b5a242178d76d98a7adf7"} Jul 13 21:17:58.868422 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.868377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" event={"ID":"548c5568-8459-426f-b804-048d29e612fd","Type":"ContainerStarted","Data":"d2fb9c0ab16024da301765fe398019a4e8ff3c5e3e6e04e7e4a17d5eaba1c383"} Jul 13 21:17:58.870146 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.870128 2572 generic.go:356] "Generic (PLEG): container finished" podID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerID="e36bb10864f6028aa2b238d17b3fdf11d7272a537a1f9c380126b33f192bd393" exitCode=0 Jul 13 21:17:58.870222 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.870153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" event={"ID":"07e916e0-5017-4d92-9c2e-0ef10ea00e49","Type":"ContainerDied","Data":"e36bb10864f6028aa2b238d17b3fdf11d7272a537a1f9c380126b33f192bd393"} Jul 13 21:17:58.909258 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.909220 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.909424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.909347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w7mh\" (UniqueName: \"kubernetes.io/projected/c686c4df-c581-4d1d-bb7b-cb8b175024f7-kube-api-access-2w7mh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.909424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.909389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.909857 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.909799 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.910058 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.909963 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:58.918304 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:58.918271 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w7mh\" (UniqueName: \"kubernetes.io/projected/c686c4df-c581-4d1d-bb7b-cb8b175024f7-kube-api-access-2w7mh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:59.104654 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.104606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:17:59.238749 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.238723 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf"] Jul 13 21:17:59.240311 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:17:59.240283 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc686c4df_c581_4d1d_bb7b_cb8b175024f7.slice/crio-ed34869096dcde67745a4dec92cf00d699d600b7bda23c6b15c1e5983f96f570 WatchSource:0}: Error finding container ed34869096dcde67745a4dec92cf00d699d600b7bda23c6b15c1e5983f96f570: Status 404 returned error can't find the container with id ed34869096dcde67745a4dec92cf00d699d600b7bda23c6b15c1e5983f96f570 Jul 13 21:17:59.883766 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.883729 2572 generic.go:356] "Generic (PLEG): container finished" podID="548c5568-8459-426f-b804-048d29e612fd" containerID="f12333bee3d57383afb9edb3cda6ec11bde3d39e7c9a692cf4c42770998996d7" exitCode=0 Jul 13 21:17:59.883972 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.883823 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" event={"ID":"548c5568-8459-426f-b804-048d29e612fd","Type":"ContainerDied","Data":"f12333bee3d57383afb9edb3cda6ec11bde3d39e7c9a692cf4c42770998996d7"} Jul 13 21:17:59.886261 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.886235 2572 generic.go:356] "Generic (PLEG): container finished" podID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerID="8e739f8b95fbb0c112aa30c92ca461462b4e9ae5842b62bd570cd8197ab1b371" exitCode=0 Jul 13 21:17:59.886359 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.886275 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" event={"ID":"07e916e0-5017-4d92-9c2e-0ef10ea00e49","Type":"ContainerDied","Data":"8e739f8b95fbb0c112aa30c92ca461462b4e9ae5842b62bd570cd8197ab1b371"} Jul 13 21:17:59.887844 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.887807 2572 generic.go:356] "Generic (PLEG): container finished" podID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerID="9826837e092a537bf0d794f8ac549cad081fde68f27eeb0075eb8c283e0bc04a" exitCode=0 Jul 13 21:17:59.887927 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.887863 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" event={"ID":"c686c4df-c581-4d1d-bb7b-cb8b175024f7","Type":"ContainerDied","Data":"9826837e092a537bf0d794f8ac549cad081fde68f27eeb0075eb8c283e0bc04a"} Jul 13 21:17:59.887927 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:17:59.887896 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" event={"ID":"c686c4df-c581-4d1d-bb7b-cb8b175024f7","Type":"ContainerStarted","Data":"ed34869096dcde67745a4dec92cf00d699d600b7bda23c6b15c1e5983f96f570"} Jul 13 21:18:00.894962 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:00.894869 2572 generic.go:356] "Generic (PLEG): container finished" podID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerID="4ee2b449bbe9df135dd63bbb9877888fa44ac202c4a1a161cba3f203237b831f" exitCode=0 Jul 13 21:18:00.894962 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:00.894947 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" event={"ID":"239044cd-dffb-4534-ad8f-cee56f3218a7","Type":"ContainerDied","Data":"4ee2b449bbe9df135dd63bbb9877888fa44ac202c4a1a161cba3f203237b831f"} Jul 13 21:18:00.896834 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:00.896809 2572 generic.go:356] "Generic (PLEG): container finished" podID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerID="d1d99da1d48ae8d7e7b9cf44aa5e5a461afa81a1b6328444e94ff973a29d8f83" exitCode=0 Jul 13 21:18:00.896958 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:00.896937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" event={"ID":"c686c4df-c581-4d1d-bb7b-cb8b175024f7","Type":"ContainerDied","Data":"d1d99da1d48ae8d7e7b9cf44aa5e5a461afa81a1b6328444e94ff973a29d8f83"} Jul 13 21:18:00.899151 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:00.899130 2572 generic.go:356] "Generic (PLEG): container finished" podID="548c5568-8459-426f-b804-048d29e612fd" containerID="d6fe1abc3bd74017a0cba15d21fecf2905b3fbcc55a431385b8f98cd966f7f09" exitCode=0 Jul 13 21:18:00.899275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:00.899205 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" event={"ID":"548c5568-8459-426f-b804-048d29e612fd","Type":"ContainerDied","Data":"d6fe1abc3bd74017a0cba15d21fecf2905b3fbcc55a431385b8f98cd966f7f09"} Jul 13 21:18:01.034555 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.034528 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:18:01.130322 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.130283 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-util\") pod \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " Jul 13 21:18:01.130322 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.130331 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-bundle\") pod \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " Jul 13 21:18:01.130510 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.130387 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4t64\" (UniqueName: \"kubernetes.io/projected/07e916e0-5017-4d92-9c2e-0ef10ea00e49-kube-api-access-p4t64\") pod \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\" (UID: \"07e916e0-5017-4d92-9c2e-0ef10ea00e49\") " Jul 13 21:18:01.130862 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.130836 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-bundle" (OuterVolumeSpecName: "bundle") pod "07e916e0-5017-4d92-9c2e-0ef10ea00e49" (UID: "07e916e0-5017-4d92-9c2e-0ef10ea00e49"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:18:01.132645 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.132610 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e916e0-5017-4d92-9c2e-0ef10ea00e49-kube-api-access-p4t64" (OuterVolumeSpecName: "kube-api-access-p4t64") pod "07e916e0-5017-4d92-9c2e-0ef10ea00e49" (UID: "07e916e0-5017-4d92-9c2e-0ef10ea00e49"). InnerVolumeSpecName "kube-api-access-p4t64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:18:01.135542 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.135513 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-util" (OuterVolumeSpecName: "util") pod "07e916e0-5017-4d92-9c2e-0ef10ea00e49" (UID: "07e916e0-5017-4d92-9c2e-0ef10ea00e49"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:18:01.231504 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.231403 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-util\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:01.231504 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.231439 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07e916e0-5017-4d92-9c2e-0ef10ea00e49-bundle\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:01.231504 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.231451 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4t64\" (UniqueName: \"kubernetes.io/projected/07e916e0-5017-4d92-9c2e-0ef10ea00e49-kube-api-access-p4t64\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:01.906444 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.906412 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" Jul 13 21:18:01.906889 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.906417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7" event={"ID":"07e916e0-5017-4d92-9c2e-0ef10ea00e49","Type":"ContainerDied","Data":"755a527215cc5dc44bc5f003ce6ff971ec83e65ee411cb694e642c7342b023e0"} Jul 13 21:18:01.906889 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.906531 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="755a527215cc5dc44bc5f003ce6ff971ec83e65ee411cb694e642c7342b023e0" Jul 13 21:18:01.908483 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.908460 2572 generic.go:356] "Generic (PLEG): container finished" podID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerID="1896759a65ac04eb39465310903aad24d226b16fc5f2878695d736262cc22aef" exitCode=0 Jul 13 21:18:01.908618 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.908529 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" event={"ID":"239044cd-dffb-4534-ad8f-cee56f3218a7","Type":"ContainerDied","Data":"1896759a65ac04eb39465310903aad24d226b16fc5f2878695d736262cc22aef"} Jul 13 21:18:01.910593 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.910566 2572 generic.go:356] "Generic (PLEG): container finished" podID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerID="5cefc7cb0e2565df42ece6b7b3369f2686d243b62b20d04b2bcbc9e14921059a" exitCode=0 Jul 13 21:18:01.910713 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:01.910638 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" event={"ID":"c686c4df-c581-4d1d-bb7b-cb8b175024f7","Type":"ContainerDied","Data":"5cefc7cb0e2565df42ece6b7b3369f2686d243b62b20d04b2bcbc9e14921059a"} Jul 13 21:18:02.045261 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.045233 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:18:02.140418 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.140371 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktbz6\" (UniqueName: \"kubernetes.io/projected/548c5568-8459-426f-b804-048d29e612fd-kube-api-access-ktbz6\") pod \"548c5568-8459-426f-b804-048d29e612fd\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " Jul 13 21:18:02.140615 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.140483 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-util\") pod \"548c5568-8459-426f-b804-048d29e612fd\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " Jul 13 21:18:02.140615 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.140522 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-bundle\") pod \"548c5568-8459-426f-b804-048d29e612fd\" (UID: \"548c5568-8459-426f-b804-048d29e612fd\") " Jul 13 21:18:02.140940 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.140910 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-bundle" (OuterVolumeSpecName: "bundle") pod "548c5568-8459-426f-b804-048d29e612fd" (UID: "548c5568-8459-426f-b804-048d29e612fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:18:02.142465 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.142441 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548c5568-8459-426f-b804-048d29e612fd-kube-api-access-ktbz6" (OuterVolumeSpecName: "kube-api-access-ktbz6") pod "548c5568-8459-426f-b804-048d29e612fd" (UID: "548c5568-8459-426f-b804-048d29e612fd"). InnerVolumeSpecName "kube-api-access-ktbz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:18:02.145974 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.145935 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-util" (OuterVolumeSpecName: "util") pod "548c5568-8459-426f-b804-048d29e612fd" (UID: "548c5568-8459-426f-b804-048d29e612fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:18:02.241476 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.241434 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-util\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:02.241476 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.241471 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548c5568-8459-426f-b804-048d29e612fd-bundle\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:02.241664 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.241484 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktbz6\" (UniqueName: \"kubernetes.io/projected/548c5568-8459-426f-b804-048d29e612fd-kube-api-access-ktbz6\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:02.916906 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.916877 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" Jul 13 21:18:02.917322 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.916909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q" event={"ID":"548c5568-8459-426f-b804-048d29e612fd","Type":"ContainerDied","Data":"d2fb9c0ab16024da301765fe398019a4e8ff3c5e3e6e04e7e4a17d5eaba1c383"} Jul 13 21:18:02.917322 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:02.916959 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2fb9c0ab16024da301765fe398019a4e8ff3c5e3e6e04e7e4a17d5eaba1c383" Jul 13 21:18:03.059584 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.059249 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:18:03.102259 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.102226 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:18:03.150707 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.150671 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w7mh\" (UniqueName: \"kubernetes.io/projected/c686c4df-c581-4d1d-bb7b-cb8b175024f7-kube-api-access-2w7mh\") pod \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " Jul 13 21:18:03.150887 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.150720 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-bundle\") pod \"239044cd-dffb-4534-ad8f-cee56f3218a7\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " Jul 13 21:18:03.150887 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.150759 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmvqj\" (UniqueName: \"kubernetes.io/projected/239044cd-dffb-4534-ad8f-cee56f3218a7-kube-api-access-nmvqj\") pod \"239044cd-dffb-4534-ad8f-cee56f3218a7\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " Jul 13 21:18:03.151038 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.150896 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-bundle\") pod \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " Jul 13 21:18:03.151038 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.150960 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-util\") pod \"239044cd-dffb-4534-ad8f-cee56f3218a7\" (UID: \"239044cd-dffb-4534-ad8f-cee56f3218a7\") " Jul 13 21:18:03.151137 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.151057 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-util\") pod \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\" (UID: \"c686c4df-c581-4d1d-bb7b-cb8b175024f7\") " Jul 13 21:18:03.151554 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.151522 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-bundle" (OuterVolumeSpecName: "bundle") pod "c686c4df-c581-4d1d-bb7b-cb8b175024f7" (UID: "c686c4df-c581-4d1d-bb7b-cb8b175024f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:18:03.151676 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.151602 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-bundle" (OuterVolumeSpecName: "bundle") pod "239044cd-dffb-4534-ad8f-cee56f3218a7" (UID: "239044cd-dffb-4534-ad8f-cee56f3218a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:18:03.152960 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.152927 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/239044cd-dffb-4534-ad8f-cee56f3218a7-kube-api-access-nmvqj" (OuterVolumeSpecName: "kube-api-access-nmvqj") pod "239044cd-dffb-4534-ad8f-cee56f3218a7" (UID: "239044cd-dffb-4534-ad8f-cee56f3218a7"). InnerVolumeSpecName "kube-api-access-nmvqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:18:03.153207 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.153189 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c686c4df-c581-4d1d-bb7b-cb8b175024f7-kube-api-access-2w7mh" (OuterVolumeSpecName: "kube-api-access-2w7mh") pod "c686c4df-c581-4d1d-bb7b-cb8b175024f7" (UID: "c686c4df-c581-4d1d-bb7b-cb8b175024f7"). InnerVolumeSpecName "kube-api-access-2w7mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:18:03.156989 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.156965 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-util" (OuterVolumeSpecName: "util") pod "239044cd-dffb-4534-ad8f-cee56f3218a7" (UID: "239044cd-dffb-4534-ad8f-cee56f3218a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:18:03.157599 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.157578 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-util" (OuterVolumeSpecName: "util") pod "c686c4df-c581-4d1d-bb7b-cb8b175024f7" (UID: "c686c4df-c581-4d1d-bb7b-cb8b175024f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 21:18:03.252315 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.252275 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-util\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:03.252315 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.252308 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w7mh\" (UniqueName: \"kubernetes.io/projected/c686c4df-c581-4d1d-bb7b-cb8b175024f7-kube-api-access-2w7mh\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:03.252315 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.252320 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-bundle\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:03.252551 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.252330 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmvqj\" (UniqueName: \"kubernetes.io/projected/239044cd-dffb-4534-ad8f-cee56f3218a7-kube-api-access-nmvqj\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:03.252551 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.252339 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c686c4df-c581-4d1d-bb7b-cb8b175024f7-bundle\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:03.252551 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.252348 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/239044cd-dffb-4534-ad8f-cee56f3218a7-util\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:18:03.923442 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.923409 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" Jul 13 21:18:03.923442 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.923414 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf" event={"ID":"239044cd-dffb-4534-ad8f-cee56f3218a7","Type":"ContainerDied","Data":"d840d12a2285adaac9545a20a3bfa7722fd4e11a2be7579508945f2fbfc74f15"} Jul 13 21:18:03.923897 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.923462 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d840d12a2285adaac9545a20a3bfa7722fd4e11a2be7579508945f2fbfc74f15" Jul 13 21:18:03.928566 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.928531 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" event={"ID":"c686c4df-c581-4d1d-bb7b-cb8b175024f7","Type":"ContainerDied","Data":"ed34869096dcde67745a4dec92cf00d699d600b7bda23c6b15c1e5983f96f570"} Jul 13 21:18:03.928566 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.928566 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf" Jul 13 21:18:03.928722 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:18:03.928588 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed34869096dcde67745a4dec92cf00d699d600b7bda23c6b15c1e5983f96f570" Jul 13 21:19:18.476149 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476101 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5cbnk"] Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476650 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerName="util" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476670 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerName="util" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476682 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerName="pull" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476690 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerName="pull" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476705 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476714 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476722 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548c5568-8459-426f-b804-048d29e612fd" containerName="pull" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476730 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="548c5568-8459-426f-b804-048d29e612fd" containerName="pull" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476738 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476746 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476765 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerName="pull" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476773 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerName="pull" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476785 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476793 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476807 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548c5568-8459-426f-b804-048d29e612fd" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476815 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="548c5568-8459-426f-b804-048d29e612fd" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476827 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548c5568-8459-426f-b804-048d29e612fd" containerName="util" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476834 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="548c5568-8459-426f-b804-048d29e612fd" containerName="util" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476843 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerName="pull" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476850 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerName="pull" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476862 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerName="util" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476869 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerName="util" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476882 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerName="util" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476890 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerName="util" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.476986 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="548c5568-8459-426f-b804-048d29e612fd" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.477022 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="239044cd-dffb-4534-ad8f-cee56f3218a7" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.477033 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c686c4df-c581-4d1d-bb7b-cb8b175024f7" containerName="extract" Jul 13 21:19:18.477162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.477043 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e916e0-5017-4d92-9c2e-0ef10ea00e49" containerName="extract" Jul 13 21:19:18.480458 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.480435 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:18.482968 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.482943 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 21:19:18.482968 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.482960 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 21:19:18.483156 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.483059 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 21:19:18.483903 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.483887 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v2h48\"" Jul 13 21:19:18.489067 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.489043 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5cbnk"] Jul 13 21:19:18.570652 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.570616 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5cbnk"] Jul 13 21:19:18.594120 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.594084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgkx6\" (UniqueName: \"kubernetes.io/projected/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-kube-api-access-qgkx6\") pod \"limitador-limitador-64c94fd64f-5cbnk\" (UID: \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:18.594294 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.594202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-config-file\") pod \"limitador-limitador-64c94fd64f-5cbnk\" (UID: \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:18.695120 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.695070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgkx6\" (UniqueName: \"kubernetes.io/projected/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-kube-api-access-qgkx6\") pod \"limitador-limitador-64c94fd64f-5cbnk\" (UID: \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:18.695303 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.695150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-config-file\") pod \"limitador-limitador-64c94fd64f-5cbnk\" (UID: \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:18.695800 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.695781 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-config-file\") pod \"limitador-limitador-64c94fd64f-5cbnk\" (UID: \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:18.702905 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.702878 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgkx6\" (UniqueName: \"kubernetes.io/projected/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-kube-api-access-qgkx6\") pod \"limitador-limitador-64c94fd64f-5cbnk\" (UID: \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:18.791912 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.791872 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:18.928921 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:18.928894 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5cbnk"] Jul 13 21:19:18.930793 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:19:18.930761 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c0c53a_2ae7_4f13_9f11_3700d5176e66.slice/crio-696c2db7329dcce0c125245f0852619ef3a3f3a03fd5141c0ad7666b9a8ea3a2 WatchSource:0}: Error finding container 696c2db7329dcce0c125245f0852619ef3a3f3a03fd5141c0ad7666b9a8ea3a2: Status 404 returned error can't find the container with id 696c2db7329dcce0c125245f0852619ef3a3f3a03fd5141c0ad7666b9a8ea3a2 Jul 13 21:19:19.309080 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:19.309047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" event={"ID":"c5c0c53a-2ae7-4f13-9f11-3700d5176e66","Type":"ContainerStarted","Data":"696c2db7329dcce0c125245f0852619ef3a3f3a03fd5141c0ad7666b9a8ea3a2"} Jul 13 21:19:22.325923 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:22.325884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" event={"ID":"c5c0c53a-2ae7-4f13-9f11-3700d5176e66","Type":"ContainerStarted","Data":"97d04d786a96a4302e25b7477d7cedf4bc32306bccdf160996ab7ce01d5088bd"} Jul 13 21:19:22.326320 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:22.326032 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:22.342316 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:22.342250 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" podStartSLOduration=1.303846243 podStartE2EDuration="4.342234534s" totalImagesPullingTime="3.038388291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:19:22.340768338 +0000 UTC m=+496.097987806" watchObservedRunningTime="2026-07-13 21:19:22.342234534 +0000 UTC m=+496.099454001" Jul 13 21:19:33.333277 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:33.333235 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:33.602674 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:33.602570 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5cbnk"] Jul 13 21:19:33.602913 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:33.602820 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" podUID="c5c0c53a-2ae7-4f13-9f11-3700d5176e66" containerName="limitador" containerID="cri-o://97d04d786a96a4302e25b7477d7cedf4bc32306bccdf160996ab7ce01d5088bd" gracePeriod=30 Jul 13 21:19:34.389066 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.389026 2572 generic.go:356] "Generic (PLEG): container finished" podID="c5c0c53a-2ae7-4f13-9f11-3700d5176e66" containerID="97d04d786a96a4302e25b7477d7cedf4bc32306bccdf160996ab7ce01d5088bd" exitCode=0 Jul 13 21:19:34.389066 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.389068 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" event={"ID":"c5c0c53a-2ae7-4f13-9f11-3700d5176e66","Type":"ContainerDied","Data":"97d04d786a96a4302e25b7477d7cedf4bc32306bccdf160996ab7ce01d5088bd"} Jul 13 21:19:34.558745 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.558714 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:34.637348 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.637304 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-config-file\") pod \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\" (UID: \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\") " Jul 13 21:19:34.637553 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.637411 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgkx6\" (UniqueName: \"kubernetes.io/projected/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-kube-api-access-qgkx6\") pod \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\" (UID: \"c5c0c53a-2ae7-4f13-9f11-3700d5176e66\") " Jul 13 21:19:34.637754 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.637727 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-config-file" (OuterVolumeSpecName: "config-file") pod "c5c0c53a-2ae7-4f13-9f11-3700d5176e66" (UID: "c5c0c53a-2ae7-4f13-9f11-3700d5176e66"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:19:34.639543 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.639480 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-kube-api-access-qgkx6" (OuterVolumeSpecName: "kube-api-access-qgkx6") pod "c5c0c53a-2ae7-4f13-9f11-3700d5176e66" (UID: "c5c0c53a-2ae7-4f13-9f11-3700d5176e66"). InnerVolumeSpecName "kube-api-access-qgkx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:19:34.739130 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.739083 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgkx6\" (UniqueName: \"kubernetes.io/projected/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-kube-api-access-qgkx6\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:19:34.739130 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:34.739119 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5c0c53a-2ae7-4f13-9f11-3700d5176e66-config-file\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:19:35.395263 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:35.395230 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" event={"ID":"c5c0c53a-2ae7-4f13-9f11-3700d5176e66","Type":"ContainerDied","Data":"696c2db7329dcce0c125245f0852619ef3a3f3a03fd5141c0ad7666b9a8ea3a2"} Jul 13 21:19:35.395263 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:35.395262 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5cbnk" Jul 13 21:19:35.395776 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:35.395296 2572 scope.go:117] "RemoveContainer" containerID="97d04d786a96a4302e25b7477d7cedf4bc32306bccdf160996ab7ce01d5088bd" Jul 13 21:19:35.412227 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:35.412196 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5cbnk"] Jul 13 21:19:35.414172 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:35.414146 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5cbnk"] Jul 13 21:19:36.805503 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:36.805470 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5c0c53a-2ae7-4f13-9f11-3700d5176e66" path="/var/lib/kubelet/pods/c5c0c53a-2ae7-4f13-9f11-3700d5176e66/volumes" Jul 13 21:19:37.504617 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.504579 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6jflc"] Jul 13 21:19:37.505067 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.504994 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c0c53a-2ae7-4f13-9f11-3700d5176e66" containerName="limitador" Jul 13 21:19:37.505067 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.505031 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c0c53a-2ae7-4f13-9f11-3700d5176e66" containerName="limitador" Jul 13 21:19:37.505268 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.505116 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5c0c53a-2ae7-4f13-9f11-3700d5176e66" containerName="limitador" Jul 13 21:19:37.509576 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.509550 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:37.512313 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.512274 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 21:19:37.512451 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.512273 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 13 21:19:37.512451 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.512274 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 21:19:37.513661 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.513641 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5xxln\"" Jul 13 21:19:37.518021 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.517972 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6jflc"] Jul 13 21:19:37.662815 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.662775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq9qp\" (UniqueName: \"kubernetes.io/projected/9dcd58ec-941b-47b0-86d6-5d78e8dd5869-kube-api-access-lq9qp\") pod \"postgres-69fb4594cf-6jflc\" (UID: \"9dcd58ec-941b-47b0-86d6-5d78e8dd5869\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:37.663040 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.662825 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9dcd58ec-941b-47b0-86d6-5d78e8dd5869-data\") pod \"postgres-69fb4594cf-6jflc\" (UID: \"9dcd58ec-941b-47b0-86d6-5d78e8dd5869\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:37.764162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.764059 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq9qp\" (UniqueName: \"kubernetes.io/projected/9dcd58ec-941b-47b0-86d6-5d78e8dd5869-kube-api-access-lq9qp\") pod \"postgres-69fb4594cf-6jflc\" (UID: \"9dcd58ec-941b-47b0-86d6-5d78e8dd5869\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:37.764162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.764113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9dcd58ec-941b-47b0-86d6-5d78e8dd5869-data\") pod \"postgres-69fb4594cf-6jflc\" (UID: \"9dcd58ec-941b-47b0-86d6-5d78e8dd5869\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:37.764521 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.764499 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9dcd58ec-941b-47b0-86d6-5d78e8dd5869-data\") pod \"postgres-69fb4594cf-6jflc\" (UID: \"9dcd58ec-941b-47b0-86d6-5d78e8dd5869\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:37.775807 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.775775 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq9qp\" (UniqueName: \"kubernetes.io/projected/9dcd58ec-941b-47b0-86d6-5d78e8dd5869-kube-api-access-lq9qp\") pod \"postgres-69fb4594cf-6jflc\" (UID: \"9dcd58ec-941b-47b0-86d6-5d78e8dd5869\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:37.822855 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.822811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:37.967109 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:37.967081 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6jflc"] Jul 13 21:19:37.969135 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:19:37.969103 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dcd58ec_941b_47b0_86d6_5d78e8dd5869.slice/crio-07caa93f5dff841246fd97b25f55952c6187f44e584cedbf6b7f04b4bd68029d WatchSource:0}: Error finding container 07caa93f5dff841246fd97b25f55952c6187f44e584cedbf6b7f04b4bd68029d: Status 404 returned error can't find the container with id 07caa93f5dff841246fd97b25f55952c6187f44e584cedbf6b7f04b4bd68029d Jul 13 21:19:38.412848 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:38.412808 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" event={"ID":"9dcd58ec-941b-47b0-86d6-5d78e8dd5869","Type":"ContainerStarted","Data":"07caa93f5dff841246fd97b25f55952c6187f44e584cedbf6b7f04b4bd68029d"} Jul 13 21:19:43.445246 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:43.445202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" event={"ID":"9dcd58ec-941b-47b0-86d6-5d78e8dd5869","Type":"ContainerStarted","Data":"b3bd975156888fd6b2e4a201a54853c96c9a62effecbed2a0bd25eca7020223c"} Jul 13 21:19:43.445783 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:43.445296 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:43.461746 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:43.461689 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" podStartSLOduration=1.57888522 podStartE2EDuration="6.461673255s" totalImagesPullingTime="4.882788035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:19:43.460989423 +0000 UTC m=+517.218208890" watchObservedRunningTime="2026-07-13 21:19:43.461673255 +0000 UTC m=+517.218892721" Jul 13 21:19:49.480409 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:49.480376 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6jflc" Jul 13 21:19:56.999769 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:56.999727 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fb4f6589f-5prl9"] Jul 13 21:19:57.204935 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.204897 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fb4f6589f-5prl9"] Jul 13 21:19:57.205117 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.205018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:19:57.208996 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.208874 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 21:19:57.208996 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.208901 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 21:19:57.208996 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.208942 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vmxct\"" Jul 13 21:19:57.232646 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.232613 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd18dff8-28dd-454f-ac40-1ff348e4dc62-webhook-cert\") pod \"maas-controller-fb4f6589f-5prl9\" (UID: \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\") " pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:19:57.232646 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.232651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxg2\" (UniqueName: \"kubernetes.io/projected/cd18dff8-28dd-454f-ac40-1ff348e4dc62-kube-api-access-rxxg2\") pod \"maas-controller-fb4f6589f-5prl9\" (UID: \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\") " pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:19:57.333953 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.333864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd18dff8-28dd-454f-ac40-1ff348e4dc62-webhook-cert\") pod \"maas-controller-fb4f6589f-5prl9\" (UID: \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\") " pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:19:57.333953 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.333904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxg2\" (UniqueName: \"kubernetes.io/projected/cd18dff8-28dd-454f-ac40-1ff348e4dc62-kube-api-access-rxxg2\") pod \"maas-controller-fb4f6589f-5prl9\" (UID: \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\") " pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:19:57.336639 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.336609 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd18dff8-28dd-454f-ac40-1ff348e4dc62-webhook-cert\") pod \"maas-controller-fb4f6589f-5prl9\" (UID: \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\") " pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:19:57.342726 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.342693 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxg2\" (UniqueName: \"kubernetes.io/projected/cd18dff8-28dd-454f-ac40-1ff348e4dc62-kube-api-access-rxxg2\") pod \"maas-controller-fb4f6589f-5prl9\" (UID: \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\") " pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:19:57.516096 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.516053 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:19:57.678241 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:57.678055 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fb4f6589f-5prl9"] Jul 13 21:19:57.681180 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:19:57.681143 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd18dff8_28dd_454f_ac40_1ff348e4dc62.slice/crio-66743d0949c4852660a9c23793feb8007967c27f3c7be9cf80fb48f355213532 WatchSource:0}: Error finding container 66743d0949c4852660a9c23793feb8007967c27f3c7be9cf80fb48f355213532: Status 404 returned error can't find the container with id 66743d0949c4852660a9c23793feb8007967c27f3c7be9cf80fb48f355213532 Jul 13 21:19:58.523571 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:19:58.523479 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb4f6589f-5prl9" event={"ID":"cd18dff8-28dd-454f-ac40-1ff348e4dc62","Type":"ContainerStarted","Data":"66743d0949c4852660a9c23793feb8007967c27f3c7be9cf80fb48f355213532"} Jul 13 21:20:00.535212 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:00.535173 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb4f6589f-5prl9" event={"ID":"cd18dff8-28dd-454f-ac40-1ff348e4dc62","Type":"ContainerStarted","Data":"87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593"} Jul 13 21:20:00.535634 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:00.535261 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:20:00.552707 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:00.552650 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fb4f6589f-5prl9" podStartSLOduration=2.602796315 podStartE2EDuration="4.552634881s" totalImagesPullingTime="1.949838566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:20:00.551289622 +0000 UTC m=+534.308509112" watchObservedRunningTime="2026-07-13 21:20:00.552634881 +0000 UTC m=+534.309854348" Jul 13 21:20:11.213857 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.213817 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fb4f6589f-5prl9"] Jul 13 21:20:11.214273 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.214040 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-fb4f6589f-5prl9" podUID="cd18dff8-28dd-454f-ac40-1ff348e4dc62" containerName="manager" containerID="cri-o://87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593" gracePeriod=30 Jul 13 21:20:11.216070 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.216041 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:20:11.469035 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.468949 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:20:11.552882 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.552843 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxxg2\" (UniqueName: \"kubernetes.io/projected/cd18dff8-28dd-454f-ac40-1ff348e4dc62-kube-api-access-rxxg2\") pod \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\" (UID: \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\") " Jul 13 21:20:11.552882 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.552890 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd18dff8-28dd-454f-ac40-1ff348e4dc62-webhook-cert\") pod \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\" (UID: \"cd18dff8-28dd-454f-ac40-1ff348e4dc62\") " Jul 13 21:20:11.555206 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.555170 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd18dff8-28dd-454f-ac40-1ff348e4dc62-kube-api-access-rxxg2" (OuterVolumeSpecName: "kube-api-access-rxxg2") pod "cd18dff8-28dd-454f-ac40-1ff348e4dc62" (UID: "cd18dff8-28dd-454f-ac40-1ff348e4dc62"). InnerVolumeSpecName "kube-api-access-rxxg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:20:11.555315 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.555181 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd18dff8-28dd-454f-ac40-1ff348e4dc62-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cd18dff8-28dd-454f-ac40-1ff348e4dc62" (UID: "cd18dff8-28dd-454f-ac40-1ff348e4dc62"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:20:11.593324 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.593288 2572 generic.go:356] "Generic (PLEG): container finished" podID="cd18dff8-28dd-454f-ac40-1ff348e4dc62" containerID="87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593" exitCode=0 Jul 13 21:20:11.593512 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.593338 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb4f6589f-5prl9" event={"ID":"cd18dff8-28dd-454f-ac40-1ff348e4dc62","Type":"ContainerDied","Data":"87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593"} Jul 13 21:20:11.593512 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.593379 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fb4f6589f-5prl9" event={"ID":"cd18dff8-28dd-454f-ac40-1ff348e4dc62","Type":"ContainerDied","Data":"66743d0949c4852660a9c23793feb8007967c27f3c7be9cf80fb48f355213532"} Jul 13 21:20:11.593512 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.593400 2572 scope.go:117] "RemoveContainer" containerID="87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593" Jul 13 21:20:11.593512 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.593340 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fb4f6589f-5prl9" Jul 13 21:20:11.603151 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.603125 2572 scope.go:117] "RemoveContainer" containerID="87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593" Jul 13 21:20:11.603509 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:20:11.603488 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593\": container with ID starting with 87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593 not found: ID does not exist" containerID="87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593" Jul 13 21:20:11.603568 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.603521 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593"} err="failed to get container status \"87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593\": rpc error: code = NotFound desc = could not find container \"87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593\": container with ID starting with 87935dc75e3853d9885f1f171b2a661dedbdb4ae60f20d0e6d7c1de250bc0593 not found: ID does not exist" Jul 13 21:20:11.616415 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.616378 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fb4f6589f-5prl9"] Jul 13 21:20:11.623253 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.620209 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fb4f6589f-5prl9"] Jul 13 21:20:11.653580 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.653534 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxxg2\" (UniqueName: \"kubernetes.io/projected/cd18dff8-28dd-454f-ac40-1ff348e4dc62-kube-api-access-rxxg2\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:20:11.653580 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:11.653574 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd18dff8-28dd-454f-ac40-1ff348e4dc62-webhook-cert\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:20:12.806076 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:12.806040 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd18dff8-28dd-454f-ac40-1ff348e4dc62" path="/var/lib/kubelet/pods/cd18dff8-28dd-454f-ac40-1ff348e4dc62/volumes" Jul 13 21:20:32.462408 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.462366 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75f678d9f-wd99f"] Jul 13 21:20:32.462887 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.462689 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd18dff8-28dd-454f-ac40-1ff348e4dc62" containerName="manager" Jul 13 21:20:32.462887 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.462701 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd18dff8-28dd-454f-ac40-1ff348e4dc62" containerName="manager" Jul 13 21:20:32.462887 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.462770 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd18dff8-28dd-454f-ac40-1ff348e4dc62" containerName="manager" Jul 13 21:20:32.465895 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.465874 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.468314 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.468291 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 13 21:20:32.468450 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.468371 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qqnjv\"" Jul 13 21:20:32.474990 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.474961 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75f678d9f-wd99f"] Jul 13 21:20:32.636031 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.635972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzgt\" (UniqueName: \"kubernetes.io/projected/218a1534-7ae4-424d-a4a2-7a0598de659d-kube-api-access-hbzgt\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.636202 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.636052 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/218a1534-7ae4-424d-a4a2-7a0598de659d-maas-api-tls\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.636202 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.636075 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/218a1534-7ae4-424d-a4a2-7a0598de659d-openshift-service-ca\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.737101 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.737066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/218a1534-7ae4-424d-a4a2-7a0598de659d-maas-api-tls\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.737308 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.737111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/218a1534-7ae4-424d-a4a2-7a0598de659d-openshift-service-ca\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.737308 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.737174 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzgt\" (UniqueName: \"kubernetes.io/projected/218a1534-7ae4-424d-a4a2-7a0598de659d-kube-api-access-hbzgt\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.737819 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.737798 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/218a1534-7ae4-424d-a4a2-7a0598de659d-openshift-service-ca\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.739657 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.739632 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/218a1534-7ae4-424d-a4a2-7a0598de659d-maas-api-tls\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.745393 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.745362 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzgt\" (UniqueName: \"kubernetes.io/projected/218a1534-7ae4-424d-a4a2-7a0598de659d-kube-api-access-hbzgt\") pod \"maas-api-75f678d9f-wd99f\" (UID: \"218a1534-7ae4-424d-a4a2-7a0598de659d\") " pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.776862 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.776821 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:32.933691 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.933604 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75f678d9f-wd99f"] Jul 13 21:20:32.936105 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:20:32.936069 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218a1534_7ae4_424d_a4a2_7a0598de659d.slice/crio-a09d9743cf4dee67c6f2b1e4553cc7bb8df450f5ee36ba09d7259cc9bad02a93 WatchSource:0}: Error finding container a09d9743cf4dee67c6f2b1e4553cc7bb8df450f5ee36ba09d7259cc9bad02a93: Status 404 returned error can't find the container with id a09d9743cf4dee67c6f2b1e4553cc7bb8df450f5ee36ba09d7259cc9bad02a93 Jul 13 21:20:32.982799 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.982752 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k5ftx"] Jul 13 21:20:32.987396 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.987306 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:32.990075 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.990046 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hq54l\"" Jul 13 21:20:32.990075 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.990050 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 13 21:20:32.997355 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:32.997320 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k5ftx"] Jul 13 21:20:33.141181 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.141136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtlgs\" (UniqueName: \"kubernetes.io/projected/2ea566d8-69c0-4933-a812-9030b0d7b055-kube-api-access-jtlgs\") pod \"payload-processing-f9b8d9b9b-k5ftx\" (UID: \"2ea566d8-69c0-4933-a812-9030b0d7b055\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:33.141359 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.141220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ea566d8-69c0-4933-a812-9030b0d7b055-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k5ftx\" (UID: \"2ea566d8-69c0-4933-a812-9030b0d7b055\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:33.241750 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.241665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ea566d8-69c0-4933-a812-9030b0d7b055-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k5ftx\" (UID: \"2ea566d8-69c0-4933-a812-9030b0d7b055\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:33.241750 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.241718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtlgs\" (UniqueName: \"kubernetes.io/projected/2ea566d8-69c0-4933-a812-9030b0d7b055-kube-api-access-jtlgs\") pod \"payload-processing-f9b8d9b9b-k5ftx\" (UID: \"2ea566d8-69c0-4933-a812-9030b0d7b055\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:33.242472 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.242444 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ea566d8-69c0-4933-a812-9030b0d7b055-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k5ftx\" (UID: \"2ea566d8-69c0-4933-a812-9030b0d7b055\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:33.249896 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.249865 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtlgs\" (UniqueName: \"kubernetes.io/projected/2ea566d8-69c0-4933-a812-9030b0d7b055-kube-api-access-jtlgs\") pod \"payload-processing-f9b8d9b9b-k5ftx\" (UID: \"2ea566d8-69c0-4933-a812-9030b0d7b055\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:33.299819 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.299783 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:33.438416 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.438385 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k5ftx"] Jul 13 21:20:33.440716 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:20:33.440686 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea566d8_69c0_4933_a812_9030b0d7b055.slice/crio-7671aa7e3889d013518c5fb7bac440b54db5445e01635bb2e563d29daae9dd63 WatchSource:0}: Error finding container 7671aa7e3889d013518c5fb7bac440b54db5445e01635bb2e563d29daae9dd63: Status 404 returned error can't find the container with id 7671aa7e3889d013518c5fb7bac440b54db5445e01635bb2e563d29daae9dd63 Jul 13 21:20:33.704201 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.704103 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" event={"ID":"2ea566d8-69c0-4933-a812-9030b0d7b055","Type":"ContainerStarted","Data":"7671aa7e3889d013518c5fb7bac440b54db5445e01635bb2e563d29daae9dd63"} Jul 13 21:20:33.705355 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:33.705328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" event={"ID":"218a1534-7ae4-424d-a4a2-7a0598de659d","Type":"ContainerStarted","Data":"a09d9743cf4dee67c6f2b1e4553cc7bb8df450f5ee36ba09d7259cc9bad02a93"} Jul 13 21:20:35.717450 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:35.717358 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" event={"ID":"2ea566d8-69c0-4933-a812-9030b0d7b055","Type":"ContainerStarted","Data":"c3551628b3ed2d9ca3ec60da4912cb730fb6561e49cb517c3ed000b4ab1d087f"} Jul 13 21:20:35.717884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:35.717467 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:20:35.719076 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:35.719047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" event={"ID":"218a1534-7ae4-424d-a4a2-7a0598de659d","Type":"ContainerStarted","Data":"6e97c837306204eb18da31c0ddd8e32b9242a7cb4f858f67bb1c1e9a67108ea8"} Jul 13 21:20:35.719196 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:35.719102 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:35.734097 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:35.734049 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" podStartSLOduration=2.469475568 podStartE2EDuration="3.733991279s" totalImagesPullingTime="1.264515711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:20:35.733149457 +0000 UTC m=+569.490368929" watchObservedRunningTime="2026-07-13 21:20:35.733991279 +0000 UTC m=+569.491210746" Jul 13 21:20:35.751431 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:35.751364 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" podStartSLOduration=1.357212477 podStartE2EDuration="3.751341305s" totalImagesPullingTime="2.394128828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:20:35.749285186 +0000 UTC m=+569.506504656" watchObservedRunningTime="2026-07-13 21:20:35.751341305 +0000 UTC m=+569.508560771" Jul 13 21:20:41.729829 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:41.729794 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75f678d9f-wd99f" Jul 13 21:20:46.726545 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:20:46.726511 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5ftx" Jul 13 21:21:06.689593 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:06.689562 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:21:06.690521 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:06.690499 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:21:06.700592 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:06.700570 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:21:06.701389 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:06.701366 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:21:09.747839 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.747798 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8"] Jul 13 21:21:09.750637 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.750609 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.754272 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.754246 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 13 21:21:09.754424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.754245 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 21:21:09.754424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.754247 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 21:21:09.754525 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.754259 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sm8dp\"" Jul 13 21:21:09.759630 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.759608 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8"] Jul 13 21:21:09.852313 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.852275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.852494 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.852395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6qx9\" (UniqueName: \"kubernetes.io/projected/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-kube-api-access-p6qx9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.852494 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.852443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.852494 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.852469 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.852643 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.852491 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.852643 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.852517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953201 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qx9\" (UniqueName: \"kubernetes.io/projected/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-kube-api-access-p6qx9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953201 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953201 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953459 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953220 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953459 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953237 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953459 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953459 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953657 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953627 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953775 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953637 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.953775 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.953691 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.955677 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.955648 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.955859 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.955842 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:09.961555 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:09.961524 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6qx9\" (UniqueName: \"kubernetes.io/projected/e7e68dfe-1948-47e0-8fd9-d3aedf9753ea-kube-api-access-p6qx9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wjd8\" (UID: \"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:10.063149 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:10.063049 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:10.202921 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:10.202887 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8"] Jul 13 21:21:10.204683 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:21:10.204655 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e68dfe_1948_47e0_8fd9_d3aedf9753ea.slice/crio-d2283e4c0112932ae56a038282a37f635888577d09aab82fcc62d305ceab09be WatchSource:0}: Error finding container d2283e4c0112932ae56a038282a37f635888577d09aab82fcc62d305ceab09be: Status 404 returned error can't find the container with id d2283e4c0112932ae56a038282a37f635888577d09aab82fcc62d305ceab09be Jul 13 21:21:10.895128 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:10.895088 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" event={"ID":"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea","Type":"ContainerStarted","Data":"d2283e4c0112932ae56a038282a37f635888577d09aab82fcc62d305ceab09be"} Jul 13 21:21:11.901256 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:11.901217 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" event={"ID":"e7e68dfe-1948-47e0-8fd9-d3aedf9753ea","Type":"ContainerStarted","Data":"c36b23a380493f6768d26e392a5fe94bcfe236fa1e70b3eff881d8e207c96703"} Jul 13 21:21:11.919432 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:11.919371 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" podStartSLOduration=1.916589442 podStartE2EDuration="2.919353826s" totalImagesPullingTime="1.002764384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:11.917622495 +0000 UTC m=+605.674841964" watchObservedRunningTime="2026-07-13 21:21:11.919353826 +0000 UTC m=+605.676573293" Jul 13 21:21:20.063577 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:20.063534 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:20.063968 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:20.063631 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:20.076341 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:20.076309 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:20.958316 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:20.958286 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wjd8" Jul 13 21:21:29.648133 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.648049 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d"] Jul 13 21:21:29.650534 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.650514 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.653139 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.653110 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 13 21:21:29.663304 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.663274 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d"] Jul 13 21:21:29.722842 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.722798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.722842 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.722840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.723139 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.722871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-685m9\" (UniqueName: \"kubernetes.io/projected/8912154b-85cf-4133-bd4d-43217e13e32e-kube-api-access-685m9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.723139 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.722979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8912154b-85cf-4133-bd4d-43217e13e32e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.723139 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.723084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.723139 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.723115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824145 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8912154b-85cf-4133-bd4d-43217e13e32e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824145 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824360 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824360 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824360 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824360 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-685m9\" (UniqueName: \"kubernetes.io/projected/8912154b-85cf-4133-bd4d-43217e13e32e-kube-api-access-685m9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824610 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824588 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824689 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824665 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.824795 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.824778 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.826448 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.826429 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8912154b-85cf-4133-bd4d-43217e13e32e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.826820 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.826796 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8912154b-85cf-4133-bd4d-43217e13e32e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.831888 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.831863 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-685m9\" (UniqueName: \"kubernetes.io/projected/8912154b-85cf-4133-bd4d-43217e13e32e-kube-api-access-685m9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d\" (UID: \"8912154b-85cf-4133-bd4d-43217e13e32e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:29.961327 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:29.961229 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:30.104931 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:30.104898 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d"] Jul 13 21:21:30.106456 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:21:30.106430 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8912154b_85cf_4133_bd4d_43217e13e32e.slice/crio-a3dd8c4b8199fd05cae8fb8e20d73ddc98fa59b5ff9a3e378124de13e173b20f WatchSource:0}: Error finding container a3dd8c4b8199fd05cae8fb8e20d73ddc98fa59b5ff9a3e378124de13e173b20f: Status 404 returned error can't find the container with id a3dd8c4b8199fd05cae8fb8e20d73ddc98fa59b5ff9a3e378124de13e173b20f Jul 13 21:21:30.108037 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:30.108016 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:21:31.005219 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:31.005179 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" event={"ID":"8912154b-85cf-4133-bd4d-43217e13e32e","Type":"ContainerStarted","Data":"54d6147263ac0727970531fbca9abbd2a721328e4695f9d1a01ca3e0435cbce7"} Jul 13 21:21:31.005598 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:31.005238 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" event={"ID":"8912154b-85cf-4133-bd4d-43217e13e32e","Type":"ContainerStarted","Data":"a3dd8c4b8199fd05cae8fb8e20d73ddc98fa59b5ff9a3e378124de13e173b20f"} Jul 13 21:21:31.022388 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:31.022326 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" podStartSLOduration=1.838975167 podStartE2EDuration="2.022304537s" totalImagesPullingTime="183.32937ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:31.021664794 +0000 UTC m=+624.778884262" watchObservedRunningTime="2026-07-13 21:21:31.022304537 +0000 UTC m=+624.779524013" Jul 13 21:21:39.961783 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:39.961730 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:39.962512 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:39.961813 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:39.974643 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:39.974615 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:21:40.065556 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:21:40.065526 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d" Jul 13 21:26:06.727568 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:26:06.727537 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:26:06.731319 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:26:06.731292 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:26:06.735695 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:26:06.735672 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:26:06.738724 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:26:06.738701 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:31:06.762432 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:31:06.762403 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:31:06.768031 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:31:06.767970 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:31:06.770653 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:31:06.770628 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:31:06.776158 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:31:06.776131 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:36:06.799234 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:06.799207 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:36:06.809100 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:06.809075 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:36:06.809249 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:06.809077 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:36:06.817170 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:06.817146 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:36:51.730542 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.730507 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc"] Jul 13 21:36:51.734039 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.733991 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:51.736784 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.736764 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-19275bdc-serving-cert\"" Jul 13 21:36:51.747211 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.747176 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc"] Jul 13 21:36:51.832867 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.832825 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:51.833072 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.832885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-openshift-service-ca\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:51.833072 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.832951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4zm\" (UniqueName: \"kubernetes.io/projected/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-kube-api-access-dn4zm\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:51.933603 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.933560 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:51.933806 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:36:51.933711 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-serving-cert: secret "maas-api-e2e-ait-19275bdc-serving-cert" not found Jul 13 21:36:51.933806 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.933766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-openshift-service-ca\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:51.933806 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:36:51.933797 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls podName:ca2c8bb3-1de0-41f2-9bcd-87395fa07220 nodeName:}" failed. No retries permitted until 2026-07-13 21:36:52.433774065 +0000 UTC m=+1546.190993529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls") pod "maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" (UID: "ca2c8bb3-1de0-41f2-9bcd-87395fa07220") : secret "maas-api-e2e-ait-19275bdc-serving-cert" not found Jul 13 21:36:51.933988 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.933857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4zm\" (UniqueName: \"kubernetes.io/projected/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-kube-api-access-dn4zm\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:51.934451 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.934427 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-openshift-service-ca\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:51.945118 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:51.945081 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4zm\" (UniqueName: \"kubernetes.io/projected/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-kube-api-access-dn4zm\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:52.438224 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:52.438183 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:52.440733 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:52.440707 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls\") pod \"maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:52.644654 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:52.644612 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:52.792511 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:52.792485 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc"] Jul 13 21:36:52.794578 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:36:52.794548 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2c8bb3_1de0_41f2_9bcd_87395fa07220.slice/crio-c930d74941f7a28d9db148b50edc1058255b360a689497ffa22894694dc1b0b1 WatchSource:0}: Error finding container c930d74941f7a28d9db148b50edc1058255b360a689497ffa22894694dc1b0b1: Status 404 returned error can't find the container with id c930d74941f7a28d9db148b50edc1058255b360a689497ffa22894694dc1b0b1 Jul 13 21:36:52.795949 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:52.795929 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:36:53.768858 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:53.768812 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" event={"ID":"ca2c8bb3-1de0-41f2-9bcd-87395fa07220","Type":"ContainerStarted","Data":"a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa"} Jul 13 21:36:53.769053 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:53.768919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" event={"ID":"ca2c8bb3-1de0-41f2-9bcd-87395fa07220","Type":"ContainerStarted","Data":"c930d74941f7a28d9db148b50edc1058255b360a689497ffa22894694dc1b0b1"} Jul 13 21:36:53.769053 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:53.768943 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:36:53.785305 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:53.785255 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" podStartSLOduration=2.257135801 podStartE2EDuration="2.78523819s" totalImagesPullingTime="528.102389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:36:53.784505685 +0000 UTC m=+1547.541725175" watchObservedRunningTime="2026-07-13 21:36:53.78523819 +0000 UTC m=+1547.542457658" Jul 13 21:36:59.782630 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:36:59.782596 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:37:07.097282 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.097242 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc"] Jul 13 21:37:07.097771 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.097514 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" podUID="ca2c8bb3-1de0-41f2-9bcd-87395fa07220" containerName="maas-api" containerID="cri-o://a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa" gracePeriod=30 Jul 13 21:37:07.354471 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.354391 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:37:07.479344 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.479298 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-openshift-service-ca\") pod \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " Jul 13 21:37:07.479344 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.479346 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls\") pod \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " Jul 13 21:37:07.479816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.479387 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn4zm\" (UniqueName: \"kubernetes.io/projected/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-kube-api-access-dn4zm\") pod \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\" (UID: \"ca2c8bb3-1de0-41f2-9bcd-87395fa07220\") " Jul 13 21:37:07.479816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.479771 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca2c8bb3-1de0-41f2-9bcd-87395fa07220" (UID: "ca2c8bb3-1de0-41f2-9bcd-87395fa07220"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:37:07.481711 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.481686 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-kube-api-access-dn4zm" (OuterVolumeSpecName: "kube-api-access-dn4zm") pod "ca2c8bb3-1de0-41f2-9bcd-87395fa07220" (UID: "ca2c8bb3-1de0-41f2-9bcd-87395fa07220"). InnerVolumeSpecName "kube-api-access-dn4zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:37:07.481711 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.481684 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca2c8bb3-1de0-41f2-9bcd-87395fa07220" (UID: "ca2c8bb3-1de0-41f2-9bcd-87395fa07220"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:37:07.580523 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.580483 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:37:07.580523 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.580517 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:37:07.580523 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.580526 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn4zm\" (UniqueName: \"kubernetes.io/projected/ca2c8bb3-1de0-41f2-9bcd-87395fa07220-kube-api-access-dn4zm\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:37:07.843561 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.843523 2572 generic.go:356] "Generic (PLEG): container finished" podID="ca2c8bb3-1de0-41f2-9bcd-87395fa07220" containerID="a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa" exitCode=0 Jul 13 21:37:07.843561 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.843564 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" Jul 13 21:37:07.843833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.843598 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" event={"ID":"ca2c8bb3-1de0-41f2-9bcd-87395fa07220","Type":"ContainerDied","Data":"a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa"} Jul 13 21:37:07.843833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.843649 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc" event={"ID":"ca2c8bb3-1de0-41f2-9bcd-87395fa07220","Type":"ContainerDied","Data":"c930d74941f7a28d9db148b50edc1058255b360a689497ffa22894694dc1b0b1"} Jul 13 21:37:07.843833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.843677 2572 scope.go:117] "RemoveContainer" containerID="a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa" Jul 13 21:37:07.853873 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.853853 2572 scope.go:117] "RemoveContainer" containerID="a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa" Jul 13 21:37:07.854208 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:37:07.854184 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa\": container with ID starting with a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa not found: ID does not exist" containerID="a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa" Jul 13 21:37:07.854276 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.854219 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa"} err="failed to get container status \"a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa\": rpc error: code = NotFound desc = could not find container \"a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa\": container with ID starting with a67af8efd44ac07166eb621badd7475808a53c5c928d8ffda45ef7b8b6990afa not found: ID does not exist" Jul 13 21:37:07.867298 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.867258 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc"] Jul 13 21:37:07.870233 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:07.870205 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19275bdc-6d58d98c7f-fldwc"] Jul 13 21:37:08.805443 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:08.805408 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca2c8bb3-1de0-41f2-9bcd-87395fa07220" path="/var/lib/kubelet/pods/ca2c8bb3-1de0-41f2-9bcd-87395fa07220/volumes" Jul 13 21:37:23.984469 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:23.984429 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw"] Jul 13 21:37:23.984962 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:23.984945 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2c8bb3-1de0-41f2-9bcd-87395fa07220" containerName="maas-api" Jul 13 21:37:23.985036 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:23.984966 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2c8bb3-1de0-41f2-9bcd-87395fa07220" containerName="maas-api" Jul 13 21:37:23.985112 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:23.985100 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2c8bb3-1de0-41f2-9bcd-87395fa07220" containerName="maas-api" Jul 13 21:37:23.989737 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:23.989714 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:23.992422 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:23.992392 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-737411d0-serving-cert\"" Jul 13 21:37:23.994122 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:23.994092 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw"] Jul 13 21:37:24.025856 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.025806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppkqn\" (UniqueName: \"kubernetes.io/projected/79a98713-ea33-4e64-a743-2bdd359e04e8-kube-api-access-ppkqn\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.025856 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.025857 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.026114 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.025955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a98713-ea33-4e64-a743-2bdd359e04e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.126559 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.126518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppkqn\" (UniqueName: \"kubernetes.io/projected/79a98713-ea33-4e64-a743-2bdd359e04e8-kube-api-access-ppkqn\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.126559 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.126568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.126826 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.126616 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a98713-ea33-4e64-a743-2bdd359e04e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.126826 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:37:24.126753 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-serving-cert: secret "maas-api-e2e-migrate-737411d0-serving-cert" not found Jul 13 21:37:24.126939 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:37:24.126832 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls podName:79a98713-ea33-4e64-a743-2bdd359e04e8 nodeName:}" failed. No retries permitted until 2026-07-13 21:37:24.626809615 +0000 UTC m=+1578.384029076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls") pod "maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" (UID: "79a98713-ea33-4e64-a743-2bdd359e04e8") : secret "maas-api-e2e-migrate-737411d0-serving-cert" not found Jul 13 21:37:24.127242 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.127221 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a98713-ea33-4e64-a743-2bdd359e04e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.134797 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.134768 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppkqn\" (UniqueName: \"kubernetes.io/projected/79a98713-ea33-4e64-a743-2bdd359e04e8-kube-api-access-ppkqn\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.630019 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.629967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.632419 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.632393 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls\") pod \"maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:24.903275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:24.903163 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:25.051229 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:25.051199 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw"] Jul 13 21:37:25.053377 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:37:25.053348 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a98713_ea33_4e64_a743_2bdd359e04e8.slice/crio-ca66733dbc57b79395f3f767aedb6c0c03692d92086bdec8ecb1e694d08fefc7 WatchSource:0}: Error finding container ca66733dbc57b79395f3f767aedb6c0c03692d92086bdec8ecb1e694d08fefc7: Status 404 returned error can't find the container with id ca66733dbc57b79395f3f767aedb6c0c03692d92086bdec8ecb1e694d08fefc7 Jul 13 21:37:25.945757 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:25.945723 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" event={"ID":"79a98713-ea33-4e64-a743-2bdd359e04e8","Type":"ContainerStarted","Data":"0f64ba2deac63edaf24d3311901f9e729f7c1485c012e14f04152b680d51c010"} Jul 13 21:37:25.945957 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:25.945799 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" event={"ID":"79a98713-ea33-4e64-a743-2bdd359e04e8","Type":"ContainerStarted","Data":"ca66733dbc57b79395f3f767aedb6c0c03692d92086bdec8ecb1e694d08fefc7"} Jul 13 21:37:25.945957 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:25.945892 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:25.966039 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:25.965963 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" podStartSLOduration=2.5782155639999997 podStartE2EDuration="2.965944977s" totalImagesPullingTime="387.729413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:37:25.963426829 +0000 UTC m=+1579.720646296" watchObservedRunningTime="2026-07-13 21:37:25.965944977 +0000 UTC m=+1579.723164526" Jul 13 21:37:28.347019 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.346965 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc"] Jul 13 21:37:28.350489 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.350469 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" Jul 13 21:37:28.353077 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.353056 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fhllj\"" Jul 13 21:37:28.357315 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.357285 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc"] Jul 13 21:37:28.357833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.357807 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d70986-4991-443a-8ce4-9e23d1c11349-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc\" (UID: \"98d70986-4991-443a-8ce4-9e23d1c11349\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" Jul 13 21:37:28.458600 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.458568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d70986-4991-443a-8ce4-9e23d1c11349-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc\" (UID: \"98d70986-4991-443a-8ce4-9e23d1c11349\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" Jul 13 21:37:28.459296 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.459267 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d70986-4991-443a-8ce4-9e23d1c11349-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc\" (UID: \"98d70986-4991-443a-8ce4-9e23d1c11349\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" Jul 13 21:37:28.663951 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.663841 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" Jul 13 21:37:28.811638 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.811613 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc"] Jul 13 21:37:28.813765 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:37:28.813734 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d70986_4991_443a_8ce4_9e23d1c11349.slice/crio-3cf03e9598f2edda2380c36607ef7563d3de405cae4e6ba9581cd699c8f4aee8 WatchSource:0}: Error finding container 3cf03e9598f2edda2380c36607ef7563d3de405cae4e6ba9581cd699c8f4aee8: Status 404 returned error can't find the container with id 3cf03e9598f2edda2380c36607ef7563d3de405cae4e6ba9581cd699c8f4aee8 Jul 13 21:37:28.962764 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:28.962671 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" event={"ID":"98d70986-4991-443a-8ce4-9e23d1c11349","Type":"ContainerStarted","Data":"3cf03e9598f2edda2380c36607ef7563d3de405cae4e6ba9581cd699c8f4aee8"} Jul 13 21:37:31.958377 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:31.958346 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:31.983019 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:31.982977 2572 generic.go:356] "Generic (PLEG): container finished" podID="98d70986-4991-443a-8ce4-9e23d1c11349" containerID="05acdda52a8c291f46d9a682fba8d4adcd2935ef8c885c036df1af2a825ad014" exitCode=7 Jul 13 21:37:31.983307 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:31.983066 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" event={"ID":"98d70986-4991-443a-8ce4-9e23d1c11349","Type":"ContainerDied","Data":"05acdda52a8c291f46d9a682fba8d4adcd2935ef8c885c036df1af2a825ad014"} Jul 13 21:37:31.983387 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:31.983327 2572 scope.go:117] "RemoveContainer" containerID="05acdda52a8c291f46d9a682fba8d4adcd2935ef8c885c036df1af2a825ad014" Jul 13 21:37:32.991067 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:32.991030 2572 generic.go:356] "Generic (PLEG): container finished" podID="98d70986-4991-443a-8ce4-9e23d1c11349" containerID="cfbcea441f6c7f837131ee6916ccd6ae69c41d637e3c1d655b0d62d32c918e20" exitCode=0 Jul 13 21:37:32.991509 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:32.991067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" event={"ID":"98d70986-4991-443a-8ce4-9e23d1c11349","Type":"ContainerDied","Data":"cfbcea441f6c7f837131ee6916ccd6ae69c41d637e3c1d655b0d62d32c918e20"} Jul 13 21:37:32.991509 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:32.991138 2572 scope.go:117] "RemoveContainer" containerID="05acdda52a8c291f46d9a682fba8d4adcd2935ef8c885c036df1af2a825ad014" Jul 13 21:37:34.138514 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:34.138487 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" Jul 13 21:37:34.208906 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:34.208865 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d70986-4991-443a-8ce4-9e23d1c11349-maas-api-service-ca\") pod \"98d70986-4991-443a-8ce4-9e23d1c11349\" (UID: \"98d70986-4991-443a-8ce4-9e23d1c11349\") " Jul 13 21:37:34.209251 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:34.209230 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d70986-4991-443a-8ce4-9e23d1c11349-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "98d70986-4991-443a-8ce4-9e23d1c11349" (UID: "98d70986-4991-443a-8ce4-9e23d1c11349"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:37:34.310277 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:34.310180 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d70986-4991-443a-8ce4-9e23d1c11349-maas-api-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:37:35.004554 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:35.004523 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" Jul 13 21:37:35.004719 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:35.004565 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc" event={"ID":"98d70986-4991-443a-8ce4-9e23d1c11349","Type":"ContainerDied","Data":"3cf03e9598f2edda2380c36607ef7563d3de405cae4e6ba9581cd699c8f4aee8"} Jul 13 21:37:35.004719 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:35.004612 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cf03e9598f2edda2380c36607ef7563d3de405cae4e6ba9581cd699c8f4aee8" Jul 13 21:37:38.856161 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:38.856123 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw"] Jul 13 21:37:38.856639 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:38.856370 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" podUID="79a98713-ea33-4e64-a743-2bdd359e04e8" containerName="maas-api" containerID="cri-o://0f64ba2deac63edaf24d3311901f9e729f7c1485c012e14f04152b680d51c010" gracePeriod=30 Jul 13 21:37:39.032832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.032805 2572 generic.go:356] "Generic (PLEG): container finished" podID="79a98713-ea33-4e64-a743-2bdd359e04e8" containerID="0f64ba2deac63edaf24d3311901f9e729f7c1485c012e14f04152b680d51c010" exitCode=0 Jul 13 21:37:39.032949 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.032869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" event={"ID":"79a98713-ea33-4e64-a743-2bdd359e04e8","Type":"ContainerDied","Data":"0f64ba2deac63edaf24d3311901f9e729f7c1485c012e14f04152b680d51c010"} Jul 13 21:37:39.113999 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.113918 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:39.153113 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.153075 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a98713-ea33-4e64-a743-2bdd359e04e8-openshift-service-ca\") pod \"79a98713-ea33-4e64-a743-2bdd359e04e8\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " Jul 13 21:37:39.153264 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.153161 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls\") pod \"79a98713-ea33-4e64-a743-2bdd359e04e8\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " Jul 13 21:37:39.153264 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.153216 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppkqn\" (UniqueName: \"kubernetes.io/projected/79a98713-ea33-4e64-a743-2bdd359e04e8-kube-api-access-ppkqn\") pod \"79a98713-ea33-4e64-a743-2bdd359e04e8\" (UID: \"79a98713-ea33-4e64-a743-2bdd359e04e8\") " Jul 13 21:37:39.153581 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.153549 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a98713-ea33-4e64-a743-2bdd359e04e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79a98713-ea33-4e64-a743-2bdd359e04e8" (UID: "79a98713-ea33-4e64-a743-2bdd359e04e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:37:39.155383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.155351 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79a98713-ea33-4e64-a743-2bdd359e04e8" (UID: "79a98713-ea33-4e64-a743-2bdd359e04e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:37:39.155488 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.155443 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a98713-ea33-4e64-a743-2bdd359e04e8-kube-api-access-ppkqn" (OuterVolumeSpecName: "kube-api-access-ppkqn") pod "79a98713-ea33-4e64-a743-2bdd359e04e8" (UID: "79a98713-ea33-4e64-a743-2bdd359e04e8"). InnerVolumeSpecName "kube-api-access-ppkqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:37:39.254360 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.254314 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppkqn\" (UniqueName: \"kubernetes.io/projected/79a98713-ea33-4e64-a743-2bdd359e04e8-kube-api-access-ppkqn\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:37:39.254360 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.254352 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a98713-ea33-4e64-a743-2bdd359e04e8-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:37:39.254360 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:39.254364 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79a98713-ea33-4e64-a743-2bdd359e04e8-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:37:40.039448 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:40.039420 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" Jul 13 21:37:40.039958 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:40.039451 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw" event={"ID":"79a98713-ea33-4e64-a743-2bdd359e04e8","Type":"ContainerDied","Data":"ca66733dbc57b79395f3f767aedb6c0c03692d92086bdec8ecb1e694d08fefc7"} Jul 13 21:37:40.039958 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:40.039512 2572 scope.go:117] "RemoveContainer" containerID="0f64ba2deac63edaf24d3311901f9e729f7c1485c012e14f04152b680d51c010" Jul 13 21:37:40.064038 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:40.063978 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw"] Jul 13 21:37:40.067565 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:40.067535 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-737411d0-6cf4bb7fb8-nzwbw"] Jul 13 21:37:40.806219 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:40.806180 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79a98713-ea33-4e64-a743-2bdd359e04e8" path="/var/lib/kubelet/pods/79a98713-ea33-4e64-a743-2bdd359e04e8/volumes" Jul 13 21:37:55.230376 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230338 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96"] Jul 13 21:37:55.230816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230669 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d70986-4991-443a-8ce4-9e23d1c11349" containerName="revoke-keys" Jul 13 21:37:55.230816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230679 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d70986-4991-443a-8ce4-9e23d1c11349" containerName="revoke-keys" Jul 13 21:37:55.230816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230696 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79a98713-ea33-4e64-a743-2bdd359e04e8" containerName="maas-api" Jul 13 21:37:55.230816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230702 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="79a98713-ea33-4e64-a743-2bdd359e04e8" containerName="maas-api" Jul 13 21:37:55.230816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230715 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d70986-4991-443a-8ce4-9e23d1c11349" containerName="revoke-keys" Jul 13 21:37:55.230816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230721 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d70986-4991-443a-8ce4-9e23d1c11349" containerName="revoke-keys" Jul 13 21:37:55.230816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230779 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d70986-4991-443a-8ce4-9e23d1c11349" containerName="revoke-keys" Jul 13 21:37:55.230816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.230792 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="79a98713-ea33-4e64-a743-2bdd359e04e8" containerName="maas-api" Jul 13 21:37:55.235559 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.235531 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.238130 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.238103 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5278c205-serving-cert\"" Jul 13 21:37:55.245860 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.245834 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96"] Jul 13 21:37:55.300356 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.300310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/235d51a5-473c-4199-a885-39af9f3bce83-maas-api-tls\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.300356 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.300359 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t4kt\" (UniqueName: \"kubernetes.io/projected/235d51a5-473c-4199-a885-39af9f3bce83-kube-api-access-2t4kt\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.300590 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.300460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/235d51a5-473c-4199-a885-39af9f3bce83-openshift-service-ca\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.401275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.401227 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/235d51a5-473c-4199-a885-39af9f3bce83-openshift-service-ca\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.401463 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.401310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/235d51a5-473c-4199-a885-39af9f3bce83-maas-api-tls\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.401463 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.401328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t4kt\" (UniqueName: \"kubernetes.io/projected/235d51a5-473c-4199-a885-39af9f3bce83-kube-api-access-2t4kt\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.401907 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.401877 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/235d51a5-473c-4199-a885-39af9f3bce83-openshift-service-ca\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.403816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.403785 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/235d51a5-473c-4199-a885-39af9f3bce83-maas-api-tls\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.409547 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.409521 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t4kt\" (UniqueName: \"kubernetes.io/projected/235d51a5-473c-4199-a885-39af9f3bce83-kube-api-access-2t4kt\") pod \"maas-api-e2e-ait-5278c205-67c545644b-7gf96\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.549177 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.549145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:55.690439 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:55.690412 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96"] Jul 13 21:37:55.692370 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:37:55.692326 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235d51a5_473c_4199_a885_39af9f3bce83.slice/crio-4d5055a57624ed7fe1de0c2fe5b2b38a8e5b8aaca4aac25c13f5011c7a72d03d WatchSource:0}: Error finding container 4d5055a57624ed7fe1de0c2fe5b2b38a8e5b8aaca4aac25c13f5011c7a72d03d: Status 404 returned error can't find the container with id 4d5055a57624ed7fe1de0c2fe5b2b38a8e5b8aaca4aac25c13f5011c7a72d03d Jul 13 21:37:56.123645 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:56.123593 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" event={"ID":"235d51a5-473c-4199-a885-39af9f3bce83","Type":"ContainerStarted","Data":"4d5055a57624ed7fe1de0c2fe5b2b38a8e5b8aaca4aac25c13f5011c7a72d03d"} Jul 13 21:37:57.130786 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:57.130751 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" event={"ID":"235d51a5-473c-4199-a885-39af9f3bce83","Type":"ContainerStarted","Data":"874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b"} Jul 13 21:37:57.131222 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:57.130888 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:37:57.149601 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:37:57.149547 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" podStartSLOduration=1.757366784 podStartE2EDuration="2.149527971s" totalImagesPullingTime="392.161187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:37:57.1475575 +0000 UTC m=+1610.904776967" watchObservedRunningTime="2026-07-13 21:37:57.149527971 +0000 UTC m=+1610.906747439" Jul 13 21:38:03.141673 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:03.141639 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:38:10.787255 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:10.787215 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96"] Jul 13 21:38:10.787676 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:10.787485 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" podUID="235d51a5-473c-4199-a885-39af9f3bce83" containerName="maas-api" containerID="cri-o://874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b" gracePeriod=30 Jul 13 21:38:11.046080 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.045993 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:38:11.149106 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.149066 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/235d51a5-473c-4199-a885-39af9f3bce83-maas-api-tls\") pod \"235d51a5-473c-4199-a885-39af9f3bce83\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " Jul 13 21:38:11.149301 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.149118 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/235d51a5-473c-4199-a885-39af9f3bce83-openshift-service-ca\") pod \"235d51a5-473c-4199-a885-39af9f3bce83\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " Jul 13 21:38:11.149301 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.149152 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t4kt\" (UniqueName: \"kubernetes.io/projected/235d51a5-473c-4199-a885-39af9f3bce83-kube-api-access-2t4kt\") pod \"235d51a5-473c-4199-a885-39af9f3bce83\" (UID: \"235d51a5-473c-4199-a885-39af9f3bce83\") " Jul 13 21:38:11.149540 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.149512 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/235d51a5-473c-4199-a885-39af9f3bce83-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "235d51a5-473c-4199-a885-39af9f3bce83" (UID: "235d51a5-473c-4199-a885-39af9f3bce83"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:38:11.151274 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.151237 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/235d51a5-473c-4199-a885-39af9f3bce83-kube-api-access-2t4kt" (OuterVolumeSpecName: "kube-api-access-2t4kt") pod "235d51a5-473c-4199-a885-39af9f3bce83" (UID: "235d51a5-473c-4199-a885-39af9f3bce83"). InnerVolumeSpecName "kube-api-access-2t4kt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:38:11.151370 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.151280 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/235d51a5-473c-4199-a885-39af9f3bce83-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "235d51a5-473c-4199-a885-39af9f3bce83" (UID: "235d51a5-473c-4199-a885-39af9f3bce83"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:38:11.207275 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.207239 2572 generic.go:356] "Generic (PLEG): container finished" podID="235d51a5-473c-4199-a885-39af9f3bce83" containerID="874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b" exitCode=0 Jul 13 21:38:11.207478 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.207292 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" Jul 13 21:38:11.207478 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.207328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" event={"ID":"235d51a5-473c-4199-a885-39af9f3bce83","Type":"ContainerDied","Data":"874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b"} Jul 13 21:38:11.207478 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.207390 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96" event={"ID":"235d51a5-473c-4199-a885-39af9f3bce83","Type":"ContainerDied","Data":"4d5055a57624ed7fe1de0c2fe5b2b38a8e5b8aaca4aac25c13f5011c7a72d03d"} Jul 13 21:38:11.207478 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.207416 2572 scope.go:117] "RemoveContainer" containerID="874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b" Jul 13 21:38:11.216792 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.216773 2572 scope.go:117] "RemoveContainer" containerID="874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b" Jul 13 21:38:11.217117 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:38:11.217099 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b\": container with ID starting with 874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b not found: ID does not exist" containerID="874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b" Jul 13 21:38:11.217195 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.217130 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b"} err="failed to get container status \"874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b\": rpc error: code = NotFound desc = could not find container \"874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b\": container with ID starting with 874c41cc09af3ff04495c3f83dbcb2cbb2f746be7eb68969ead2412cf85c376b not found: ID does not exist" Jul 13 21:38:11.229555 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.229517 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96"] Jul 13 21:38:11.235967 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.235935 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5278c205-67c545644b-7gf96"] Jul 13 21:38:11.249838 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.249813 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/235d51a5-473c-4199-a885-39af9f3bce83-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:38:11.249838 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.249836 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/235d51a5-473c-4199-a885-39af9f3bce83-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:38:11.249979 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:11.249846 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t4kt\" (UniqueName: \"kubernetes.io/projected/235d51a5-473c-4199-a885-39af9f3bce83-kube-api-access-2t4kt\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:38:12.806117 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:12.806084 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="235d51a5-473c-4199-a885-39af9f3bce83" path="/var/lib/kubelet/pods/235d51a5-473c-4199-a885-39af9f3bce83/volumes" Jul 13 21:38:27.980835 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:27.980791 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4"] Jul 13 21:38:27.981365 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:27.981349 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="235d51a5-473c-4199-a885-39af9f3bce83" containerName="maas-api" Jul 13 21:38:27.981411 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:27.981369 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="235d51a5-473c-4199-a885-39af9f3bce83" containerName="maas-api" Jul 13 21:38:27.981467 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:27.981456 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d70986-4991-443a-8ce4-9e23d1c11349" containerName="revoke-keys" Jul 13 21:38:27.981501 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:27.981470 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="235d51a5-473c-4199-a885-39af9f3bce83" containerName="maas-api" Jul 13 21:38:27.986437 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:27.986413 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:27.991237 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:27.991205 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f9b92c93-serving-cert\"" Jul 13 21:38:27.994820 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:27.994793 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4"] Jul 13 21:38:28.084291 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.084247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6510ccb-88dc-4afc-82c4-de4672a21397-maas-api-tls\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.084291 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.084296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7b55\" (UniqueName: \"kubernetes.io/projected/e6510ccb-88dc-4afc-82c4-de4672a21397-kube-api-access-v7b55\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.084519 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.084337 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6510ccb-88dc-4afc-82c4-de4672a21397-openshift-service-ca\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.185316 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.185274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6510ccb-88dc-4afc-82c4-de4672a21397-maas-api-tls\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.185316 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.185318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7b55\" (UniqueName: \"kubernetes.io/projected/e6510ccb-88dc-4afc-82c4-de4672a21397-kube-api-access-v7b55\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.185531 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.185354 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6510ccb-88dc-4afc-82c4-de4672a21397-openshift-service-ca\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.186073 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.186055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6510ccb-88dc-4afc-82c4-de4672a21397-openshift-service-ca\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.187857 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.187831 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6510ccb-88dc-4afc-82c4-de4672a21397-maas-api-tls\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.197634 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.197608 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7b55\" (UniqueName: \"kubernetes.io/projected/e6510ccb-88dc-4afc-82c4-de4672a21397-kube-api-access-v7b55\") pod \"maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.298173 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.298137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:28.438327 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:28.438291 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4"] Jul 13 21:38:28.439884 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:38:28.439859 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6510ccb_88dc_4afc_82c4_de4672a21397.slice/crio-280deb3829819e8b7bc96f3e4de038e90e410e5e3d9d82477f802037dc222135 WatchSource:0}: Error finding container 280deb3829819e8b7bc96f3e4de038e90e410e5e3d9d82477f802037dc222135: Status 404 returned error can't find the container with id 280deb3829819e8b7bc96f3e4de038e90e410e5e3d9d82477f802037dc222135 Jul 13 21:38:29.306943 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:29.306895 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" event={"ID":"e6510ccb-88dc-4afc-82c4-de4672a21397","Type":"ContainerStarted","Data":"fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12"} Jul 13 21:38:29.307389 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:29.306963 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" event={"ID":"e6510ccb-88dc-4afc-82c4-de4672a21397","Type":"ContainerStarted","Data":"280deb3829819e8b7bc96f3e4de038e90e410e5e3d9d82477f802037dc222135"} Jul 13 21:38:29.307389 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:29.307120 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:38:29.325591 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:29.325532 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" podStartSLOduration=1.9694577070000001 podStartE2EDuration="2.32551272s" totalImagesPullingTime="356.055013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:38:29.323712494 +0000 UTC m=+1643.080931974" watchObservedRunningTime="2026-07-13 21:38:29.32551272 +0000 UTC m=+1643.082732186" Jul 13 21:38:35.320204 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:38:35.320172 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:39:33.010797 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.010720 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4"] Jul 13 21:39:33.011237 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.010933 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" podUID="e6510ccb-88dc-4afc-82c4-de4672a21397" containerName="maas-api" containerID="cri-o://fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12" gracePeriod=30 Jul 13 21:39:33.257111 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.257082 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:39:33.357997 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.357903 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7b55\" (UniqueName: \"kubernetes.io/projected/e6510ccb-88dc-4afc-82c4-de4672a21397-kube-api-access-v7b55\") pod \"e6510ccb-88dc-4afc-82c4-de4672a21397\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " Jul 13 21:39:33.357997 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.357964 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6510ccb-88dc-4afc-82c4-de4672a21397-openshift-service-ca\") pod \"e6510ccb-88dc-4afc-82c4-de4672a21397\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " Jul 13 21:39:33.358264 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.358050 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6510ccb-88dc-4afc-82c4-de4672a21397-maas-api-tls\") pod \"e6510ccb-88dc-4afc-82c4-de4672a21397\" (UID: \"e6510ccb-88dc-4afc-82c4-de4672a21397\") " Jul 13 21:39:33.358305 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.358257 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6510ccb-88dc-4afc-82c4-de4672a21397-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6510ccb-88dc-4afc-82c4-de4672a21397" (UID: "e6510ccb-88dc-4afc-82c4-de4672a21397"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:39:33.360141 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.360116 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6510ccb-88dc-4afc-82c4-de4672a21397-kube-api-access-v7b55" (OuterVolumeSpecName: "kube-api-access-v7b55") pod "e6510ccb-88dc-4afc-82c4-de4672a21397" (UID: "e6510ccb-88dc-4afc-82c4-de4672a21397"). InnerVolumeSpecName "kube-api-access-v7b55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:39:33.360210 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.360152 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6510ccb-88dc-4afc-82c4-de4672a21397-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6510ccb-88dc-4afc-82c4-de4672a21397" (UID: "e6510ccb-88dc-4afc-82c4-de4672a21397"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:39:33.459298 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.459261 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7b55\" (UniqueName: \"kubernetes.io/projected/e6510ccb-88dc-4afc-82c4-de4672a21397-kube-api-access-v7b55\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:39:33.459298 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.459294 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6510ccb-88dc-4afc-82c4-de4672a21397-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:39:33.459298 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.459305 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6510ccb-88dc-4afc-82c4-de4672a21397-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:39:33.650187 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.650093 2572 generic.go:356] "Generic (PLEG): container finished" podID="e6510ccb-88dc-4afc-82c4-de4672a21397" containerID="fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12" exitCode=0 Jul 13 21:39:33.650187 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.650137 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" Jul 13 21:39:33.650187 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.650171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" event={"ID":"e6510ccb-88dc-4afc-82c4-de4672a21397","Type":"ContainerDied","Data":"fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12"} Jul 13 21:39:33.650398 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.650227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4" event={"ID":"e6510ccb-88dc-4afc-82c4-de4672a21397","Type":"ContainerDied","Data":"280deb3829819e8b7bc96f3e4de038e90e410e5e3d9d82477f802037dc222135"} Jul 13 21:39:33.650398 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.650250 2572 scope.go:117] "RemoveContainer" containerID="fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12" Jul 13 21:39:33.662248 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.662231 2572 scope.go:117] "RemoveContainer" containerID="fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12" Jul 13 21:39:33.662579 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:39:33.662556 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12\": container with ID starting with fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12 not found: ID does not exist" containerID="fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12" Jul 13 21:39:33.662677 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.662589 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12"} err="failed to get container status \"fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12\": rpc error: code = NotFound desc = could not find container \"fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12\": container with ID starting with fbac9716d7b3692f1f8ddafc20ce83a2ed83bc0975e7dcffdc9985542bcc3a12 not found: ID does not exist" Jul 13 21:39:33.686302 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.686264 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4"] Jul 13 21:39:33.688519 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:33.688492 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9b92c93-687f4db8c8-57nw4"] Jul 13 21:39:34.806137 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:39:34.806103 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6510ccb-88dc-4afc-82c4-de4672a21397" path="/var/lib/kubelet/pods/e6510ccb-88dc-4afc-82c4-de4672a21397/volumes" Jul 13 21:41:06.835335 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:06.835305 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:41:06.843171 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:06.843140 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:41:06.844656 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:06.844633 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:41:06.851802 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:06.851775 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:41:32.213833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.213794 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm"] Jul 13 21:41:32.214325 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.214187 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6510ccb-88dc-4afc-82c4-de4672a21397" containerName="maas-api" Jul 13 21:41:32.214325 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.214200 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6510ccb-88dc-4afc-82c4-de4672a21397" containerName="maas-api" Jul 13 21:41:32.214325 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.214267 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6510ccb-88dc-4afc-82c4-de4672a21397" containerName="maas-api" Jul 13 21:41:32.217426 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.217407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.220023 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.219978 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2b4e0142-serving-cert\"" Jul 13 21:41:32.227801 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.227770 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm"] Jul 13 21:41:32.306083 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.306050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxs44\" (UniqueName: \"kubernetes.io/projected/e534f118-0ee6-4849-87fc-8676cfab6c92-kube-api-access-dxs44\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.306254 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.306092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534f118-0ee6-4849-87fc-8676cfab6c92-openshift-service-ca\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.306254 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.306151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.407305 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.407262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxs44\" (UniqueName: \"kubernetes.io/projected/e534f118-0ee6-4849-87fc-8676cfab6c92-kube-api-access-dxs44\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.407305 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.407312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534f118-0ee6-4849-87fc-8676cfab6c92-openshift-service-ca\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.407538 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.407351 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.407538 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:41:32.407525 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-serving-cert: secret "maas-api-e2e-mt-2b4e0142-serving-cert" not found Jul 13 21:41:32.407605 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:41:32.407592 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls podName:e534f118-0ee6-4849-87fc-8676cfab6c92 nodeName:}" failed. No retries permitted until 2026-07-13 21:41:32.907572158 +0000 UTC m=+1826.664791602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls") pod "maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" (UID: "e534f118-0ee6-4849-87fc-8676cfab6c92") : secret "maas-api-e2e-mt-2b4e0142-serving-cert" not found Jul 13 21:41:32.408058 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.408038 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534f118-0ee6-4849-87fc-8676cfab6c92-openshift-service-ca\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.416670 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.416640 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxs44\" (UniqueName: \"kubernetes.io/projected/e534f118-0ee6-4849-87fc-8676cfab6c92-kube-api-access-dxs44\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.912320 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.912277 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:32.914827 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:32.914803 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls\") pod \"maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:33.128852 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:33.128817 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:33.274359 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:33.274332 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm"] Jul 13 21:41:33.276408 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:41:33.276364 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode534f118_0ee6_4849_87fc_8676cfab6c92.slice/crio-cf99e2e8dc7ef39bc065805a0983ee2de796976b57bed1bf103c29a631b81d6a WatchSource:0}: Error finding container cf99e2e8dc7ef39bc065805a0983ee2de796976b57bed1bf103c29a631b81d6a: Status 404 returned error can't find the container with id cf99e2e8dc7ef39bc065805a0983ee2de796976b57bed1bf103c29a631b81d6a Jul 13 21:41:34.288683 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:34.288644 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" event={"ID":"e534f118-0ee6-4849-87fc-8676cfab6c92","Type":"ContainerStarted","Data":"ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549"} Jul 13 21:41:34.289092 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:34.288700 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" event={"ID":"e534f118-0ee6-4849-87fc-8676cfab6c92","Type":"ContainerStarted","Data":"cf99e2e8dc7ef39bc065805a0983ee2de796976b57bed1bf103c29a631b81d6a"} Jul 13 21:41:34.289092 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:34.288757 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:34.308992 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:34.308928 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" podStartSLOduration=1.744045061 podStartE2EDuration="2.308909505s" totalImagesPullingTime="564.864444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:41:34.306161036 +0000 UTC m=+1828.063380504" watchObservedRunningTime="2026-07-13 21:41:34.308909505 +0000 UTC m=+1828.066128993" Jul 13 21:41:40.300318 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:40.300282 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:54.693209 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:54.693165 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm"] Jul 13 21:41:54.693630 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:54.693394 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" podUID="e534f118-0ee6-4849-87fc-8676cfab6c92" containerName="maas-api" containerID="cri-o://ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549" gracePeriod=30 Jul 13 21:41:54.947540 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:54.947466 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:55.014339 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.014297 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534f118-0ee6-4849-87fc-8676cfab6c92-openshift-service-ca\") pod \"e534f118-0ee6-4849-87fc-8676cfab6c92\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " Jul 13 21:41:55.014498 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.014351 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxs44\" (UniqueName: \"kubernetes.io/projected/e534f118-0ee6-4849-87fc-8676cfab6c92-kube-api-access-dxs44\") pod \"e534f118-0ee6-4849-87fc-8676cfab6c92\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " Jul 13 21:41:55.014498 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.014388 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls\") pod \"e534f118-0ee6-4849-87fc-8676cfab6c92\" (UID: \"e534f118-0ee6-4849-87fc-8676cfab6c92\") " Jul 13 21:41:55.014718 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.014689 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e534f118-0ee6-4849-87fc-8676cfab6c92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e534f118-0ee6-4849-87fc-8676cfab6c92" (UID: "e534f118-0ee6-4849-87fc-8676cfab6c92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:41:55.016502 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.016461 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e534f118-0ee6-4849-87fc-8676cfab6c92-kube-api-access-dxs44" (OuterVolumeSpecName: "kube-api-access-dxs44") pod "e534f118-0ee6-4849-87fc-8676cfab6c92" (UID: "e534f118-0ee6-4849-87fc-8676cfab6c92"). InnerVolumeSpecName "kube-api-access-dxs44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:41:55.016666 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.016577 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e534f118-0ee6-4849-87fc-8676cfab6c92" (UID: "e534f118-0ee6-4849-87fc-8676cfab6c92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:41:55.115898 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.115773 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534f118-0ee6-4849-87fc-8676cfab6c92-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:41:55.115898 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.115899 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxs44\" (UniqueName: \"kubernetes.io/projected/e534f118-0ee6-4849-87fc-8676cfab6c92-kube-api-access-dxs44\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:41:55.116205 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.115915 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e534f118-0ee6-4849-87fc-8676cfab6c92-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:41:55.400339 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.400303 2572 generic.go:356] "Generic (PLEG): container finished" podID="e534f118-0ee6-4849-87fc-8676cfab6c92" containerID="ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549" exitCode=0 Jul 13 21:41:55.400493 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.400345 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" event={"ID":"e534f118-0ee6-4849-87fc-8676cfab6c92","Type":"ContainerDied","Data":"ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549"} Jul 13 21:41:55.400493 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.400365 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" Jul 13 21:41:55.400493 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.400414 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm" event={"ID":"e534f118-0ee6-4849-87fc-8676cfab6c92","Type":"ContainerDied","Data":"cf99e2e8dc7ef39bc065805a0983ee2de796976b57bed1bf103c29a631b81d6a"} Jul 13 21:41:55.400493 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.400437 2572 scope.go:117] "RemoveContainer" containerID="ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549" Jul 13 21:41:55.410372 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.410348 2572 scope.go:117] "RemoveContainer" containerID="ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549" Jul 13 21:41:55.410719 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:41:55.410698 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549\": container with ID starting with ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549 not found: ID does not exist" containerID="ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549" Jul 13 21:41:55.410792 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.410733 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549"} err="failed to get container status \"ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549\": rpc error: code = NotFound desc = could not find container \"ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549\": container with ID starting with ed1894365f2231a2eb57135b9e0f0467095c3aa3c880c8e455cdc2797ae1a549 not found: ID does not exist" Jul 13 21:41:55.422509 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.422465 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm"] Jul 13 21:41:55.425917 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:55.425886 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2b4e0142-6fdb549969-sq2zm"] Jul 13 21:41:56.805761 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:41:56.805725 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e534f118-0ee6-4849-87fc-8676cfab6c92" path="/var/lib/kubelet/pods/e534f118-0ee6-4849-87fc-8676cfab6c92/volumes" Jul 13 21:42:32.149766 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.149681 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm"] Jul 13 21:42:32.150268 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.150230 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e534f118-0ee6-4849-87fc-8676cfab6c92" containerName="maas-api" Jul 13 21:42:32.150268 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.150251 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e534f118-0ee6-4849-87fc-8676cfab6c92" containerName="maas-api" Jul 13 21:42:32.150385 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.150366 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e534f118-0ee6-4849-87fc-8676cfab6c92" containerName="maas-api" Jul 13 21:42:32.153510 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.153491 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.156079 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.156057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ffa5db90-serving-cert\"" Jul 13 21:42:32.161494 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.161468 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm"] Jul 13 21:42:32.252649 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.252609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-maas-api-tls\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.252649 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.252647 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb8c7\" (UniqueName: \"kubernetes.io/projected/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-kube-api-access-rb8c7\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.252868 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.252690 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-openshift-service-ca\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.353861 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.353812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-openshift-service-ca\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.354102 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.353935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-maas-api-tls\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.354102 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.353959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8c7\" (UniqueName: \"kubernetes.io/projected/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-kube-api-access-rb8c7\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.354548 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.354518 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-openshift-service-ca\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.356441 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.356420 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-maas-api-tls\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.363291 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.363266 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb8c7\" (UniqueName: \"kubernetes.io/projected/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-kube-api-access-rb8c7\") pod \"maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.465271 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.465169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:32.608190 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.608154 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm"] Jul 13 21:42:32.609768 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:42:32.609727 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabac5c3_5ddd_42e8_9b84_9520d81cfe69.slice/crio-83bca2a1ec4d4419440143fb61aee6c6d9900d7442a1dab197a542321fab17f8 WatchSource:0}: Error finding container 83bca2a1ec4d4419440143fb61aee6c6d9900d7442a1dab197a542321fab17f8: Status 404 returned error can't find the container with id 83bca2a1ec4d4419440143fb61aee6c6d9900d7442a1dab197a542321fab17f8 Jul 13 21:42:32.611194 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:32.611174 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:42:33.599347 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:33.599309 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" event={"ID":"dabac5c3-5ddd-42e8-9b84-9520d81cfe69","Type":"ContainerStarted","Data":"2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1"} Jul 13 21:42:33.599833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:33.599370 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" event={"ID":"dabac5c3-5ddd-42e8-9b84-9520d81cfe69","Type":"ContainerStarted","Data":"83bca2a1ec4d4419440143fb61aee6c6d9900d7442a1dab197a542321fab17f8"} Jul 13 21:42:33.599833 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:33.599394 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:42:33.615886 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:33.615834 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" podStartSLOduration=1.233995758 podStartE2EDuration="1.615815697s" totalImagesPullingTime="381.819939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:42:33.615238582 +0000 UTC m=+1887.372458083" watchObservedRunningTime="2026-07-13 21:42:33.615815697 +0000 UTC m=+1887.373035164" Jul 13 21:42:39.609920 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:42:39.609888 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:43:25.357097 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.357041 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm"] Jul 13 21:43:25.357701 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.357324 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" podUID="dabac5c3-5ddd-42e8-9b84-9520d81cfe69" containerName="maas-api" containerID="cri-o://2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1" gracePeriod=30 Jul 13 21:43:25.611971 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.611899 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:43:25.720615 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.720577 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb8c7\" (UniqueName: \"kubernetes.io/projected/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-kube-api-access-rb8c7\") pod \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " Jul 13 21:43:25.720810 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.720640 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-maas-api-tls\") pod \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " Jul 13 21:43:25.720810 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.720671 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-openshift-service-ca\") pod \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\" (UID: \"dabac5c3-5ddd-42e8-9b84-9520d81cfe69\") " Jul 13 21:43:25.721114 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.721086 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dabac5c3-5ddd-42e8-9b84-9520d81cfe69" (UID: "dabac5c3-5ddd-42e8-9b84-9520d81cfe69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:43:25.722723 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.722695 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-kube-api-access-rb8c7" (OuterVolumeSpecName: "kube-api-access-rb8c7") pod "dabac5c3-5ddd-42e8-9b84-9520d81cfe69" (UID: "dabac5c3-5ddd-42e8-9b84-9520d81cfe69"). InnerVolumeSpecName "kube-api-access-rb8c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:43:25.722814 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.722740 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dabac5c3-5ddd-42e8-9b84-9520d81cfe69" (UID: "dabac5c3-5ddd-42e8-9b84-9520d81cfe69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:43:25.821632 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.821601 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:43:25.821632 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.821628 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:43:25.821632 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.821639 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb8c7\" (UniqueName: \"kubernetes.io/projected/dabac5c3-5ddd-42e8-9b84-9520d81cfe69-kube-api-access-rb8c7\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:43:25.887088 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.886972 2572 generic.go:356] "Generic (PLEG): container finished" podID="dabac5c3-5ddd-42e8-9b84-9520d81cfe69" containerID="2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1" exitCode=0 Jul 13 21:43:25.887088 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.887031 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" Jul 13 21:43:25.887088 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.887056 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" event={"ID":"dabac5c3-5ddd-42e8-9b84-9520d81cfe69","Type":"ContainerDied","Data":"2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1"} Jul 13 21:43:25.887336 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.887110 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm" event={"ID":"dabac5c3-5ddd-42e8-9b84-9520d81cfe69","Type":"ContainerDied","Data":"83bca2a1ec4d4419440143fb61aee6c6d9900d7442a1dab197a542321fab17f8"} Jul 13 21:43:25.887336 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.887133 2572 scope.go:117] "RemoveContainer" containerID="2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1" Jul 13 21:43:25.896498 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.896465 2572 scope.go:117] "RemoveContainer" containerID="2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1" Jul 13 21:43:25.896795 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:43:25.896776 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1\": container with ID starting with 2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1 not found: ID does not exist" containerID="2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1" Jul 13 21:43:25.896836 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.896807 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1"} err="failed to get container status \"2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1\": rpc error: code = NotFound desc = could not find container \"2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1\": container with ID starting with 2a70897230b963a5d5c2b77bb7a3213b72c8724fc20d446a6aea917664e57bc1 not found: ID does not exist" Jul 13 21:43:25.909205 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.909173 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm"] Jul 13 21:43:25.912638 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:25.912610 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ffa5db90-57844784f8-gbqlm"] Jul 13 21:43:26.812960 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:43:26.812924 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dabac5c3-5ddd-42e8-9b84-9520d81cfe69" path="/var/lib/kubelet/pods/dabac5c3-5ddd-42e8-9b84-9520d81cfe69/volumes" Jul 13 21:45:20.189686 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.189651 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz"] Jul 13 21:45:20.190173 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.190116 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dabac5c3-5ddd-42e8-9b84-9520d81cfe69" containerName="maas-api" Jul 13 21:45:20.190173 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.190131 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dabac5c3-5ddd-42e8-9b84-9520d81cfe69" containerName="maas-api" Jul 13 21:45:20.190258 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.190225 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dabac5c3-5ddd-42e8-9b84-9520d81cfe69" containerName="maas-api" Jul 13 21:45:20.193385 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.193363 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.196971 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.196945 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-749717-serving-cert\"" Jul 13 21:45:20.206053 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.206017 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz"] Jul 13 21:45:20.312315 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.312271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2755cce7-be10-4ef9-b454-c501872e6c56-openshift-service-ca\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.312534 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.312338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llmlj\" (UniqueName: \"kubernetes.io/projected/2755cce7-be10-4ef9-b454-c501872e6c56-kube-api-access-llmlj\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.312534 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.312445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.413576 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.413539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2755cce7-be10-4ef9-b454-c501872e6c56-openshift-service-ca\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.413576 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.413595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llmlj\" (UniqueName: \"kubernetes.io/projected/2755cce7-be10-4ef9-b454-c501872e6c56-kube-api-access-llmlj\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.413861 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.413640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.413861 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:45:20.413763 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-serving-cert: secret "maas-api-e2e-inf-a-749717-serving-cert" not found Jul 13 21:45:20.413861 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:45:20.413841 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls podName:2755cce7-be10-4ef9-b454-c501872e6c56 nodeName:}" failed. No retries permitted until 2026-07-13 21:45:20.913820132 +0000 UTC m=+2054.671039577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls") pod "maas-api-e2e-inf-a-749717-575577769d-d6pwz" (UID: "2755cce7-be10-4ef9-b454-c501872e6c56") : secret "maas-api-e2e-inf-a-749717-serving-cert" not found Jul 13 21:45:20.414390 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.414363 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2755cce7-be10-4ef9-b454-c501872e6c56-openshift-service-ca\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.422477 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.422442 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llmlj\" (UniqueName: \"kubernetes.io/projected/2755cce7-be10-4ef9-b454-c501872e6c56-kube-api-access-llmlj\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.917071 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.916991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:20.919985 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:20.919955 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls\") pod \"maas-api-e2e-inf-a-749717-575577769d-d6pwz\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:21.104263 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:21.104217 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:21.242755 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:21.242723 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz"] Jul 13 21:45:21.244731 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:45:21.244704 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2755cce7_be10_4ef9_b454_c501872e6c56.slice/crio-ba3b3639cd6a1167518c66144ff804ae77b244fe47caa69ef7dfc865a086c36d WatchSource:0}: Error finding container ba3b3639cd6a1167518c66144ff804ae77b244fe47caa69ef7dfc865a086c36d: Status 404 returned error can't find the container with id ba3b3639cd6a1167518c66144ff804ae77b244fe47caa69ef7dfc865a086c36d Jul 13 21:45:21.491379 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:21.491334 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" event={"ID":"2755cce7-be10-4ef9-b454-c501872e6c56","Type":"ContainerStarted","Data":"ba3b3639cd6a1167518c66144ff804ae77b244fe47caa69ef7dfc865a086c36d"} Jul 13 21:45:22.497705 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:22.497668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" event={"ID":"2755cce7-be10-4ef9-b454-c501872e6c56","Type":"ContainerStarted","Data":"b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3"} Jul 13 21:45:22.498152 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:22.497731 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:22.515374 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:22.515306 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" podStartSLOduration=2.108447111 podStartE2EDuration="2.5152881s" totalImagesPullingTime="406.840989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:45:22.514726138 +0000 UTC m=+2056.271945609" watchObservedRunningTime="2026-07-13 21:45:22.5152881 +0000 UTC m=+2056.272507566" Jul 13 21:45:28.102199 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.102158 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg"] Jul 13 21:45:28.105938 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.105901 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.108511 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.108475 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f491fd-serving-cert\"" Jul 13 21:45:28.115431 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.115400 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg"] Jul 13 21:45:28.182044 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.181967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.182235 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.182115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cad4e29c-4dbd-4ad5-bffa-11700bd82659-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.182235 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.182211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8ggq\" (UniqueName: \"kubernetes.io/projected/cad4e29c-4dbd-4ad5-bffa-11700bd82659-kube-api-access-v8ggq\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.283038 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.282962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8ggq\" (UniqueName: \"kubernetes.io/projected/cad4e29c-4dbd-4ad5-bffa-11700bd82659-kube-api-access-v8ggq\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.283217 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.283051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.283217 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.283092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cad4e29c-4dbd-4ad5-bffa-11700bd82659-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.283217 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:45:28.283202 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-serving-cert: secret "maas-api-e2e-inf-b-f491fd-serving-cert" not found Jul 13 21:45:28.283327 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:45:28.283274 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls podName:cad4e29c-4dbd-4ad5-bffa-11700bd82659 nodeName:}" failed. No retries permitted until 2026-07-13 21:45:28.783253686 +0000 UTC m=+2062.540473146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls") pod "maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" (UID: "cad4e29c-4dbd-4ad5-bffa-11700bd82659") : secret "maas-api-e2e-inf-b-f491fd-serving-cert" not found Jul 13 21:45:28.283819 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.283801 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cad4e29c-4dbd-4ad5-bffa-11700bd82659-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.293144 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.293117 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8ggq\" (UniqueName: \"kubernetes.io/projected/cad4e29c-4dbd-4ad5-bffa-11700bd82659-kube-api-access-v8ggq\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.509181 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.509148 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:45:28.788826 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.788721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:28.791259 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:28.791224 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls\") pod \"maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:29.018911 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:29.018859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:29.161916 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:29.161885 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg"] Jul 13 21:45:29.163326 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:45:29.163298 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad4e29c_4dbd_4ad5_bffa_11700bd82659.slice/crio-102b463447f981867f7ae00b252cdbded255436a999eb36cc47570ae2a7e46f4 WatchSource:0}: Error finding container 102b463447f981867f7ae00b252cdbded255436a999eb36cc47570ae2a7e46f4: Status 404 returned error can't find the container with id 102b463447f981867f7ae00b252cdbded255436a999eb36cc47570ae2a7e46f4 Jul 13 21:45:29.537086 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:29.537056 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" event={"ID":"cad4e29c-4dbd-4ad5-bffa-11700bd82659","Type":"ContainerStarted","Data":"102b463447f981867f7ae00b252cdbded255436a999eb36cc47570ae2a7e46f4"} Jul 13 21:45:30.544102 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:30.544060 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" event={"ID":"cad4e29c-4dbd-4ad5-bffa-11700bd82659","Type":"ContainerStarted","Data":"c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4"} Jul 13 21:45:30.544494 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:30.544191 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:45:30.564328 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:30.564279 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" podStartSLOduration=2.252938506 podStartE2EDuration="2.564260614s" totalImagesPullingTime="311.322108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:45:30.56256909 +0000 UTC m=+2064.319788556" watchObservedRunningTime="2026-07-13 21:45:30.564260614 +0000 UTC m=+2064.321480080" Jul 13 21:45:36.555227 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:45:36.555195 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:46:06.870375 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:06.870346 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:46:06.878444 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:06.878418 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:46:06.880253 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:06.880233 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:46:06.887849 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:06.887825 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:46:32.067692 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.067650 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9"] Jul 13 21:46:32.071247 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.071222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" Jul 13 21:46:32.073952 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.073927 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fhllj\"" Jul 13 21:46:32.079077 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.078898 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9"] Jul 13 21:46:32.169393 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.169343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8a47c3-bf40-48d9-9516-ea16790441e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-749717-64jq9\" (UID: \"8c8a47c3-bf40-48d9-9516-ea16790441e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" Jul 13 21:46:32.270161 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.270121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8a47c3-bf40-48d9-9516-ea16790441e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-749717-64jq9\" (UID: \"8c8a47c3-bf40-48d9-9516-ea16790441e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" Jul 13 21:46:32.270735 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.270714 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8a47c3-bf40-48d9-9516-ea16790441e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-749717-64jq9\" (UID: \"8c8a47c3-bf40-48d9-9516-ea16790441e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" Jul 13 21:46:32.383482 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.383386 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" Jul 13 21:46:32.530200 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.530168 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9"] Jul 13 21:46:32.532362 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:46:32.532328 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8a47c3_bf40_48d9_9516_ea16790441e1.slice/crio-10578ffc4594834b85fbc38f397c4c330b68833880ce1ed488a750d2b2c14bc1 WatchSource:0}: Error finding container 10578ffc4594834b85fbc38f397c4c330b68833880ce1ed488a750d2b2c14bc1: Status 404 returned error can't find the container with id 10578ffc4594834b85fbc38f397c4c330b68833880ce1ed488a750d2b2c14bc1 Jul 13 21:46:32.885092 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.885037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" event={"ID":"8c8a47c3-bf40-48d9-9516-ea16790441e1","Type":"ContainerStarted","Data":"e4fc84ea59b7939dac60521e6cf15d102837b650a396e8892653f1b0efa298a7"} Jul 13 21:46:32.885263 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.885117 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" event={"ID":"8c8a47c3-bf40-48d9-9516-ea16790441e1","Type":"ContainerStarted","Data":"10578ffc4594834b85fbc38f397c4c330b68833880ce1ed488a750d2b2c14bc1"} Jul 13 21:46:32.900226 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:32.900169 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" podStartSLOduration=0.900151499 podStartE2EDuration="900.151499ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:46:32.899920801 +0000 UTC m=+2126.657140271" watchObservedRunningTime="2026-07-13 21:46:32.900151499 +0000 UTC m=+2126.657371047" Jul 13 21:46:33.891907 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:33.891870 2572 generic.go:356] "Generic (PLEG): container finished" podID="8c8a47c3-bf40-48d9-9516-ea16790441e1" containerID="e4fc84ea59b7939dac60521e6cf15d102837b650a396e8892653f1b0efa298a7" exitCode=0 Jul 13 21:46:33.892343 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:33.891960 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" event={"ID":"8c8a47c3-bf40-48d9-9516-ea16790441e1","Type":"ContainerDied","Data":"e4fc84ea59b7939dac60521e6cf15d102837b650a396e8892653f1b0efa298a7"} Jul 13 21:46:35.033648 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:35.033619 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" Jul 13 21:46:35.196917 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:35.196795 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8a47c3-bf40-48d9-9516-ea16790441e1-maas-api-service-ca\") pod \"8c8a47c3-bf40-48d9-9516-ea16790441e1\" (UID: \"8c8a47c3-bf40-48d9-9516-ea16790441e1\") " Jul 13 21:46:35.197277 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:35.197251 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c8a47c3-bf40-48d9-9516-ea16790441e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c8a47c3-bf40-48d9-9516-ea16790441e1" (UID: "8c8a47c3-bf40-48d9-9516-ea16790441e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:46:35.298354 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:35.298296 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8a47c3-bf40-48d9-9516-ea16790441e1-maas-api-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:46:35.904147 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:35.904120 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" Jul 13 21:46:35.904318 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:35.904155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-749717-64jq9" event={"ID":"8c8a47c3-bf40-48d9-9516-ea16790441e1","Type":"ContainerDied","Data":"10578ffc4594834b85fbc38f397c4c330b68833880ce1ed488a750d2b2c14bc1"} Jul 13 21:46:35.904318 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:35.904196 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10578ffc4594834b85fbc38f397c4c330b68833880ce1ed488a750d2b2c14bc1" Jul 13 21:46:42.524273 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.524229 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz"] Jul 13 21:46:42.524747 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.524518 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" podUID="2755cce7-be10-4ef9-b454-c501872e6c56" containerName="maas-api" containerID="cri-o://b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3" gracePeriod=30 Jul 13 21:46:42.789035 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.788945 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:46:42.858383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.858342 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llmlj\" (UniqueName: \"kubernetes.io/projected/2755cce7-be10-4ef9-b454-c501872e6c56-kube-api-access-llmlj\") pod \"2755cce7-be10-4ef9-b454-c501872e6c56\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " Jul 13 21:46:42.858604 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.858426 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2755cce7-be10-4ef9-b454-c501872e6c56-openshift-service-ca\") pod \"2755cce7-be10-4ef9-b454-c501872e6c56\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " Jul 13 21:46:42.858604 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.858461 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls\") pod \"2755cce7-be10-4ef9-b454-c501872e6c56\" (UID: \"2755cce7-be10-4ef9-b454-c501872e6c56\") " Jul 13 21:46:42.858797 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.858769 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2755cce7-be10-4ef9-b454-c501872e6c56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2755cce7-be10-4ef9-b454-c501872e6c56" (UID: "2755cce7-be10-4ef9-b454-c501872e6c56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:46:42.860640 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.860603 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2755cce7-be10-4ef9-b454-c501872e6c56-kube-api-access-llmlj" (OuterVolumeSpecName: "kube-api-access-llmlj") pod "2755cce7-be10-4ef9-b454-c501872e6c56" (UID: "2755cce7-be10-4ef9-b454-c501872e6c56"). InnerVolumeSpecName "kube-api-access-llmlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:46:42.860640 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.860639 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2755cce7-be10-4ef9-b454-c501872e6c56" (UID: "2755cce7-be10-4ef9-b454-c501872e6c56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:46:42.942788 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.942749 2572 generic.go:356] "Generic (PLEG): container finished" podID="2755cce7-be10-4ef9-b454-c501872e6c56" containerID="b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3" exitCode=0 Jul 13 21:46:42.942962 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.942790 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" event={"ID":"2755cce7-be10-4ef9-b454-c501872e6c56","Type":"ContainerDied","Data":"b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3"} Jul 13 21:46:42.942962 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.942848 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" event={"ID":"2755cce7-be10-4ef9-b454-c501872e6c56","Type":"ContainerDied","Data":"ba3b3639cd6a1167518c66144ff804ae77b244fe47caa69ef7dfc865a086c36d"} Jul 13 21:46:42.942962 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.942871 2572 scope.go:117] "RemoveContainer" containerID="b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3" Jul 13 21:46:42.942962 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.942798 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz" Jul 13 21:46:42.953406 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.953385 2572 scope.go:117] "RemoveContainer" containerID="b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3" Jul 13 21:46:42.953717 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:46:42.953697 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3\": container with ID starting with b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3 not found: ID does not exist" containerID="b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3" Jul 13 21:46:42.953764 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.953725 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3"} err="failed to get container status \"b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3\": rpc error: code = NotFound desc = could not find container \"b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3\": container with ID starting with b3b017437ea0caa8754cd3be0016e364eb5e1808d17143fb0f68119c1946ebc3 not found: ID does not exist" Jul 13 21:46:42.959746 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.959717 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llmlj\" (UniqueName: \"kubernetes.io/projected/2755cce7-be10-4ef9-b454-c501872e6c56-kube-api-access-llmlj\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:46:42.959746 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.959742 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2755cce7-be10-4ef9-b454-c501872e6c56-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:46:42.959746 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.959753 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2755cce7-be10-4ef9-b454-c501872e6c56-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:46:42.967551 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.967515 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz"] Jul 13 21:46:42.972586 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:42.972553 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-749717-575577769d-d6pwz"] Jul 13 21:46:44.805863 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:46:44.805798 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2755cce7-be10-4ef9-b454-c501872e6c56" path="/var/lib/kubelet/pods/2755cce7-be10-4ef9-b454-c501872e6c56/volumes" Jul 13 21:47:08.662674 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.662632 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg"] Jul 13 21:47:08.663196 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.662892 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" podUID="cad4e29c-4dbd-4ad5-bffa-11700bd82659" containerName="maas-api" containerID="cri-o://c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4" gracePeriod=30 Jul 13 21:47:08.922821 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.922737 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:47:08.990750 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.990708 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cad4e29c-4dbd-4ad5-bffa-11700bd82659-openshift-service-ca\") pod \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " Jul 13 21:47:08.990750 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.990755 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8ggq\" (UniqueName: \"kubernetes.io/projected/cad4e29c-4dbd-4ad5-bffa-11700bd82659-kube-api-access-v8ggq\") pod \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " Jul 13 21:47:08.990964 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.990798 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls\") pod \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\" (UID: \"cad4e29c-4dbd-4ad5-bffa-11700bd82659\") " Jul 13 21:47:08.991178 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.991138 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad4e29c-4dbd-4ad5-bffa-11700bd82659-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cad4e29c-4dbd-4ad5-bffa-11700bd82659" (UID: "cad4e29c-4dbd-4ad5-bffa-11700bd82659"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:47:08.993028 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.992983 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cad4e29c-4dbd-4ad5-bffa-11700bd82659" (UID: "cad4e29c-4dbd-4ad5-bffa-11700bd82659"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:47:08.993028 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:08.992990 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad4e29c-4dbd-4ad5-bffa-11700bd82659-kube-api-access-v8ggq" (OuterVolumeSpecName: "kube-api-access-v8ggq") pod "cad4e29c-4dbd-4ad5-bffa-11700bd82659" (UID: "cad4e29c-4dbd-4ad5-bffa-11700bd82659"). InnerVolumeSpecName "kube-api-access-v8ggq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:47:09.086641 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.086608 2572 generic.go:356] "Generic (PLEG): container finished" podID="cad4e29c-4dbd-4ad5-bffa-11700bd82659" containerID="c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4" exitCode=0 Jul 13 21:47:09.086825 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.086654 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" event={"ID":"cad4e29c-4dbd-4ad5-bffa-11700bd82659","Type":"ContainerDied","Data":"c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4"} Jul 13 21:47:09.086825 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.086657 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" Jul 13 21:47:09.086825 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.086699 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg" event={"ID":"cad4e29c-4dbd-4ad5-bffa-11700bd82659","Type":"ContainerDied","Data":"102b463447f981867f7ae00b252cdbded255436a999eb36cc47570ae2a7e46f4"} Jul 13 21:47:09.086825 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.086722 2572 scope.go:117] "RemoveContainer" containerID="c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4" Jul 13 21:47:09.091436 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.091404 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cad4e29c-4dbd-4ad5-bffa-11700bd82659-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:47:09.091436 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.091436 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8ggq\" (UniqueName: \"kubernetes.io/projected/cad4e29c-4dbd-4ad5-bffa-11700bd82659-kube-api-access-v8ggq\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:47:09.091614 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.091448 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cad4e29c-4dbd-4ad5-bffa-11700bd82659-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:47:09.096864 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.096844 2572 scope.go:117] "RemoveContainer" containerID="c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4" Jul 13 21:47:09.097213 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:47:09.097192 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4\": container with ID starting with c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4 not found: ID does not exist" containerID="c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4" Jul 13 21:47:09.097265 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.097224 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4"} err="failed to get container status \"c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4\": rpc error: code = NotFound desc = could not find container \"c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4\": container with ID starting with c9ee8e01d69a2900d5992d21b3b331371c6ca822fb857ea6a5839e3c8a1695a4 not found: ID does not exist" Jul 13 21:47:09.109746 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.109707 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg"] Jul 13 21:47:09.114225 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:09.114190 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f491fd-5d7d685b88-tr9pg"] Jul 13 21:47:10.805540 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:10.805506 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad4e29c-4dbd-4ad5-bffa-11700bd82659" path="/var/lib/kubelet/pods/cad4e29c-4dbd-4ad5-bffa-11700bd82659/volumes" Jul 13 21:47:27.879315 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879276 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v"] Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879646 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad4e29c-4dbd-4ad5-bffa-11700bd82659" containerName="maas-api" Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879658 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad4e29c-4dbd-4ad5-bffa-11700bd82659" containerName="maas-api" Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879669 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8a47c3-bf40-48d9-9516-ea16790441e1" containerName="revoke-keys" Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879674 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8a47c3-bf40-48d9-9516-ea16790441e1" containerName="revoke-keys" Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879686 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2755cce7-be10-4ef9-b454-c501872e6c56" containerName="maas-api" Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879692 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2755cce7-be10-4ef9-b454-c501872e6c56" containerName="maas-api" Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879758 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2755cce7-be10-4ef9-b454-c501872e6c56" containerName="maas-api" Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879771 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c8a47c3-bf40-48d9-9516-ea16790441e1" containerName="revoke-keys" Jul 13 21:47:27.879811 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.879779 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cad4e29c-4dbd-4ad5-bffa-11700bd82659" containerName="maas-api" Jul 13 21:47:27.882976 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.882949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:27.885413 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.885380 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-459a1d-serving-cert\"" Jul 13 21:47:27.892778 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:27.892743 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v"] Jul 13 21:47:28.064276 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.064235 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw575\" (UniqueName: \"kubernetes.io/projected/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-kube-api-access-kw575\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.064276 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.064291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-maas-api-tls\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.064521 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.064347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-openshift-service-ca\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.165866 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.165753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw575\" (UniqueName: \"kubernetes.io/projected/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-kube-api-access-kw575\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.165866 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.165820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-maas-api-tls\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.166174 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.165905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-openshift-service-ca\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.166638 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.166619 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-openshift-service-ca\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.168442 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.168423 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-maas-api-tls\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.174391 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.174352 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw575\" (UniqueName: \"kubernetes.io/projected/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-kube-api-access-kw575\") pod \"maas-api-e2e-api-a-459a1d-8948c7596-v8s2v\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.195458 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.195417 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:28.344807 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:28.344771 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v"] Jul 13 21:47:28.347016 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:47:28.346977 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8fb183_b4e1_4d1f_80e2_58250bffed1c.slice/crio-7363bbd47f0953f731abdc7071559ef882bad5ce640f9b330134d8f42903c729 WatchSource:0}: Error finding container 7363bbd47f0953f731abdc7071559ef882bad5ce640f9b330134d8f42903c729: Status 404 returned error can't find the container with id 7363bbd47f0953f731abdc7071559ef882bad5ce640f9b330134d8f42903c729 Jul 13 21:47:29.200332 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:29.200228 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" event={"ID":"7d8fb183-b4e1-4d1f-80e2-58250bffed1c","Type":"ContainerStarted","Data":"c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b"} Jul 13 21:47:29.200332 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:29.200295 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:29.200332 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:29.200318 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" event={"ID":"7d8fb183-b4e1-4d1f-80e2-58250bffed1c","Type":"ContainerStarted","Data":"7363bbd47f0953f731abdc7071559ef882bad5ce640f9b330134d8f42903c729"} Jul 13 21:47:29.218100 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:29.218049 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" podStartSLOduration=1.690839028 podStartE2EDuration="2.21803418s" totalImagesPullingTime="527.195152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:47:29.217301679 +0000 UTC m=+2182.974521147" watchObservedRunningTime="2026-07-13 21:47:29.21803418 +0000 UTC m=+2182.975253647" Jul 13 21:47:35.211584 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:35.211552 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:35.975734 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:35.975691 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj"] Jul 13 21:47:35.979617 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:35.979590 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:35.982341 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:35.982311 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-7b2acc-serving-cert\"" Jul 13 21:47:35.991326 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:35.991293 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj"] Jul 13 21:47:36.026742 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.026705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-openshift-service-ca\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.026919 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.026746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l2p7\" (UniqueName: \"kubernetes.io/projected/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-kube-api-access-5l2p7\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.026919 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.026844 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.127497 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.127455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.127705 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.127536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-openshift-service-ca\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.127705 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.127563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l2p7\" (UniqueName: \"kubernetes.io/projected/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-kube-api-access-5l2p7\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.127705 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:47:36.127614 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-serving-cert: secret "maas-api-e2e-api-b-7b2acc-serving-cert" not found Jul 13 21:47:36.127705 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:47:36.127694 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls podName:6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7 nodeName:}" failed. No retries permitted until 2026-07-13 21:47:36.627671327 +0000 UTC m=+2190.384890775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls") pod "maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" (UID: "6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7") : secret "maas-api-e2e-api-b-7b2acc-serving-cert" not found Jul 13 21:47:36.128322 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.128302 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-openshift-service-ca\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.136224 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.136201 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l2p7\" (UniqueName: \"kubernetes.io/projected/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-kube-api-access-5l2p7\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.632151 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.632099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.634658 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.634618 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls\") pod \"maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:36.892808 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:36.892716 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:37.035707 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:37.035630 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj"] Jul 13 21:47:37.038099 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:47:37.038070 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee7c66f_ce6f_4e84_bb80_91e2553ff0f7.slice/crio-6b334932736c33eb93301d2e04cbc0d79f8363c0bb6c3e1ad7d94dc25ad2111b WatchSource:0}: Error finding container 6b334932736c33eb93301d2e04cbc0d79f8363c0bb6c3e1ad7d94dc25ad2111b: Status 404 returned error can't find the container with id 6b334932736c33eb93301d2e04cbc0d79f8363c0bb6c3e1ad7d94dc25ad2111b Jul 13 21:47:37.039500 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:37.039482 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 21:47:37.244168 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:37.244127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" event={"ID":"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7","Type":"ContainerStarted","Data":"6b334932736c33eb93301d2e04cbc0d79f8363c0bb6c3e1ad7d94dc25ad2111b"} Jul 13 21:47:38.251088 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:38.251047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" event={"ID":"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7","Type":"ContainerStarted","Data":"d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58"} Jul 13 21:47:38.251579 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:38.251111 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:38.270742 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:38.270689 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" podStartSLOduration=2.758309746 podStartE2EDuration="3.270669673s" totalImagesPullingTime="512.359927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:47:38.268566186 +0000 UTC m=+2192.025785653" watchObservedRunningTime="2026-07-13 21:47:38.270669673 +0000 UTC m=+2192.027889141" Jul 13 21:47:44.263379 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:44.263341 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:47:59.321150 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.321110 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v"] Jul 13 21:47:59.321672 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.321469 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" podUID="7d8fb183-b4e1-4d1f-80e2-58250bffed1c" containerName="maas-api" containerID="cri-o://c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b" gracePeriod=30 Jul 13 21:47:59.577222 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.577151 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:47:59.641361 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.641316 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-openshift-service-ca\") pod \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " Jul 13 21:47:59.641361 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.641373 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-maas-api-tls\") pod \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " Jul 13 21:47:59.641595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.641467 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw575\" (UniqueName: \"kubernetes.io/projected/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-kube-api-access-kw575\") pod \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\" (UID: \"7d8fb183-b4e1-4d1f-80e2-58250bffed1c\") " Jul 13 21:47:59.641707 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.641669 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d8fb183-b4e1-4d1f-80e2-58250bffed1c" (UID: "7d8fb183-b4e1-4d1f-80e2-58250bffed1c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:47:59.643575 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.643546 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-kube-api-access-kw575" (OuterVolumeSpecName: "kube-api-access-kw575") pod "7d8fb183-b4e1-4d1f-80e2-58250bffed1c" (UID: "7d8fb183-b4e1-4d1f-80e2-58250bffed1c"). InnerVolumeSpecName "kube-api-access-kw575". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:47:59.643687 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.643633 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d8fb183-b4e1-4d1f-80e2-58250bffed1c" (UID: "7d8fb183-b4e1-4d1f-80e2-58250bffed1c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:47:59.742850 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.742807 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:47:59.742850 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.742845 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:47:59.742850 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:47:59.742854 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw575\" (UniqueName: \"kubernetes.io/projected/7d8fb183-b4e1-4d1f-80e2-58250bffed1c-kube-api-access-kw575\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:48:00.372082 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.372041 2572 generic.go:356] "Generic (PLEG): container finished" podID="7d8fb183-b4e1-4d1f-80e2-58250bffed1c" containerID="c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b" exitCode=0 Jul 13 21:48:00.372082 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.372081 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" Jul 13 21:48:00.372579 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.372091 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" event={"ID":"7d8fb183-b4e1-4d1f-80e2-58250bffed1c","Type":"ContainerDied","Data":"c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b"} Jul 13 21:48:00.372579 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.372150 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v" event={"ID":"7d8fb183-b4e1-4d1f-80e2-58250bffed1c","Type":"ContainerDied","Data":"7363bbd47f0953f731abdc7071559ef882bad5ce640f9b330134d8f42903c729"} Jul 13 21:48:00.372579 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.372172 2572 scope.go:117] "RemoveContainer" containerID="c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b" Jul 13 21:48:00.382352 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.382323 2572 scope.go:117] "RemoveContainer" containerID="c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b" Jul 13 21:48:00.382668 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:48:00.382645 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b\": container with ID starting with c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b not found: ID does not exist" containerID="c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b" Jul 13 21:48:00.382742 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.382678 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b"} err="failed to get container status \"c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b\": rpc error: code = NotFound desc = could not find container \"c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b\": container with ID starting with c1223355912d31b3cc702d848f887b8d8916037fb8fe03582d02c8eb6846bc7b not found: ID does not exist" Jul 13 21:48:00.395774 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.395734 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v"] Jul 13 21:48:00.400650 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.400618 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-459a1d-8948c7596-v8s2v"] Jul 13 21:48:00.807484 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:00.807449 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d8fb183-b4e1-4d1f-80e2-58250bffed1c" path="/var/lib/kubelet/pods/7d8fb183-b4e1-4d1f-80e2-58250bffed1c/volumes" Jul 13 21:48:24.956357 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:24.956312 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj"] Jul 13 21:48:24.956907 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:24.956592 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" podUID="6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" containerName="maas-api" containerID="cri-o://d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58" gracePeriod=30 Jul 13 21:48:25.215335 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.215263 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:48:25.277371 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.277330 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l2p7\" (UniqueName: \"kubernetes.io/projected/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-kube-api-access-5l2p7\") pod \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " Jul 13 21:48:25.277589 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.277387 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls\") pod \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " Jul 13 21:48:25.277589 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.277414 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-openshift-service-ca\") pod \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\" (UID: \"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7\") " Jul 13 21:48:25.277831 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.277808 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" (UID: "6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:48:25.279610 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.279577 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-kube-api-access-5l2p7" (OuterVolumeSpecName: "kube-api-access-5l2p7") pod "6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" (UID: "6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7"). InnerVolumeSpecName "kube-api-access-5l2p7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:48:25.279610 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.279587 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" (UID: "6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:48:25.378453 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.378409 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l2p7\" (UniqueName: \"kubernetes.io/projected/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-kube-api-access-5l2p7\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:48:25.378453 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.378444 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:48:25.378453 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.378456 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:48:25.512214 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.512180 2572 generic.go:356] "Generic (PLEG): container finished" podID="6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" containerID="d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58" exitCode=0 Jul 13 21:48:25.512395 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.512228 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" Jul 13 21:48:25.512395 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.512239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" event={"ID":"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7","Type":"ContainerDied","Data":"d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58"} Jul 13 21:48:25.512395 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.512283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj" event={"ID":"6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7","Type":"ContainerDied","Data":"6b334932736c33eb93301d2e04cbc0d79f8363c0bb6c3e1ad7d94dc25ad2111b"} Jul 13 21:48:25.512395 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.512303 2572 scope.go:117] "RemoveContainer" containerID="d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58" Jul 13 21:48:25.529561 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.529538 2572 scope.go:117] "RemoveContainer" containerID="d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58" Jul 13 21:48:25.529908 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:48:25.529883 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58\": container with ID starting with d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58 not found: ID does not exist" containerID="d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58" Jul 13 21:48:25.530034 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.529913 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58"} err="failed to get container status \"d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58\": rpc error: code = NotFound desc = could not find container \"d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58\": container with ID starting with d13a33e3162a223b818b5aa02029c03b29cf89fbfd744cb3cafe9648a4402a58 not found: ID does not exist" Jul 13 21:48:25.539816 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.539785 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj"] Jul 13 21:48:25.545719 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:25.545692 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7b2acc-986f84f4f-p6gmj"] Jul 13 21:48:26.806830 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:26.806794 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" path="/var/lib/kubelet/pods/6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7/volumes" Jul 13 21:48:44.209387 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.209351 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z"] Jul 13 21:48:44.209805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.209698 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" containerName="maas-api" Jul 13 21:48:44.209805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.209710 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" containerName="maas-api" Jul 13 21:48:44.209805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.209740 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8fb183-b4e1-4d1f-80e2-58250bffed1c" containerName="maas-api" Jul 13 21:48:44.209805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.209746 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8fb183-b4e1-4d1f-80e2-58250bffed1c" containerName="maas-api" Jul 13 21:48:44.209805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.209807 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8fb183-b4e1-4d1f-80e2-58250bffed1c" containerName="maas-api" Jul 13 21:48:44.209963 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.209815 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee7c66f-ce6f-4e84-bb80-91e2553ff0f7" containerName="maas-api" Jul 13 21:48:44.213069 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.213031 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.218476 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.218445 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-8139bf-serving-cert\"" Jul 13 21:48:44.226359 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.226324 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z"] Jul 13 21:48:44.346753 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.346703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4dd171-c9e9-428e-8b88-0a887959622c-maas-api-tls\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.346973 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.346795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snrr2\" (UniqueName: \"kubernetes.io/projected/6f4dd171-c9e9-428e-8b88-0a887959622c-kube-api-access-snrr2\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.346973 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.346833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4dd171-c9e9-428e-8b88-0a887959622c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.447901 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.447856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4dd171-c9e9-428e-8b88-0a887959622c-maas-api-tls\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.448162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.447927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snrr2\" (UniqueName: \"kubernetes.io/projected/6f4dd171-c9e9-428e-8b88-0a887959622c-kube-api-access-snrr2\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.448162 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.447955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4dd171-c9e9-428e-8b88-0a887959622c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.448595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.448575 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4dd171-c9e9-428e-8b88-0a887959622c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.450694 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.450669 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4dd171-c9e9-428e-8b88-0a887959622c-maas-api-tls\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.456715 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.456685 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snrr2\" (UniqueName: \"kubernetes.io/projected/6f4dd171-c9e9-428e-8b88-0a887959622c-kube-api-access-snrr2\") pod \"maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.526304 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.526264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:44.669765 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:44.669735 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z"] Jul 13 21:48:44.671958 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:48:44.671932 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4dd171_c9e9_428e_8b88_0a887959622c.slice/crio-9af69dbfce2adbc26e4b20c079075628b29caa334dc4e209f1a5ea10bc471edc WatchSource:0}: Error finding container 9af69dbfce2adbc26e4b20c079075628b29caa334dc4e209f1a5ea10bc471edc: Status 404 returned error can't find the container with id 9af69dbfce2adbc26e4b20c079075628b29caa334dc4e209f1a5ea10bc471edc Jul 13 21:48:45.620668 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:45.620628 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" event={"ID":"6f4dd171-c9e9-428e-8b88-0a887959622c","Type":"ContainerStarted","Data":"0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e"} Jul 13 21:48:45.621128 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:45.620708 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" event={"ID":"6f4dd171-c9e9-428e-8b88-0a887959622c","Type":"ContainerStarted","Data":"9af69dbfce2adbc26e4b20c079075628b29caa334dc4e209f1a5ea10bc471edc"} Jul 13 21:48:45.621128 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:45.620774 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:45.636726 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:45.636672 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" podStartSLOduration=1.183014218 podStartE2EDuration="1.636656195s" totalImagesPullingTime="453.641977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:48:45.636193619 +0000 UTC m=+2259.393413087" watchObservedRunningTime="2026-07-13 21:48:45.636656195 +0000 UTC m=+2259.393875677" Jul 13 21:48:51.632178 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:51.632142 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:48:52.387914 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.382324 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6"] Jul 13 21:48:52.389359 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.389326 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.392060 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.392033 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-6c68d6-serving-cert\"" Jul 13 21:48:52.396113 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.396090 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6"] Jul 13 21:48:52.518690 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.518653 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsk7z\" (UniqueName: \"kubernetes.io/projected/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-kube-api-access-hsk7z\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.518690 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.518695 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-maas-api-tls\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.519151 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.518833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.619847 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.619808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.620084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.619861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsk7z\" (UniqueName: \"kubernetes.io/projected/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-kube-api-access-hsk7z\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.620084 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.619886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-maas-api-tls\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.620481 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.620460 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.622269 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.622251 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-maas-api-tls\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.628080 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.628059 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsk7z\" (UniqueName: \"kubernetes.io/projected/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-kube-api-access-hsk7z\") pod \"maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.702611 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.702513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:52.844887 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:52.844853 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6"] Jul 13 21:48:52.846488 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:48:52.846448 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b1baa7_329d_4a2a_8bc6_e50b4c9cca06.slice/crio-32c4704bcceb75c06c0e7ffa76239b4418837899194471573b79716be82338de WatchSource:0}: Error finding container 32c4704bcceb75c06c0e7ffa76239b4418837899194471573b79716be82338de: Status 404 returned error can't find the container with id 32c4704bcceb75c06c0e7ffa76239b4418837899194471573b79716be82338de Jul 13 21:48:53.664884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:53.664793 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" event={"ID":"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06","Type":"ContainerStarted","Data":"e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2"} Jul 13 21:48:53.664884 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:53.664853 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" event={"ID":"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06","Type":"ContainerStarted","Data":"32c4704bcceb75c06c0e7ffa76239b4418837899194471573b79716be82338de"} Jul 13 21:48:53.665097 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:53.665025 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:48:53.681561 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:53.681510 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" podStartSLOduration=1.186259207 podStartE2EDuration="1.68149236s" totalImagesPullingTime="495.233153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:48:53.680064389 +0000 UTC m=+2267.437283857" watchObservedRunningTime="2026-07-13 21:48:53.68149236 +0000 UTC m=+2267.438711826" Jul 13 21:48:59.676151 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:48:59.676119 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:51:06.908870 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:51:06.908841 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:51:06.916621 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:51:06.916596 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:51:06.920760 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:51:06.920738 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:51:06.928287 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:51:06.928261 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:54:37.855165 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:37.855058 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z"] Jul 13 21:54:37.857861 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:37.855327 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" podUID="6f4dd171-c9e9-428e-8b88-0a887959622c" containerName="maas-api" containerID="cri-o://0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e" gracePeriod=30 Jul 13 21:54:38.311449 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.311416 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:54:38.369231 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.369195 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snrr2\" (UniqueName: \"kubernetes.io/projected/6f4dd171-c9e9-428e-8b88-0a887959622c-kube-api-access-snrr2\") pod \"6f4dd171-c9e9-428e-8b88-0a887959622c\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " Jul 13 21:54:38.369430 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.369295 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4dd171-c9e9-428e-8b88-0a887959622c-maas-api-tls\") pod \"6f4dd171-c9e9-428e-8b88-0a887959622c\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " Jul 13 21:54:38.369430 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.369322 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4dd171-c9e9-428e-8b88-0a887959622c-openshift-service-ca\") pod \"6f4dd171-c9e9-428e-8b88-0a887959622c\" (UID: \"6f4dd171-c9e9-428e-8b88-0a887959622c\") " Jul 13 21:54:38.369745 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.369714 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f4dd171-c9e9-428e-8b88-0a887959622c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f4dd171-c9e9-428e-8b88-0a887959622c" (UID: "6f4dd171-c9e9-428e-8b88-0a887959622c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:54:38.371434 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.371399 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f4dd171-c9e9-428e-8b88-0a887959622c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f4dd171-c9e9-428e-8b88-0a887959622c" (UID: "6f4dd171-c9e9-428e-8b88-0a887959622c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:54:38.371434 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.371414 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4dd171-c9e9-428e-8b88-0a887959622c-kube-api-access-snrr2" (OuterVolumeSpecName: "kube-api-access-snrr2") pod "6f4dd171-c9e9-428e-8b88-0a887959622c" (UID: "6f4dd171-c9e9-428e-8b88-0a887959622c"). InnerVolumeSpecName "kube-api-access-snrr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:54:38.470511 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.470416 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snrr2\" (UniqueName: \"kubernetes.io/projected/6f4dd171-c9e9-428e-8b88-0a887959622c-kube-api-access-snrr2\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:54:38.470511 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.470448 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4dd171-c9e9-428e-8b88-0a887959622c-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:54:38.470511 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.470458 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4dd171-c9e9-428e-8b88-0a887959622c-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:54:38.530393 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.530357 2572 generic.go:356] "Generic (PLEG): container finished" podID="6f4dd171-c9e9-428e-8b88-0a887959622c" containerID="0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e" exitCode=0 Jul 13 21:54:38.530570 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.530410 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" Jul 13 21:54:38.530570 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.530440 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" event={"ID":"6f4dd171-c9e9-428e-8b88-0a887959622c","Type":"ContainerDied","Data":"0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e"} Jul 13 21:54:38.530570 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.530498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z" event={"ID":"6f4dd171-c9e9-428e-8b88-0a887959622c","Type":"ContainerDied","Data":"9af69dbfce2adbc26e4b20c079075628b29caa334dc4e209f1a5ea10bc471edc"} Jul 13 21:54:38.530570 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.530522 2572 scope.go:117] "RemoveContainer" containerID="0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e" Jul 13 21:54:38.540900 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.540878 2572 scope.go:117] "RemoveContainer" containerID="0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e" Jul 13 21:54:38.541243 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:54:38.541220 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e\": container with ID starting with 0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e not found: ID does not exist" containerID="0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e" Jul 13 21:54:38.541318 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.541254 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e"} err="failed to get container status \"0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e\": rpc error: code = NotFound desc = could not find container \"0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e\": container with ID starting with 0571d9bfb4e907f876ce098f5379dbe7cb25085993fdf0cde569f37f11de2a2e not found: ID does not exist" Jul 13 21:54:38.552514 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.552475 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z"] Jul 13 21:54:38.555972 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.555934 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8139bf-67cfb94dd6-gk28z"] Jul 13 21:54:38.806827 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:54:38.806789 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f4dd171-c9e9-428e-8b88-0a887959622c" path="/var/lib/kubelet/pods/6f4dd171-c9e9-428e-8b88-0a887959622c/volumes" Jul 13 21:55:04.174765 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.174722 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6"] Jul 13 21:55:04.175198 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.174954 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" podUID="76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" containerName="maas-api" containerID="cri-o://e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2" gracePeriod=30 Jul 13 21:55:04.427919 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.427847 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:55:04.500504 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.500465 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-maas-api-tls\") pod \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " Jul 13 21:55:04.500708 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.500568 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsk7z\" (UniqueName: \"kubernetes.io/projected/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-kube-api-access-hsk7z\") pod \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " Jul 13 21:55:04.500708 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.500602 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-openshift-service-ca\") pod \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\" (UID: \"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06\") " Jul 13 21:55:04.501046 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.501021 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" (UID: "76b1baa7-329d-4a2a-8bc6-e50b4c9cca06"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 21:55:04.502734 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.502701 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" (UID: "76b1baa7-329d-4a2a-8bc6-e50b4c9cca06"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 21:55:04.502843 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.502736 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-kube-api-access-hsk7z" (OuterVolumeSpecName: "kube-api-access-hsk7z") pod "76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" (UID: "76b1baa7-329d-4a2a-8bc6-e50b4c9cca06"). InnerVolumeSpecName "kube-api-access-hsk7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 21:55:04.602347 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.602308 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-maas-api-tls\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:55:04.602347 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.602342 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsk7z\" (UniqueName: \"kubernetes.io/projected/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-kube-api-access-hsk7z\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:55:04.602347 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.602353 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06-openshift-service-ca\") on node \"ip-10-0-136-160.ec2.internal\" DevicePath \"\"" Jul 13 21:55:04.674454 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.674415 2572 generic.go:356] "Generic (PLEG): container finished" podID="76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" containerID="e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2" exitCode=0 Jul 13 21:55:04.674658 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.674469 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" Jul 13 21:55:04.674658 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.674499 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" event={"ID":"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06","Type":"ContainerDied","Data":"e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2"} Jul 13 21:55:04.674658 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.674558 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6" event={"ID":"76b1baa7-329d-4a2a-8bc6-e50b4c9cca06","Type":"ContainerDied","Data":"32c4704bcceb75c06c0e7ffa76239b4418837899194471573b79716be82338de"} Jul 13 21:55:04.674658 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.674597 2572 scope.go:117] "RemoveContainer" containerID="e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2" Jul 13 21:55:04.684847 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.684827 2572 scope.go:117] "RemoveContainer" containerID="e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2" Jul 13 21:55:04.685210 ip-10-0-136-160 kubenswrapper[2572]: E0713 21:55:04.685189 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2\": container with ID starting with e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2 not found: ID does not exist" containerID="e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2" Jul 13 21:55:04.685266 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.685222 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2"} err="failed to get container status \"e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2\": rpc error: code = NotFound desc = could not find container \"e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2\": container with ID starting with e2531d347a7472a04fbb7512e4288767a2e21eb4a30518ba29c74b3570c943e2 not found: ID does not exist" Jul 13 21:55:04.697910 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.697874 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6"] Jul 13 21:55:04.704307 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.704271 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6c68d6-7d8959dfb5-2wsj6"] Jul 13 21:55:04.805978 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:04.805937 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" path="/var/lib/kubelet/pods/76b1baa7-329d-4a2a-8bc6-e50b4c9cca06/volumes" Jul 13 21:55:25.842171 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:25.842135 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd76fcbc5-df78l_2cb539ff-df7c-4f32-aead-b28e6b3f7920/copy-manifests/0.log" Jul 13 21:55:25.849596 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:25.849559 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd76fcbc5-df78l_2cb539ff-df7c-4f32-aead-b28e6b3f7920/manager/0.log" Jul 13 21:55:26.325323 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:26.325286 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-75f678d9f-wd99f_218a1534-7ae4-424d-a4a2-7a0598de659d/maas-api/0.log" Jul 13 21:55:27.218643 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:27.218609 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-749717-64jq9_8c8a47c3-bf40-48d9-9516-ea16790441e1/revoke-keys/0.log" Jul 13 21:55:27.437979 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:27.437949 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-737411d0-bpnpc_98d70986-4991-443a-8ce4-9e23d1c11349/revoke-keys/1.log" Jul 13 21:55:28.023623 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:28.023592 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6jflc_9dcd58ec-941b-47b0-86d6-5d78e8dd5869/postgres/0.log" Jul 13 21:55:28.796858 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:28.796820 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q_548c5568-8459-426f-b804-048d29e612fd/util/0.log" Jul 13 21:55:28.803628 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:28.803591 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q_548c5568-8459-426f-b804-048d29e612fd/pull/0.log" Jul 13 21:55:28.809954 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:28.809931 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q_548c5568-8459-426f-b804-048d29e612fd/extract/0.log" Jul 13 21:55:28.920467 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:28.920438 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7_07e916e0-5017-4d92-9c2e-0ef10ea00e49/util/0.log" Jul 13 21:55:28.927407 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:28.927378 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7_07e916e0-5017-4d92-9c2e-0ef10ea00e49/pull/0.log" Jul 13 21:55:28.934724 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:28.934697 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7_07e916e0-5017-4d92-9c2e-0ef10ea00e49/extract/0.log" Jul 13 21:55:29.042539 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:29.042513 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf_239044cd-dffb-4534-ad8f-cee56f3218a7/util/0.log" Jul 13 21:55:29.048805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:29.048747 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf_239044cd-dffb-4534-ad8f-cee56f3218a7/pull/0.log" Jul 13 21:55:29.054820 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:29.054797 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf_239044cd-dffb-4534-ad8f-cee56f3218a7/extract/0.log" Jul 13 21:55:29.166103 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:29.166079 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf_c686c4df-c581-4d1d-bb7b-cb8b175024f7/pull/0.log" Jul 13 21:55:29.172862 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:29.172841 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf_c686c4df-c581-4d1d-bb7b-cb8b175024f7/extract/0.log" Jul 13 21:55:29.180110 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:29.180084 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf_c686c4df-c581-4d1d-bb7b-cb8b175024f7/util/0.log" Jul 13 21:55:30.595045 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:30.594988 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5wqmz_1b362f14-9725-4e52-8404-32bcf18e63c7/discovery/0.log" Jul 13 21:55:31.208171 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:31.208135 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k5ftx_2ea566d8-69c0-4933-a812-9030b0d7b055/payload-processing/0.log" Jul 13 21:55:31.324543 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:31.324514 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648d4b6868-z7k6f_9425fe2f-9987-418e-b031-6fa26d109a53/router/0.log" Jul 13 21:55:31.793354 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:31.793322 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7wjd8_e7e68dfe-1948-47e0-8fd9-d3aedf9753ea/main/0.log" Jul 13 21:55:32.012717 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:32.012684 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrpb4d_8912154b-85cf-4133-bd4d-43217e13e32e/main/0.log" Jul 13 21:55:39.210956 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:39.210889 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vmb6b_c52b4863-bb7b-4548-bb4b-7b1d44cc55b2/global-pull-secret-syncer/0.log" Jul 13 21:55:39.325823 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:39.325784 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vq8n7_010744c3-a370-44db-bf22-df19d606d9f5/konnectivity-agent/0.log" Jul 13 21:55:39.369423 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:39.369389 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-160.ec2.internal_1d6f08ebb51da33ba85c19409801495d/haproxy/0.log" Jul 13 21:55:43.746110 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.746083 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q_548c5568-8459-426f-b804-048d29e612fd/extract/0.log" Jul 13 21:55:43.778444 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.778405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q_548c5568-8459-426f-b804-048d29e612fd/util/0.log" Jul 13 21:55:43.799238 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.799206 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ljt9q_548c5568-8459-426f-b804-048d29e612fd/pull/0.log" Jul 13 21:55:43.831216 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.831185 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7_07e916e0-5017-4d92-9c2e-0ef10ea00e49/extract/0.log" Jul 13 21:55:43.853133 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.853104 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7_07e916e0-5017-4d92-9c2e-0ef10ea00e49/util/0.log" Jul 13 21:55:43.877533 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.877501 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09vwz7_07e916e0-5017-4d92-9c2e-0ef10ea00e49/pull/0.log" Jul 13 21:55:43.908383 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.908352 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf_239044cd-dffb-4534-ad8f-cee56f3218a7/extract/0.log" Jul 13 21:55:43.940445 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.940417 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf_239044cd-dffb-4534-ad8f-cee56f3218a7/util/0.log" Jul 13 21:55:43.962435 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.962407 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nthrf_239044cd-dffb-4534-ad8f-cee56f3218a7/pull/0.log" Jul 13 21:55:43.989224 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:43.989192 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf_c686c4df-c581-4d1d-bb7b-cb8b175024f7/extract/0.log" Jul 13 21:55:44.012385 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:44.012305 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf_c686c4df-c581-4d1d-bb7b-cb8b175024f7/util/0.log" Jul 13 21:55:44.036078 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:44.036048 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6ttf_c686c4df-c581-4d1d-bb7b-cb8b175024f7/pull/0.log" Jul 13 21:55:46.850032 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:46.849937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-97bg5_326776ac-7b7a-427c-878b-717eb09a6c44/cluster-monitoring-operator/0.log" Jul 13 21:55:47.001628 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:47.001598 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6htp2_55cf2240-4c52-4632-a54a-d570118687d4/node-exporter/0.log" Jul 13 21:55:47.024032 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:47.023981 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6htp2_55cf2240-4c52-4632-a54a-d570118687d4/kube-rbac-proxy/0.log" Jul 13 21:55:47.049023 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:47.048988 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6htp2_55cf2240-4c52-4632-a54a-d570118687d4/init-textfile/0.log" Jul 13 21:55:48.885601 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:48.885573 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-4gngg_ff778486-44a6-4b83-b1eb-b4814c28c962/networking-console-plugin/0.log" Jul 13 21:55:49.256351 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.256310 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp"] Jul 13 21:55:49.256805 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.256780 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4dd171-c9e9-428e-8b88-0a887959622c" containerName="maas-api" Jul 13 21:55:49.256900 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.256808 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4dd171-c9e9-428e-8b88-0a887959622c" containerName="maas-api" Jul 13 21:55:49.256900 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.256829 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" containerName="maas-api" Jul 13 21:55:49.256900 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.256838 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" containerName="maas-api" Jul 13 21:55:49.257097 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.256947 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4dd171-c9e9-428e-8b88-0a887959622c" containerName="maas-api" Jul 13 21:55:49.257097 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.256965 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="76b1baa7-329d-4a2a-8bc6-e50b4c9cca06" containerName="maas-api" Jul 13 21:55:49.260187 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.260161 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.262595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.262568 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59z9w\"/\"openshift-service-ca.crt\"" Jul 13 21:55:49.262595 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.262581 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-59z9w\"/\"default-dockercfg-lj8pz\"" Jul 13 21:55:49.263555 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.263539 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59z9w\"/\"kube-root-ca.crt\"" Jul 13 21:55:49.270219 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.270187 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp"] Jul 13 21:55:49.385748 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.385705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-lib-modules\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.385937 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.385760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-sys\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.385937 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.385832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-podres\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.385937 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.385877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-proc\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.385937 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.385894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ljg5\" (UniqueName: \"kubernetes.io/projected/29c37885-767c-4e92-93ae-096c432f232f-kube-api-access-2ljg5\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487213 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487174 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-sys\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487225 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-podres\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487316 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-sys\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487334 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-podres\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-proc\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ljg5\" (UniqueName: \"kubernetes.io/projected/29c37885-767c-4e92-93ae-096c432f232f-kube-api-access-2ljg5\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487688 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487464 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-proc\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487688 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487496 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-lib-modules\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.487688 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.487597 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29c37885-767c-4e92-93ae-096c432f232f-lib-modules\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.495013 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.494969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ljg5\" (UniqueName: \"kubernetes.io/projected/29c37885-767c-4e92-93ae-096c432f232f-kube-api-access-2ljg5\") pod \"perf-node-gather-daemonset-tbgkp\" (UID: \"29c37885-767c-4e92-93ae-096c432f232f\") " pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.552789 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.552706 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:55:49.557853 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.557823 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/2.log" Jul 13 21:55:49.572376 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.572341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.712446 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.712419 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp"] Jul 13 21:55:49.714687 ip-10-0-136-160 kubenswrapper[2572]: W0713 21:55:49.714662 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29c37885_767c_4e92_93ae_096c432f232f.slice/crio-6b0cb5eeeecf9d68882007fe199e15793bb30ca3e94a8d83e099cc1a4e3c4f9a WatchSource:0}: Error finding container 6b0cb5eeeecf9d68882007fe199e15793bb30ca3e94a8d83e099cc1a4e3c4f9a: Status 404 returned error can't find the container with id 6b0cb5eeeecf9d68882007fe199e15793bb30ca3e94a8d83e099cc1a4e3c4f9a Jul 13 21:55:49.908955 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.908919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" event={"ID":"29c37885-767c-4e92-93ae-096c432f232f","Type":"ContainerStarted","Data":"456fe3b5b5f2b902b0a9336002cfbd0fbdb4fa492a3beabfec00709bc5de0aaa"} Jul 13 21:55:49.909616 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.908985 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" event={"ID":"29c37885-767c-4e92-93ae-096c432f232f","Type":"ContainerStarted","Data":"6b0cb5eeeecf9d68882007fe199e15793bb30ca3e94a8d83e099cc1a4e3c4f9a"} Jul 13 21:55:49.909616 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.909047 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:49.923794 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:49.923742 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" podStartSLOduration=0.923723614 podStartE2EDuration="923.723614ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:55:49.923243557 +0000 UTC m=+2683.680463024" watchObservedRunningTime="2026-07-13 21:55:49.923723614 +0000 UTC m=+2683.680943119" Jul 13 21:55:50.155675 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:50.155583 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-26fl7_b79570b6-4af0-4959-95e5-9088fc3ae678/download-server/0.log" Jul 13 21:55:50.789832 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:50.789802 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-sjwnm_88d8ae4b-64db-4023-874e-59fd9547cf03/volume-data-source-validator/0.log" Jul 13 21:55:51.866803 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:51.866773 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lzs6b_e9fec4af-edef-4537-b2fe-5294b79ed89b/dns/0.log" Jul 13 21:55:51.886969 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:51.886930 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lzs6b_e9fec4af-edef-4537-b2fe-5294b79ed89b/kube-rbac-proxy/0.log" Jul 13 21:55:51.908553 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:51.908524 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6g59z_879b543e-ae6b-47c9-a437-7b6cf22ce7d8/dns-node-resolver/0.log" Jul 13 21:55:52.495547 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:52.495513 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-glv2s_a727b5bb-2e2e-452a-af07-263e377a4c65/node-ca/0.log" Jul 13 21:55:53.543907 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:53.543871 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5wqmz_1b362f14-9725-4e52-8404-32bcf18e63c7/discovery/0.log" Jul 13 21:55:53.736854 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:53.736822 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k5ftx_2ea566d8-69c0-4933-a812-9030b0d7b055/payload-processing/0.log" Jul 13 21:55:53.758509 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:53.758482 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648d4b6868-z7k6f_9425fe2f-9987-418e-b031-6fa26d109a53/router/0.log" Jul 13 21:55:54.480836 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:54.480810 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4c6t_76764d8f-c777-4838-aadf-459e551e821a/serve-healthcheck-canary/0.log" Jul 13 21:55:54.913587 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:54.913551 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6nwhm_529b7467-81c9-4887-9e8c-8992a1d76c16/insights-operator/0.log" Jul 13 21:55:54.913999 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:54.913811 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6nwhm_529b7467-81c9-4887-9e8c-8992a1d76c16/insights-operator/1.log" Jul 13 21:55:54.933426 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:54.933402 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5qzp7_db658736-ac46-440e-96d2-65c1365bb9b4/kube-rbac-proxy/0.log" Jul 13 21:55:54.954697 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:54.954673 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5qzp7_db658736-ac46-440e-96d2-65c1365bb9b4/exporter/0.log" Jul 13 21:55:54.974543 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:54.974516 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5qzp7_db658736-ac46-440e-96d2-65c1365bb9b4/extractor/0.log" Jul 13 21:55:55.925699 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:55.925671 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-59z9w/perf-node-gather-daemonset-tbgkp" Jul 13 21:55:57.723066 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:57.723033 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd76fcbc5-df78l_2cb539ff-df7c-4f32-aead-b28e6b3f7920/manager/0.log" Jul 13 21:55:57.742760 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:57.742733 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd76fcbc5-df78l_2cb539ff-df7c-4f32-aead-b28e6b3f7920/copy-manifests/0.log" Jul 13 21:55:58.938855 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:58.938779 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-575f94fb69-8b74f_44faa201-8946-4e02-b159-fe24d60d617b/manager/0.log" Jul 13 21:55:58.998985 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:58.998956 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dt9pk_151147b9-c1d1-46f6-a1f1-2d0ad231174e/openshift-lws-operator/0.log" Jul 13 21:55:59.890635 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:55:59.890550 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5wqmz_1b362f14-9725-4e52-8404-32bcf18e63c7/discovery/0.log" Jul 13 21:56:00.061044 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:00.060993 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k5ftx_2ea566d8-69c0-4933-a812-9030b0d7b055/payload-processing/0.log" Jul 13 21:56:00.076977 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:00.076946 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648d4b6868-z7k6f_9425fe2f-9987-418e-b031-6fa26d109a53/router/0.log" Jul 13 21:56:01.423577 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:01.423544 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5wqmz_1b362f14-9725-4e52-8404-32bcf18e63c7/discovery/0.log" Jul 13 21:56:01.589023 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:01.588972 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k5ftx_2ea566d8-69c0-4933-a812-9030b0d7b055/payload-processing/0.log" Jul 13 21:56:01.608759 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:01.608730 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648d4b6868-z7k6f_9425fe2f-9987-418e-b031-6fa26d109a53/router/0.log" Jul 13 21:56:04.655242 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:04.655212 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-49b7n_59099ed0-78cd-4277-9bf9-4680ad390448/kube-storage-version-migrator-operator/1.log" Jul 13 21:56:04.656472 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:04.656442 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-49b7n_59099ed0-78cd-4277-9bf9-4680ad390448/kube-storage-version-migrator-operator/0.log" Jul 13 21:56:05.885781 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:05.885745 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw94l_f065e8ba-445e-42f0-8e97-1723a3402498/kube-multus-additional-cni-plugins/0.log" Jul 13 21:56:05.906597 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:05.906563 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw94l_f065e8ba-445e-42f0-8e97-1723a3402498/egress-router-binary-copy/0.log" Jul 13 21:56:05.929205 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:05.929179 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw94l_f065e8ba-445e-42f0-8e97-1723a3402498/cni-plugins/0.log" Jul 13 21:56:05.948968 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:05.948940 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw94l_f065e8ba-445e-42f0-8e97-1723a3402498/bond-cni-plugin/0.log" Jul 13 21:56:05.972099 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:05.972069 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw94l_f065e8ba-445e-42f0-8e97-1723a3402498/routeoverride-cni/0.log" Jul 13 21:56:05.998676 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:05.998632 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw94l_f065e8ba-445e-42f0-8e97-1723a3402498/whereabouts-cni-bincopy/0.log" Jul 13 21:56:06.018679 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:06.018650 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw94l_f065e8ba-445e-42f0-8e97-1723a3402498/whereabouts-cni/0.log" Jul 13 21:56:06.199036 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:06.198944 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ch59v_34e022a7-7f94-497c-9a95-6407f947e4eb/kube-multus/0.log" Jul 13 21:56:06.259893 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:06.259865 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dhdrv_0f490020-e5a6-4a78-a256-55354cd3050a/network-metrics-daemon/0.log" Jul 13 21:56:06.279542 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:06.279508 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dhdrv_0f490020-e5a6-4a78-a256-55354cd3050a/kube-rbac-proxy/0.log" Jul 13 21:56:06.942286 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:06.942253 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:56:06.950364 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:06.950339 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:56:06.956692 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:06.956666 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cd8gg_76c22c6f-0ed5-477a-a251-9db873499e6c/console-operator/1.log" Jul 13 21:56:06.963970 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:06.963945 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:56:07.728129 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:07.728097 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-controller/0.log" Jul 13 21:56:07.760414 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:07.760386 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/1.log" Jul 13 21:56:07.760414 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:07.760401 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovn-acl-logging/0.log" Jul 13 21:56:07.789990 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:07.789947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/kube-rbac-proxy-node/0.log" Jul 13 21:56:07.833827 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:07.833796 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/kube-rbac-proxy-ovn-metrics/0.log" Jul 13 21:56:07.867564 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:07.867518 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/northd/0.log" Jul 13 21:56:07.905030 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:07.904974 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/nbdb/0.log" Jul 13 21:56:07.947424 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:07.947393 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/sbdb/0.log" Jul 13 21:56:08.014137 ip-10-0-136-160 kubenswrapper[2572]: I0713 21:56:08.014107 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq5hl_81f42c7f-f2fc-4fd1-b1a8-19122a5e5fad/ovnkube-controller/0.log"