Jul 14 00:42:05.573500 ip-10-0-131-60 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 00:42:05.573515 ip-10-0-131-60 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 00:42:05.573526 ip-10-0-131-60 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 00:42:05.573856 ip-10-0-131-60 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 00:42:15.698276 ip-10-0-131-60 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 00:42:15.698293 ip-10-0-131-60 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9bf06022cfb848f3bc5495849845b987 -- Jul 14 00:44:06.419358 ip-10-0-131-60 systemd[1]: Starting Kubernetes Kubelet... Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.722057 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728166 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728180 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728183 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728187 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728189 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728192 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728195 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:44:06.788883 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728198 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728200 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728203 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728207 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728212 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728215 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728218 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728221 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728224 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728226 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728229 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728232 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728234 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728237 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728240 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728242 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728246 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728249 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728251 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728254 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:44:06.789822 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728257 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728260 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728262 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728265 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728275 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728277 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728280 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728283 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728286 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728288 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728291 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728294 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728296 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728301 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728304 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728307 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728310 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728313 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728316 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:44:06.790418 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728319 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728321 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728325 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728328 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728337 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728340 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728343 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728346 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728349 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728352 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728355 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728358 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728360 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728363 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728365 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728368 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728370 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728372 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728375 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728378 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:44:06.791078 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728382 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728386 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728388 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728391 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728394 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728396 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728399 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728401 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728404 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728406 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728409 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728412 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728414 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728417 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728419 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728421 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728425 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728428 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728430 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728433 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:44:06.791777 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728435 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:44:06.792393 ip-10-0-131-60 systemd[1]: Started Kubernetes Kubelet. Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728438 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728441 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728443 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728446 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728448 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728450 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728453 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728456 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728459 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728461 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728464 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.728466 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729159 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729166 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729169 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729172 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729175 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729178 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729181 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:44:06.792799 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729184 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729186 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729189 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729191 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729194 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729196 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729199 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729201 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729204 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729206 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729209 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729212 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729214 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729217 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729221 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729225 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729228 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729232 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:44:06.793703 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729235 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729238 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729241 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729244 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729247 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729250 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729253 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729257 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729260 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729263 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729266 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729269 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729272 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729275 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729277 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729280 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729283 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729285 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729288 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729290 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:44:06.794570 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729293 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729296 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729298 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729301 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729303 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729307 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729309 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729311 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729314 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729317 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729319 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729322 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729324 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729327 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729330 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729332 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729335 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729338 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729341 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729344 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:44:06.795270 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729346 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729351 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729355 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729358 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729361 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729363 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729366 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729368 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729371 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729374 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729376 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729379 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729381 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729384 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729386 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729389 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729391 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729394 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729397 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729399 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:44:06.796095 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729402 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729405 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729407 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729410 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729413 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729415 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729418 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729420 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729422 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729425 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729428 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729430 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729433 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729437 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729812 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729818 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729822 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729825 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729828 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729830 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:44:06.796794 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729833 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729836 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729838 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729841 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729844 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729847 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729849 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729852 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729854 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729856 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729860 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729862 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729865 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729868 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729870 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729873 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729875 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729878 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729880 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:44:06.964580 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729883 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729886 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729889 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729892 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729895 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729897 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729902 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729904 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729907 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729909 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729912 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729914 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729917 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729919 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729922 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729924 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729927 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729929 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729932 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729934 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:44:06.985869 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729937 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729939 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729942 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729944 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729948 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729952 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729956 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729958 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729961 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729964 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729967 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729970 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729972 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729978 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729982 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729985 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729988 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729991 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729994 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:44:06.986983 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729997 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.729999 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730002 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730004 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730007 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730009 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730012 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730014 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730017 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730019 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730022 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730024 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730026 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730029 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730031 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730034 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730036 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730039 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730042 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730045 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:44:06.987728 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730047 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730050 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730052 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730055 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730057 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730060 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730062 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730084 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730087 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730090 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730093 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730097 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730099 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730102 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730105 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730168 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730175 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730181 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730185 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730189 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730192 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730196 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 00:44:06.988649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730200 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730203 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730206 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730209 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730212 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730216 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730219 2575 flags.go:64] FLAG: --cgroup-root="" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730221 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730224 2575 flags.go:64] FLAG: --client-ca-file="" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730228 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730231 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730235 2575 flags.go:64] FLAG: --cluster-domain="" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730238 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730241 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730244 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730247 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730251 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730254 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730257 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730260 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730263 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730267 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730270 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730273 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 00:44:06.989403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730276 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730284 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730287 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730290 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730293 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730296 2575 flags.go:64] FLAG: --enable-server="true" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730299 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730302 2575 flags.go:64] FLAG: --event-burst="100" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730306 2575 flags.go:64] FLAG: --event-qps="50" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730308 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730311 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730314 2575 flags.go:64] FLAG: --eviction-hard="" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730318 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730321 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730324 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730327 2575 flags.go:64] FLAG: --eviction-soft="" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730330 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730333 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730336 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730339 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730342 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730344 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730347 2575 flags.go:64] FLAG: --feature-gates="" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730351 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730354 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 00:44:06.990396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730357 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730360 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730363 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730365 2575 flags.go:64] FLAG: --help="false" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730370 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-131-60.ec2.internal" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730373 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730376 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730378 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730383 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730386 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730389 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730392 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730395 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730398 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730401 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730404 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730406 2575 flags.go:64] FLAG: --kube-reserved="" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730409 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730412 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730415 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730418 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730421 2575 flags.go:64] FLAG: --lock-file="" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730424 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730426 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 00:44:06.991345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730429 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730435 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730438 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730441 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730443 2575 flags.go:64] FLAG: --logging-format="text" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730446 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730450 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730452 2575 flags.go:64] FLAG: --manifest-url="" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730455 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730459 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730462 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730466 2575 flags.go:64] FLAG: --max-pods="110" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730470 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730473 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730476 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730479 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730483 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730486 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730489 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730496 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730499 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730502 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730505 2575 flags.go:64] FLAG: --pod-cidr="" Jul 14 00:44:06.992346 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730508 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730513 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730516 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730519 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730522 2575 flags.go:64] FLAG: --port="10250" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730525 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730528 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d148f9c55a2d0bb" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730531 2575 flags.go:64] FLAG: --qos-reserved="" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730534 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730537 2575 flags.go:64] FLAG: --register-node="true" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730541 2575 flags.go:64] FLAG: --register-with-taints="" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730544 2575 flags.go:64] FLAG: --registry-burst="10" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730547 2575 flags.go:64] FLAG: --registry-qps="5" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730550 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730553 2575 flags.go:64] FLAG: --reserved-memory="" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730557 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730560 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730562 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730565 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730568 2575 flags.go:64] FLAG: --runonce="false" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730571 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730576 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730579 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730582 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730586 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730589 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 00:44:06.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730593 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730597 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730600 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730603 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730606 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730609 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730612 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730615 2575 flags.go:64] FLAG: --system-cgroups="" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730618 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730623 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730625 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730628 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730632 2575 flags.go:64] FLAG: --tls-min-version="" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730635 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730638 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730640 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730643 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730646 2575 flags.go:64] FLAG: --v="2" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730650 2575 flags.go:64] FLAG: --version="false" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730654 2575 flags.go:64] FLAG: --vmodule="" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730658 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.730661 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730770 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730774 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:44:06.994086 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730777 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730780 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730783 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730787 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730790 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730792 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730795 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730797 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730801 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730804 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730806 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730809 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730812 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730814 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730817 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730819 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730822 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730825 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730828 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:44:06.995468 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730830 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730834 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730838 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730841 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730844 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730846 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730849 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730852 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730854 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730857 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730860 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730862 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730865 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730867 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730870 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730872 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730876 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730879 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730882 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:44:07.194077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730884 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730887 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730891 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730893 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730896 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730899 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730901 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730904 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730907 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730909 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730912 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730914 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730917 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730919 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730922 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730924 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730927 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730929 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730932 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730934 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:44:07.195441 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730937 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730939 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730942 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730945 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730947 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730951 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730954 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730957 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730960 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730964 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730967 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730970 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730973 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730976 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730980 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730983 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730986 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730989 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730992 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730994 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:44:07.197783 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.730998 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731000 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731003 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731006 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731009 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731012 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731015 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731017 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731020 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731022 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731025 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731027 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731030 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731032 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731035 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731038 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731041 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731044 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:44:07.198742 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.731048 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.731545 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.738583 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.738598 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.738616 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.738622 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738673 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738678 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738682 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738685 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738689 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738692 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738695 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738697 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738701 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:44:07.201942 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738703 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738706 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738708 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738711 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738713 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738716 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738719 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738721 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738724 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738726 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738729 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738732 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738734 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738737 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738740 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738743 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738745 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738748 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738751 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:44:07.202902 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738754 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738757 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738759 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738762 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738765 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738767 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738770 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738773 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738775 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738777 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738780 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738783 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738785 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738788 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738791 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738794 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738797 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738799 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738802 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738804 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:44:07.206625 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738807 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738809 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738812 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738814 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738817 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738820 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738823 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738825 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738829 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738833 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738836 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738839 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738841 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738844 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738847 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738850 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738852 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738855 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738858 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:44:07.207605 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738862 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738865 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738867 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738870 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738872 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738877 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738880 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738882 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738886 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738889 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738893 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738896 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738899 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738902 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738905 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738908 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738911 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738914 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738917 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:44:07.208589 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738920 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738923 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738925 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738928 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738932 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738934 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738937 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738940 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738942 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738945 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738948 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738951 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.738954 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.738959 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739062 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:44:07.212129 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739085 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739088 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739090 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739095 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739097 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739100 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739103 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739107 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739109 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739112 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739116 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739119 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739122 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739125 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739127 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739130 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739132 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739135 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739137 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:44:07.213077 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739140 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739143 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739145 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739148 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739150 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739153 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739155 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739158 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739161 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739164 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739166 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739169 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739171 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739174 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739176 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739179 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739183 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739186 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739188 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739191 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:44:07.214030 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739194 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739197 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739200 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739202 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739204 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739207 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739210 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739213 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739215 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739218 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739220 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739223 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739225 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739228 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739231 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739233 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739236 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739238 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739241 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739243 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:44:07.216162 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739246 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739248 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739251 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739253 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739256 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739258 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739261 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739263 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739267 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739270 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739272 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739275 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739278 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739281 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739283 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739286 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739288 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739291 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739293 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:44:07.217105 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739296 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739314 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739319 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739322 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739325 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739328 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739331 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739333 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739336 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739340 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739343 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739346 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739349 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739352 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739355 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739358 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739361 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739364 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739367 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:44:07.219939 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:06.739369 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.739374 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.739463 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.741979 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.743004 2575 server.go:1019] "Starting client certificate rotation" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.743097 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.743618 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.745500 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.748356 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.760833 2575 log.go:25] "Validated CRI v1 runtime API" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.763318 2575 log.go:25] "Validated CRI v1 image API" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.764042 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 00:44:07.220904 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.765961 2575 fs.go:135] Filesystem UUIDs: map[023d8a7e-3902-4f5f-971e-5055584cce81:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9f8bd7ae-fa7a-45b7-b723-0d4b72b37e41:/dev/nvme0n1p3] Jul 14 00:44:07.384614 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.765984 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 00:44:07.384614 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.770333 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.771360 2575 manager.go:216] Machine: {Timestamp:2026-07-14 00:44:06.770032752 +0000 UTC m=+0.259370213 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102815 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e0127f24308b57c645e07b53bdd15 SystemUUID:ec2e0127-f243-08b5-7c64-5e07b53bdd15 BootID:9bf06022-cfb8-48f3-bc54-95849845b987 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:84:53:bc:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:84:53:bc:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:9e:d3:b6:39:74 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.771485 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.771621 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.774227 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.774251 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-60.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.775506 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.775516 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.775524 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.776022 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.777042 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.780508 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.780623 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.780652 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.780669 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.780683 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.780694 2575 kubelet.go:398] "Adding apiserver pod source" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.780703 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 00:44:07.564665 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.781025 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.781040 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.784474 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.786187 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.786223 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.786408 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.786425 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.786433 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.786443 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.786464 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.786472 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.787110 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.787131 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.787143 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.787151 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.787169 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.787179 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.788208 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.788225 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.791481 2575 server.go:1268] "Started kubelet" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.791605 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.791709 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.791623 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.792487 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-60.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.792560 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.792674 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.792811 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.793463 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.796899 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.797195 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.797284 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.797306 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.797762 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.797791 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.797808 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.797889 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.797898 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.798006 2575 factory.go:55] Registering systemd factory Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.798020 2575 factory.go:223] Registration of the systemd container factory successfully Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.798208 2575 factory.go:153] Registering CRI-O factory Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.798219 2575 factory.go:223] Registration of the crio container factory successfully Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.798282 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.798303 2575 factory.go:103] Registering Raw factory Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.798313 2575 manager.go:1196] Started watching for new ooms in manager Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.798616 2575 manager.go:349] Starting recovery of all containers Jul 14 00:44:07.566045 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.802225 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.802483 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.802267 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-60.ec2.internal.18c201504ce8172b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-60.ec2.internal,UID:ip-10-0-131-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-60.ec2.internal,},FirstTimestamp:2026-07-14 00:44:06.791427883 +0000 UTC m=+0.280765314,LastTimestamp:2026-07-14 00:44:06.791427883 +0000 UTC m=+0.280765314,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-60.ec2.internal,}" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.806195 2575 manager.go:354] Recovery completed Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.812711 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.814781 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.814816 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.814833 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.815293 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.815307 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.815321 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.815369 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.816047 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.816082 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.816093 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.817200 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-60.ec2.internal.18c201504e4caabd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-60.ec2.internal,UID:ip-10-0-131-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-60.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-60.ec2.internal,},FirstTimestamp:2026-07-14 00:44:06.814796477 +0000 UTC m=+0.304133909,LastTimestamp:2026-07-14 00:44:06.814796477 +0000 UTC m=+0.304133909,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-60.ec2.internal,}" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.817386 2575 policy_none.go:49] "None policy: Start" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.817398 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.817408 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.819383 2575 policy_none.go:47] "Start" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.823235 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s5x8s" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.827449 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-60.ec2.internal.18c201504e4d1823 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-60.ec2.internal,UID:ip-10-0-131-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-60.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-60.ec2.internal,},FirstTimestamp:2026-07-14 00:44:06.814824483 +0000 UTC m=+0.304161922,LastTimestamp:2026-07-14 00:44:06.814824483 +0000 UTC m=+0.304161922,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-60.ec2.internal,}" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.828944 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s5x8s" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.853627 2575 manager.go:337] "Starting Device Plugin manager" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.853658 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.853667 2575 server.go:87] "Starting device plugin registration server" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.853833 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 00:44:07.567979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.853842 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.853937 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.854018 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.854026 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.854477 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.854518 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.957371 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.958302 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.958336 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.958358 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.958393 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.967537 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.968323 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.968341 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-60.ec2.internal\": node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.968904 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.968947 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.968977 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:06.969020 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:06.971280 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.018715 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.073081 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal"] Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.073151 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.076399 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.076426 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.076441 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082189 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082297 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082325 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082888 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082909 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082918 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082934 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082956 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.082974 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.085345 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.085368 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.085999 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.086017 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.086027 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:44:07.569869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.099945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f79072967abef080669ef8a984458ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"5f79072967abef080669ef8a984458ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.099968 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f79072967abef080669ef8a984458ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"5f79072967abef080669ef8a984458ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.100001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b858f6dbf512009ca5a9e4eaae700794-config\") pod \"kube-apiserver-proxy-ip-10-0-131-60.ec2.internal\" (UID: \"b858f6dbf512009ca5a9e4eaae700794\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.119676 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.119777 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-60.ec2.internal\" not found" node="ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.124264 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-60.ec2.internal\" not found" node="ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.201038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f79072967abef080669ef8a984458ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"5f79072967abef080669ef8a984458ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.201064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f79072967abef080669ef8a984458ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"5f79072967abef080669ef8a984458ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.201098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b858f6dbf512009ca5a9e4eaae700794-config\") pod \"kube-apiserver-proxy-ip-10-0-131-60.ec2.internal\" (UID: \"b858f6dbf512009ca5a9e4eaae700794\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.201141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b858f6dbf512009ca5a9e4eaae700794-config\") pod \"kube-apiserver-proxy-ip-10-0-131-60.ec2.internal\" (UID: \"b858f6dbf512009ca5a9e4eaae700794\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.201148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f79072967abef080669ef8a984458ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"5f79072967abef080669ef8a984458ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.201148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f79072967abef080669ef8a984458ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal\" (UID: \"5f79072967abef080669ef8a984458ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.220261 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.320377 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.421333 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.421341 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.426717 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" Jul 14 00:44:07.571785 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.521900 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.623143 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.623101 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.723385 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.723349 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.742966 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.742942 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 00:44:07.743152 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.743131 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 00:44:07.824302 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.824252 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:07.833020 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.832993 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 00:39:07 +0000 UTC" deadline="2028-04-19 19:30:23.10570165 +0000 UTC" Jul 14 00:44:07.833020 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.833017 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15498h46m15.272687249s" Jul 14 00:44:07.838566 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.838555 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:44:07.839369 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.839350 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:44:07.839443 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.839387 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:44:07.839443 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:07.839403 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:44:07.925812 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:07.925786 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:08.027289 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.027260 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:08.035625 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.035608 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:44:08.127397 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.127328 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:08.227418 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.227383 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:08.252675 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.252648 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:44:08.291318 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:08.291292 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f79072967abef080669ef8a984458ba.slice/crio-87d195bc69c3f117c44ec64916d55e9b3e0974bbcd120fc4115517de7610c7fa WatchSource:0}: Error finding container 87d195bc69c3f117c44ec64916d55e9b3e0974bbcd120fc4115517de7610c7fa: Status 404 returned error can't find the container with id 87d195bc69c3f117c44ec64916d55e9b3e0974bbcd120fc4115517de7610c7fa Jul 14 00:44:08.292443 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:08.292416 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb858f6dbf512009ca5a9e4eaae700794.slice/crio-5bf798d793df60159f04d6dde1e6ee1126f61fa3797d885748923a6519e8778b WatchSource:0}: Error finding container 5bf798d793df60159f04d6dde1e6ee1126f61fa3797d885748923a6519e8778b: Status 404 returned error can't find the container with id 5bf798d793df60159f04d6dde1e6ee1126f61fa3797d885748923a6519e8778b Jul 14 00:44:08.298075 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.298059 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 00:44:08.328527 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.328496 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-60.ec2.internal\" not found" Jul 14 00:44:08.332874 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.331539 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:44:08.399642 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.399597 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" Jul 14 00:44:08.413131 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.413113 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 00:44:08.414095 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.414082 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" Jul 14 00:44:08.422743 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.422727 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 00:44:08.784229 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.784192 2575 apiserver.go:52] "Watching apiserver" Jul 14 00:44:08.790230 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.790209 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 00:44:08.790587 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.790566 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-lsts4","openshift-network-diagnostics/network-check-target-ffbmn","openshift-network-operator/iptables-alerter-h5c6h","openshift-ovn-kubernetes/ovnkube-node-cfhh7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw","openshift-cluster-node-tuning-operator/tuned-vqhbr","openshift-dns/node-resolver-qtt9x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal","openshift-multus/multus-additional-cni-plugins-mdssk","openshift-multus/network-metrics-daemon-vbw62","kube-system/global-pull-secret-syncer-rq4ld","kube-system/konnectivity-agent-w79xj","kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal","openshift-image-registry/node-ca-d5kjk"] Jul 14 00:44:08.794653 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.794633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.796894 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.796864 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.797177 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.796943 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:08.797177 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.797134 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 00:44:08.797298 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.797268 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 00:44:08.797298 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.797277 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t9jtq\"" Jul 14 00:44:08.797902 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.797889 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 00:44:08.799172 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.799124 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.801550 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.801527 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zk8l5\"" Jul 14 00:44:08.801751 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.801735 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.801829 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.801796 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:44:08.801829 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.801812 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 00:44:08.801990 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.801975 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 00:44:08.804239 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.804220 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:08.804425 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.804403 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 00:44:08.804601 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.804581 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 00:44:08.804686 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.804612 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 00:44:08.804686 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.804640 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 00:44:08.804818 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.804715 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 00:44:08.804895 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.804881 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tgw6v\"" Jul 14 00:44:08.805245 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.805225 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 00:44:08.806583 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.806561 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 00:44:08.806701 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.806669 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.806701 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.806682 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 00:44:08.807414 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.807399 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 00:44:08.807483 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.807436 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cvglv\"" Jul 14 00:44:08.809000 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.808981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2kftk\"" Jul 14 00:44:08.809150 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.809133 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:44:08.809212 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.809143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.809275 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.809214 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 00:44:08.810472 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.810456 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 00:44:08.811018 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2956f2ca-1a38-4d77-acdd-d799ee01930c-iptables-alerter-script\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.811062 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2956f2ca-1a38-4d77-acdd-d799ee01930c-host-slash\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.811062 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rplrp\" (UniqueName: \"kubernetes.io/projected/2956f2ca-1a38-4d77-acdd-d799ee01930c-kube-api-access-rplrp\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.811159 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92683eb7-9da4-407b-ac51-ac53b3400ad2-kubelet-config\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.811159 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.811159 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89e8396f-097a-429e-a698-a91fee24f257-hosts-file\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.811927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89e8396f-097a-429e-a698-a91fee24f257-tmp-dir\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.811927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdqg5\" (UniqueName: \"kubernetes.io/projected/89e8396f-097a-429e-a698-a91fee24f257-kube-api-access-qdqg5\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.811927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92683eb7-9da4-407b-ac51-ac53b3400ad2-dbus\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.811927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811740 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 00:44:08.811927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.811788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:08.812301 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.812100 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6zfm6\"" Jul 14 00:44:08.812301 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.812251 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 00:44:08.813561 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.812683 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 00:44:08.813561 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.812776 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 00:44:08.813561 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.813270 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 00:44:08.814757 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.814405 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 00:44:08.815455 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.815436 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j7ppb\"" Jul 14 00:44:08.815548 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.815499 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 00:44:08.815916 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.815900 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 00:44:08.816031 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.816010 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:08.816129 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.816107 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:08.818565 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.818548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:08.818641 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.818609 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:08.820962 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.820944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.823075 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.823060 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-76jkd\"" Jul 14 00:44:08.823345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.823327 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 00:44:08.823481 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.823465 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:08.825814 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.825792 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 00:44:08.826406 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.825861 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lqtgc\"" Jul 14 00:44:08.826406 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.825912 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 00:44:08.833020 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.833004 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nrjqv" Jul 14 00:44:08.843414 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.843394 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nrjqv" Jul 14 00:44:08.898846 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.898823 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 00:44:08.911858 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.911834 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92683eb7-9da4-407b-ac51-ac53b3400ad2-kubelet-config\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.911953 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.911867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-device-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:08.911953 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.911932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:08.912057 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.911972 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92683eb7-9da4-407b-ac51-ac53b3400ad2-kubelet-config\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.912057 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-cni-multus\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.912057 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-socket-dir-parent\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.912232 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.912232 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysctl-conf\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.912232 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-host\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.912232 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x42qs\" (UniqueName: \"kubernetes.io/projected/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-kube-api-access-x42qs\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.912232 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-cni-bin\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.912232 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt9kn\" (UniqueName: \"kubernetes.io/projected/d505356c-4ab9-4d74-a411-be8467553bf6-kube-api-access-gt9kn\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-socket-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f49d33c9-9fb7-43b9-8cce-58352c29b55a-konnectivity-ca\") pod \"konnectivity-agent-w79xj\" (UID: \"f49d33c9-9fb7-43b9-8cce-58352c29b55a\") " pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-kubelet\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-slash\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-run-netns\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912419 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-systemd\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-system-cni-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.912530 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-hostroot\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-var-lib-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-host\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912604 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-etc-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjz4x\" (UniqueName: \"kubernetes.io/projected/5d569466-c10f-4c9a-a991-2738b0372661-kube-api-access-tjz4x\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2956f2ca-1a38-4d77-acdd-d799ee01930c-iptables-alerter-script\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2956f2ca-1a38-4d77-acdd-d799ee01930c-host-slash\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rplrp\" (UniqueName: \"kubernetes.io/projected/2956f2ca-1a38-4d77-acdd-d799ee01930c-kube-api-access-rplrp\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovnkube-script-lib\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.912809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912725 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2956f2ca-1a38-4d77-acdd-d799ee01930c-host-slash\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44ck\" (UniqueName: \"kubernetes.io/projected/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-kube-api-access-h44ck\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89e8396f-097a-429e-a698-a91fee24f257-hosts-file\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-cni-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-cni-bin\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912902 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89e8396f-097a-429e-a698-a91fee24f257-hosts-file\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovnkube-config\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.912979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wdj\" (UniqueName: \"kubernetes.io/projected/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-kube-api-access-d6wdj\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-sys-fs\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-os-release\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-kubelet\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.913195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.913223 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913265 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2956f2ca-1a38-4d77-acdd-d799ee01930c-iptables-alerter-script\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-env-overrides\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-modprobe-d\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913373 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89e8396f-097a-429e-a698-a91fee24f257-tmp-dir\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:08.913407 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret podName:92683eb7-9da4-407b-ac51-ac53b3400ad2 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:09.413381582 +0000 UTC m=+2.902719006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret") pod "global-pull-secret-syncer-rq4ld" (UID: "92683eb7-9da4-407b-ac51-ac53b3400ad2") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5g4\" (UniqueName: \"kubernetes.io/projected/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-kube-api-access-fh5g4\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-system-cni-dir\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-multus-certs\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sx27\" (UniqueName: \"kubernetes.io/projected/735aef64-0568-4dc5-b40e-51a0d91c4cfe-kube-api-access-9sx27\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-systemd-units\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-kubernetes\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89e8396f-097a-429e-a698-a91fee24f257-tmp-dir\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovn-node-metrics-cert\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.913679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysctl-d\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-run\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-serviceca\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913772 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-cnibin\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-k8s-cni-cncf-io\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-netns\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-systemd\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913887 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-node-log\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-tuned\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-tmp\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-conf-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.913964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdqg5\" (UniqueName: \"kubernetes.io/projected/89e8396f-097a-429e-a698-a91fee24f257-kube-api-access-qdqg5\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.914004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92683eb7-9da4-407b-ac51-ac53b3400ad2-dbus\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.914033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/735aef64-0568-4dc5-b40e-51a0d91c4cfe-cni-binary-copy\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.914050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.914069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-cnibin\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.914098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-daemon-config\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.914311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.914126 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92683eb7-9da4-407b-ac51-ac53b3400ad2-dbus\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-ovn\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915178 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-os-release\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915230 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysconfig\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-sys\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-registration-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-etc-kubernetes\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:08.915485 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f49d33c9-9fb7-43b9-8cce-58352c29b55a-agent-certs\") pod \"konnectivity-agent-w79xj\" (UID: \"f49d33c9-9fb7-43b9-8cce-58352c29b55a\") " pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:08.916031 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-log-socket\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.916031 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-cni-netd\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:08.916031 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-lib-modules\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.916031 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.915602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-var-lib-kubelet\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:08.920033 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.920014 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 00:44:08.923454 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.923437 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rplrp\" (UniqueName: \"kubernetes.io/projected/2956f2ca-1a38-4d77-acdd-d799ee01930c-kube-api-access-rplrp\") pod \"iptables-alerter-h5c6h\" (UID: \"2956f2ca-1a38-4d77-acdd-d799ee01930c\") " pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:08.923511 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.923451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdqg5\" (UniqueName: \"kubernetes.io/projected/89e8396f-097a-429e-a698-a91fee24f257-kube-api-access-qdqg5\") pod \"node-resolver-qtt9x\" (UID: \"89e8396f-097a-429e-a698-a91fee24f257\") " pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:08.975718 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.975669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" event={"ID":"b858f6dbf512009ca5a9e4eaae700794","Type":"ContainerStarted","Data":"5bf798d793df60159f04d6dde1e6ee1126f61fa3797d885748923a6519e8778b"} Jul 14 00:44:08.976820 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:08.976797 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" event={"ID":"5f79072967abef080669ef8a984458ba","Type":"ContainerStarted","Data":"87d195bc69c3f117c44ec64916d55e9b3e0974bbcd120fc4115517de7610c7fa"} Jul 14 00:44:09.015887 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.015859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.016002 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.015894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-os-release\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.016002 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.015923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.016002 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.015949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysconfig\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.016002 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.015973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-sys\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.016002 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.015998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-registration-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016007 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-etc-kubernetes\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f49d33c9-9fb7-43b9-8cce-58352c29b55a-agent-certs\") pod \"konnectivity-agent-w79xj\" (UID: \"f49d33c9-9fb7-43b9-8cce-58352c29b55a\") " pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016096 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysconfig\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016097 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-sys\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-log-socket\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016132 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-etc-kubernetes\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-cni-netd\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-registration-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016189 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-cni-netd\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016189 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-log-socket\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-lib-modules\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-var-lib-kubelet\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-device-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.016394 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016330 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-lib-modules\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-cni-multus\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-socket-dir-parent\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-var-lib-kubelet\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016404 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-device-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016436 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-cni-multus\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016442 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysctl-conf\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-host\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-socket-dir-parent\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x42qs\" (UniqueName: \"kubernetes.io/projected/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-kube-api-access-x42qs\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-cni-bin\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016589 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt9kn\" (UniqueName: \"kubernetes.io/projected/d505356c-4ab9-4d74-a411-be8467553bf6-kube-api-access-gt9kn\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-host\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.017261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016591 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-cni-bin\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016007 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-os-release\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-socket-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f49d33c9-9fb7-43b9-8cce-58352c29b55a-konnectivity-ca\") pod \"konnectivity-agent-w79xj\" (UID: \"f49d33c9-9fb7-43b9-8cce-58352c29b55a\") " pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016684 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-kubelet\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-slash\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016744 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016744 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-socket-dir\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016631 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysctl-conf\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-run-netns\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016824 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-slash\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-run-netns\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-systemd\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-system-cni-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-kubelet\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-hostroot\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-var-lib-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-systemd\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.018108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-host\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-etc-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017008 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.016993 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-hostroot\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017028 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjz4x\" (UniqueName: \"kubernetes.io/projected/5d569466-c10f-4c9a-a991-2738b0372661-kube-api-access-tjz4x\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017066 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-var-lib-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017067 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-etc-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017101 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-host\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017187 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-system-cni-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017231 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f49d33c9-9fb7-43b9-8cce-58352c29b55a-konnectivity-ca\") pod \"konnectivity-agent-w79xj\" (UID: \"f49d33c9-9fb7-43b9-8cce-58352c29b55a\") " pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovnkube-script-lib\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44ck\" (UniqueName: \"kubernetes.io/projected/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-kube-api-access-h44ck\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-cni-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-cni-bin\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovnkube-config\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wdj\" (UniqueName: \"kubernetes.io/projected/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-kube-api-access-d6wdj\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:09.018998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-sys-fs\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-os-release\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-kubelet\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017539 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017549 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-cni-bin\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-env-overrides\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-modprobe-d\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5g4\" (UniqueName: \"kubernetes.io/projected/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-kube-api-access-fh5g4\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.017644 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017640 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-system-cni-dir\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-sys-fs\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-multus-certs\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.017752 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:09.517732167 +0000 UTC m=+3.007069591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sx27\" (UniqueName: \"kubernetes.io/projected/735aef64-0568-4dc5-b40e-51a0d91c4cfe-kube-api-access-9sx27\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017782 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-system-cni-dir\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017791 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-cni-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-systemd-units\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017837 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-multus-certs\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-kubernetes\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017869 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovn-node-metrics-cert\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017885 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-var-lib-kubelet\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysctl-d\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-run\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017957 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-serviceca\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-cnibin\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018008 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-modprobe-d\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018012 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovnkube-script-lib\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-k8s-cni-cncf-io\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-k8s-cni-cncf-io\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018064 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-netns\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018083 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-env-overrides\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.020875 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.017642 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-os-release\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-systemd\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-node-log\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018204 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-host-run-netns\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-tuned\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-tmp\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018281 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-kubernetes\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-conf-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018344 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d569466-c10f-4c9a-a991-2738b0372661-cnibin\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018348 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d569466-c10f-4c9a-a991-2738b0372661-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/735aef64-0568-4dc5-b40e-51a0d91c4cfe-cni-binary-copy\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018353 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-node-log\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-systemd\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-cnibin\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-daemon-config\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018457 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-run\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018490 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-ovn\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.021728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018497 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovnkube-config\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-conf-dir\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018602 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-ovn\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-serviceca\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018822 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-systemd-units\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-sysctl-d\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018894 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/735aef64-0568-4dc5-b40e-51a0d91c4cfe-cnibin\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.018913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-run-openvswitch\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.019035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f49d33c9-9fb7-43b9-8cce-58352c29b55a-agent-certs\") pod \"konnectivity-agent-w79xj\" (UID: \"f49d33c9-9fb7-43b9-8cce-58352c29b55a\") " pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.019056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/735aef64-0568-4dc5-b40e-51a0d91c4cfe-multus-daemon-config\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.019067 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/735aef64-0568-4dc5-b40e-51a0d91c4cfe-cni-binary-copy\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.020872 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-etc-tuned\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.021121 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-tmp\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.022696 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.021198 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-ovn-node-metrics-cert\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.023521 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.023502 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:44:09.023626 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.023525 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:44:09.023626 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.023539 2575 projected.go:196] Error preparing data for projected volume kube-api-access-76c6w for pod openshift-network-diagnostics/network-check-target-ffbmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:09.023626 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.023604 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w podName:ab0d2657-485c-451f-9895-d620ae4b7aee nodeName:}" failed. No retries permitted until 2026-07-14 00:44:09.523585903 +0000 UTC m=+3.012923339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-76c6w" (UniqueName: "kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w") pod "network-check-target-ffbmn" (UID: "ab0d2657-485c-451f-9895-d620ae4b7aee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:09.025580 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.025536 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x42qs\" (UniqueName: \"kubernetes.io/projected/cb2dd0f0-fab6-4174-a82b-a5c0427b21df-kube-api-access-x42qs\") pod \"tuned-vqhbr\" (UID: \"cb2dd0f0-fab6-4174-a82b-a5c0427b21df\") " pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.027909 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.027882 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5g4\" (UniqueName: \"kubernetes.io/projected/77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9-kube-api-access-fh5g4\") pod \"aws-ebs-csi-driver-node-s6kqw\" (UID: \"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.028677 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.028648 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wdj\" (UniqueName: \"kubernetes.io/projected/d09dae08-02ae-44c2-8f9b-95fc9c1913fc-kube-api-access-d6wdj\") pod \"node-ca-d5kjk\" (UID: \"d09dae08-02ae-44c2-8f9b-95fc9c1913fc\") " pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:09.028780 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.028753 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjz4x\" (UniqueName: \"kubernetes.io/projected/5d569466-c10f-4c9a-a991-2738b0372661-kube-api-access-tjz4x\") pod \"multus-additional-cni-plugins-mdssk\" (UID: \"5d569466-c10f-4c9a-a991-2738b0372661\") " pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.029201 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.029174 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt9kn\" (UniqueName: \"kubernetes.io/projected/d505356c-4ab9-4d74-a411-be8467553bf6-kube-api-access-gt9kn\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:09.029642 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.029623 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sx27\" (UniqueName: \"kubernetes.io/projected/735aef64-0568-4dc5-b40e-51a0d91c4cfe-kube-api-access-9sx27\") pod \"multus-lsts4\" (UID: \"735aef64-0568-4dc5-b40e-51a0d91c4cfe\") " pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.030026 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.030005 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44ck\" (UniqueName: \"kubernetes.io/projected/0d1da8d6-2211-46ae-b7dd-fd5ca380dfda-kube-api-access-h44ck\") pod \"ovnkube-node-cfhh7\" (UID: \"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.104383 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.104280 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qtt9x" Jul 14 00:44:09.114100 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.114064 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5c6h" Jul 14 00:44:09.120528 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.120495 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:09.125543 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.125520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" Jul 14 00:44:09.125809 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:09.125786 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2956f2ca_1a38_4d77_acdd_d799ee01930c.slice/crio-3f49deb08ff55fe504e4418c0f13d3f8ef7561bfe2d47857a9395aac7e783669 WatchSource:0}: Error finding container 3f49deb08ff55fe504e4418c0f13d3f8ef7561bfe2d47857a9395aac7e783669: Status 404 returned error can't find the container with id 3f49deb08ff55fe504e4418c0f13d3f8ef7561bfe2d47857a9395aac7e783669 Jul 14 00:44:09.131950 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.131926 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" Jul 14 00:44:09.132256 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:09.132232 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1da8d6_2211_46ae_b7dd_fd5ca380dfda.slice/crio-7e423781dcfba36fed41d3eef729efef92d6405eb4367b46ccd1b547caf03454 WatchSource:0}: Error finding container 7e423781dcfba36fed41d3eef729efef92d6405eb4367b46ccd1b547caf03454: Status 404 returned error can't find the container with id 7e423781dcfba36fed41d3eef729efef92d6405eb4367b46ccd1b547caf03454 Jul 14 00:44:09.137369 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.137347 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdssk" Jul 14 00:44:09.143417 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.142928 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d5kjk" Jul 14 00:44:09.149437 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.149284 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lsts4" Jul 14 00:44:09.150894 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:09.150866 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d569466_c10f_4c9a_a991_2738b0372661.slice/crio-b7b063287ecf885b83a67344ce0ba4978a5c21d037ba1638f523d66ef3ee1275 WatchSource:0}: Error finding container b7b063287ecf885b83a67344ce0ba4978a5c21d037ba1638f523d66ef3ee1275: Status 404 returned error can't find the container with id b7b063287ecf885b83a67344ce0ba4978a5c21d037ba1638f523d66ef3ee1275 Jul 14 00:44:09.153832 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.153660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:09.167946 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:09.167909 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735aef64_0568_4dc5_b40e_51a0d91c4cfe.slice/crio-c294b925235bb87bd0b84b186af466cb1047042d4ab4707716f88a83157a9e57 WatchSource:0}: Error finding container c294b925235bb87bd0b84b186af466cb1047042d4ab4707716f88a83157a9e57: Status 404 returned error can't find the container with id c294b925235bb87bd0b84b186af466cb1047042d4ab4707716f88a83157a9e57 Jul 14 00:44:09.169267 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:09.169217 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49d33c9_9fb7_43b9_8cce_58352c29b55a.slice/crio-fa6be12b8f52cc324ba27cb6b4e45d7f9f71b91ab41ae2d109f88693aa1ae079 WatchSource:0}: Error finding container fa6be12b8f52cc324ba27cb6b4e45d7f9f71b91ab41ae2d109f88693aa1ae079: Status 404 returned error can't find the container with id fa6be12b8f52cc324ba27cb6b4e45d7f9f71b91ab41ae2d109f88693aa1ae079 Jul 14 00:44:09.182843 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.182643 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:44:09.423595 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.423417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:09.423767 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.423652 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:09.423767 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.423729 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret podName:92683eb7-9da4-407b-ac51-ac53b3400ad2 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:10.423706104 +0000 UTC m=+3.913043546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret") pod "global-pull-secret-syncer-rq4ld" (UID: "92683eb7-9da4-407b-ac51-ac53b3400ad2") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:09.524663 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.524615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:09.524848 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.524710 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:09.524848 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.524805 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:44:09.524848 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.524838 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:44:09.525014 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.524853 2575 projected.go:196] Error preparing data for projected volume kube-api-access-76c6w for pod openshift-network-diagnostics/network-check-target-ffbmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:09.525014 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.524866 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:09.525014 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.524921 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w podName:ab0d2657-485c-451f-9895-d620ae4b7aee nodeName:}" failed. No retries permitted until 2026-07-14 00:44:10.524899931 +0000 UTC m=+4.014237358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-76c6w" (UniqueName: "kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w") pod "network-check-target-ffbmn" (UID: "ab0d2657-485c-451f-9895-d620ae4b7aee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:09.525014 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.524941 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:10.524930916 +0000 UTC m=+4.014268337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:09.846695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.846612 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 00:39:09 +0000 UTC" deadline="2028-03-25 22:54:42.899528536 +0000 UTC" Jul 14 00:44:09.846695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.846689 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14902h10m33.052843756s" Jul 14 00:44:09.969271 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.969234 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:09.969464 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:09.969371 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:09.982203 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.982105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w79xj" event={"ID":"f49d33c9-9fb7-43b9-8cce-58352c29b55a","Type":"ContainerStarted","Data":"fa6be12b8f52cc324ba27cb6b4e45d7f9f71b91ab41ae2d109f88693aa1ae079"} Jul 14 00:44:09.983965 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.983935 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d5kjk" event={"ID":"d09dae08-02ae-44c2-8f9b-95fc9c1913fc","Type":"ContainerStarted","Data":"a3719e192b1906ff3db06f3f61e1b98ef0647ff2fa6b7eac1c3b4b31fa7177e1"} Jul 14 00:44:09.986037 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.985962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdssk" event={"ID":"5d569466-c10f-4c9a-a991-2738b0372661","Type":"ContainerStarted","Data":"b7b063287ecf885b83a67344ce0ba4978a5c21d037ba1638f523d66ef3ee1275"} Jul 14 00:44:09.989033 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.988925 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"7e423781dcfba36fed41d3eef729efef92d6405eb4367b46ccd1b547caf03454"} Jul 14 00:44:09.990682 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.990649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qtt9x" event={"ID":"89e8396f-097a-429e-a698-a91fee24f257","Type":"ContainerStarted","Data":"cafdb8ef63b4e92833feed307a97254cd3d306ad522cc653d21dc213a15f4872"} Jul 14 00:44:09.992151 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.992105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lsts4" event={"ID":"735aef64-0568-4dc5-b40e-51a0d91c4cfe","Type":"ContainerStarted","Data":"c294b925235bb87bd0b84b186af466cb1047042d4ab4707716f88a83157a9e57"} Jul 14 00:44:09.993942 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.993879 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" event={"ID":"cb2dd0f0-fab6-4174-a82b-a5c0427b21df","Type":"ContainerStarted","Data":"cc08982337297afaf8cdcf1833c126570a493150c46eafd28d16a9d1da1177bc"} Jul 14 00:44:09.996070 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.995991 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" event={"ID":"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9","Type":"ContainerStarted","Data":"5a1f9afba378de30612fa88bbf0c19d567a9316e8743b3b185a015e6077abcca"} Jul 14 00:44:09.997945 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:09.997862 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5c6h" event={"ID":"2956f2ca-1a38-4d77-acdd-d799ee01930c","Type":"ContainerStarted","Data":"3f49deb08ff55fe504e4418c0f13d3f8ef7561bfe2d47857a9395aac7e783669"} Jul 14 00:44:10.434468 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:10.433780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:10.434468 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.433955 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:10.434468 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.434022 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret podName:92683eb7-9da4-407b-ac51-ac53b3400ad2 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:12.434002017 +0000 UTC m=+5.923339440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret") pod "global-pull-secret-syncer-rq4ld" (UID: "92683eb7-9da4-407b-ac51-ac53b3400ad2") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:10.537769 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:10.536693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:10.537769 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:10.536792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:10.537769 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.536966 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:44:10.537769 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.536986 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:44:10.537769 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.537000 2575 projected.go:196] Error preparing data for projected volume kube-api-access-76c6w for pod openshift-network-diagnostics/network-check-target-ffbmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:10.537769 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.537064 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w podName:ab0d2657-485c-451f-9895-d620ae4b7aee nodeName:}" failed. No retries permitted until 2026-07-14 00:44:12.537043813 +0000 UTC m=+6.026381236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-76c6w" (UniqueName: "kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w") pod "network-check-target-ffbmn" (UID: "ab0d2657-485c-451f-9895-d620ae4b7aee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:10.537769 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.537640 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:10.537769 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.537696 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:12.53767871 +0000 UTC m=+6.027016133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:10.847738 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:10.847692 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 00:39:09 +0000 UTC" deadline="2028-02-19 08:52:07.066189064 +0000 UTC" Jul 14 00:44:10.847738 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:10.847737 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14048h7m56.218457396s" Jul 14 00:44:10.972612 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:10.971916 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:10.972612 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.972047 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:10.972612 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:10.972158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:10.972612 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:10.972249 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:11.969624 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:11.969589 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:11.970104 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:11.969718 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:12.457989 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:12.457769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:12.457989 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.457945 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:12.458249 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.458025 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret podName:92683eb7-9da4-407b-ac51-ac53b3400ad2 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:16.458004829 +0000 UTC m=+9.947342248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret") pod "global-pull-secret-syncer-rq4ld" (UID: "92683eb7-9da4-407b-ac51-ac53b3400ad2") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:12.558684 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:12.558650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:12.558849 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:12.558741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:12.558923 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.558887 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:44:12.558979 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.558896 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:12.559031 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.558907 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:44:12.559031 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.559015 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:16.558980628 +0000 UTC m=+10.048318049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:12.559163 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.559035 2575 projected.go:196] Error preparing data for projected volume kube-api-access-76c6w for pod openshift-network-diagnostics/network-check-target-ffbmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:12.559163 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.559105 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w podName:ab0d2657-485c-451f-9895-d620ae4b7aee nodeName:}" failed. No retries permitted until 2026-07-14 00:44:16.559086522 +0000 UTC m=+10.048423944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-76c6w" (UniqueName: "kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w") pod "network-check-target-ffbmn" (UID: "ab0d2657-485c-451f-9895-d620ae4b7aee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:12.969570 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:12.969538 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:12.969756 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.969673 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:12.970140 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:12.969783 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:12.970140 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:12.969893 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:13.969490 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:13.969457 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:13.969666 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:13.969592 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:14.971262 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:14.971228 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:14.971734 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:14.971359 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:14.971734 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:14.971410 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:14.971734 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:14.971537 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:15.970234 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:15.969908 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:15.970234 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:15.970046 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:16.490928 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:16.490889 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:16.491384 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.491008 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:16.491384 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.491081 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret podName:92683eb7-9da4-407b-ac51-ac53b3400ad2 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:24.491051878 +0000 UTC m=+17.980389313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret") pod "global-pull-secret-syncer-rq4ld" (UID: "92683eb7-9da4-407b-ac51-ac53b3400ad2") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:16.591444 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:16.591400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:16.591621 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:16.591486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:16.591621 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.591584 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:16.591739 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.591640 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:44:16.591739 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.591656 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:44:16.591739 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.591661 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:24.591639472 +0000 UTC m=+18.080976892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:16.591739 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.591669 2575 projected.go:196] Error preparing data for projected volume kube-api-access-76c6w for pod openshift-network-diagnostics/network-check-target-ffbmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:16.591739 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.591716 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w podName:ab0d2657-485c-451f-9895-d620ae4b7aee nodeName:}" failed. No retries permitted until 2026-07-14 00:44:24.591701451 +0000 UTC m=+18.081038870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-76c6w" (UniqueName: "kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w") pod "network-check-target-ffbmn" (UID: "ab0d2657-485c-451f-9895-d620ae4b7aee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:16.970296 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:16.970263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:16.970457 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.970390 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:16.970716 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:16.970698 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:16.970808 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:16.970789 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:17.970026 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:17.969994 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:17.970461 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:17.970156 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:18.969840 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:18.969808 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:18.970013 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:18.969808 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:18.970013 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:18.969935 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:18.970449 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:18.970057 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:19.969973 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:19.969745 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:19.970221 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:19.970053 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:20.970097 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:20.970054 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:20.970097 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:20.970094 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:20.970634 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:20.970191 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:20.970634 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:20.970324 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:21.969998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:21.969952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:21.970189 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:21.970090 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:22.970106 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:22.970062 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:22.970526 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:22.970186 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:22.970526 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:22.970247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:22.970526 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:22.970369 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:23.969281 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:23.969246 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:23.969518 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:23.969360 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:24.551701 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:24.551663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:24.552170 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.551806 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:24.552170 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.551871 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret podName:92683eb7-9da4-407b-ac51-ac53b3400ad2 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:40.551851676 +0000 UTC m=+34.041189114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret") pod "global-pull-secret-syncer-rq4ld" (UID: "92683eb7-9da4-407b-ac51-ac53b3400ad2") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:24.652675 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:24.652632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:24.652841 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:24.652719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:24.652841 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.652776 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:24.652962 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.652850 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:40.652828345 +0000 UTC m=+34.142165772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:24.652962 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.652854 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:44:24.652962 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.652877 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:44:24.652962 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.652890 2575 projected.go:196] Error preparing data for projected volume kube-api-access-76c6w for pod openshift-network-diagnostics/network-check-target-ffbmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:24.652962 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.652939 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w podName:ab0d2657-485c-451f-9895-d620ae4b7aee nodeName:}" failed. No retries permitted until 2026-07-14 00:44:40.652922972 +0000 UTC m=+34.142260404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-76c6w" (UniqueName: "kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w") pod "network-check-target-ffbmn" (UID: "ab0d2657-485c-451f-9895-d620ae4b7aee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:24.970288 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:24.970254 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:24.970449 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.970406 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:24.970503 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:24.970461 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:24.970585 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:24.970561 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:25.969177 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:25.969143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:25.969556 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:25.969250 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:26.970031 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:26.969976 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:26.970488 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:26.970110 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:26.970488 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:26.970174 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:26.970488 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:26.970297 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:27.969798 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:27.969778 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:27.969895 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:27.969866 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:28.032803 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.032772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" event={"ID":"b858f6dbf512009ca5a9e4eaae700794","Type":"ContainerStarted","Data":"2a01e57866d199f5c0468eb653b4c14150f7c6651c081cb5c32624f1db8f2bf6"} Jul 14 00:44:28.034783 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.034764 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:44:28.035134 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.035111 2575 generic.go:356] "Generic (PLEG): container finished" podID="0d1da8d6-2211-46ae-b7dd-fd5ca380dfda" containerID="7984e4bd9177e962b1db7db252477e8f9ac7d54166eff137cbc6c198d99ea4e6" exitCode=1 Jul 14 00:44:28.035200 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.035178 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"80e410e64e5771edf203c45ecafb4581d1384430d2e2edbd30b032d569cbe413"} Jul 14 00:44:28.035255 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.035234 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerDied","Data":"7984e4bd9177e962b1db7db252477e8f9ac7d54166eff137cbc6c198d99ea4e6"} Jul 14 00:44:28.035300 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.035269 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"60f25a22e6b50015b105a87d0ddf586ff64c9c49be32100908beb9d818c2ccf8"} Jul 14 00:44:28.036739 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.036713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" event={"ID":"cb2dd0f0-fab6-4174-a82b-a5c0427b21df","Type":"ContainerStarted","Data":"9ad66401383f9fa4b78246f109860f61f563c1478d4309306902242eae2db50e"} Jul 14 00:44:28.059465 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.059430 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-60.ec2.internal" podStartSLOduration=20.059417821 podStartE2EDuration="20.059417821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:28.045592753 +0000 UTC m=+21.534930194" watchObservedRunningTime="2026-07-14 00:44:28.059417821 +0000 UTC m=+21.548755251" Jul 14 00:44:28.059787 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.059768 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vqhbr" podStartSLOduration=2.668945104 podStartE2EDuration="21.059762446s" totalImagesPullingTime="18.390817342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:28.059541576 +0000 UTC m=+21.548879007" watchObservedRunningTime="2026-07-14 00:44:28.059762446 +0000 UTC m=+21.549099913" Jul 14 00:44:28.970215 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.969894 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:28.970454 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:28.969937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:28.970454 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:28.970296 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:28.970454 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:28.970368 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:29.039266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.039237 2575 generic.go:356] "Generic (PLEG): container finished" podID="5d569466-c10f-4c9a-a991-2738b0372661" containerID="d306080fa0488c3dff7802768b4390fb20cbea11f2082aaa5c31db01e18bcb78" exitCode=0 Jul 14 00:44:29.039991 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.039307 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdssk" event={"ID":"5d569466-c10f-4c9a-a991-2738b0372661","Type":"ContainerDied","Data":"d306080fa0488c3dff7802768b4390fb20cbea11f2082aaa5c31db01e18bcb78"} Jul 14 00:44:29.042209 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.042187 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:44:29.042598 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.042580 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"75309f3c7586137373d92cfee14ef652099483d7e325fabc4fe64614adc158ec"} Jul 14 00:44:29.042645 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.042635 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"aaf9e8c6449054f407bf4b99167719dbcb7fcf38a987de4f0472c9df0dcb09b3"} Jul 14 00:44:29.042685 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.042666 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"3a78cc2fa86b034f47b2ea57fe750b361cf91d7236e38acf1c0b9c4aed76feb8"} Jul 14 00:44:29.043979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.043952 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qtt9x" event={"ID":"89e8396f-097a-429e-a698-a91fee24f257","Type":"ContainerStarted","Data":"2e2b014a45aeb6c030c108d698c0dee106026fb86b67516d3fe6d7d0c8aa7da7"} Jul 14 00:44:29.045658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.045628 2575 generic.go:356] "Generic (PLEG): container finished" podID="5f79072967abef080669ef8a984458ba" containerID="083d1d81258457e8980dd67362af33f5d4db822d84de4d122f33495b05a14d54" exitCode=0 Jul 14 00:44:29.045747 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.045657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" event={"ID":"5f79072967abef080669ef8a984458ba","Type":"ContainerDied","Data":"083d1d81258457e8980dd67362af33f5d4db822d84de4d122f33495b05a14d54"} Jul 14 00:44:29.050425 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.050400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lsts4" event={"ID":"735aef64-0568-4dc5-b40e-51a0d91c4cfe","Type":"ContainerStarted","Data":"498ac568417531c54d9307bb7a351801052db089664c0a87207d1914aec98f3b"} Jul 14 00:44:29.052021 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.052004 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" event={"ID":"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9","Type":"ContainerStarted","Data":"decc8985badac37ddd62b37919b509d620c171af24202996dfc803097fc33fd1"} Jul 14 00:44:29.053507 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.053486 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5c6h" event={"ID":"2956f2ca-1a38-4d77-acdd-d799ee01930c","Type":"ContainerStarted","Data":"422d028eda24dc88aa76310c5f957d044ba932b310e49303f6d29df0215a68ae"} Jul 14 00:44:29.055004 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.054986 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w79xj" event={"ID":"f49d33c9-9fb7-43b9-8cce-58352c29b55a","Type":"ContainerStarted","Data":"1cbdbea862412f2bc26f0df75cbfecdd3b6edef03ac55b8bd82c516c99181b40"} Jul 14 00:44:29.059681 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.059620 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d5kjk" event={"ID":"d09dae08-02ae-44c2-8f9b-95fc9c1913fc","Type":"ContainerStarted","Data":"0dbd738f2d7b4b06fb93635a348456c5357bb4988c48c01740911ec3a095a7ae"} Jul 14 00:44:29.090062 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.090019 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lsts4" podStartSLOduration=3.122851992 podStartE2EDuration="22.090000055s" totalImagesPullingTime="18.967148063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:29.07632134 +0000 UTC m=+22.565658775" watchObservedRunningTime="2026-07-14 00:44:29.090000055 +0000 UTC m=+22.579337496" Jul 14 00:44:29.103634 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.103595 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qtt9x" podStartSLOduration=15.311212964 podStartE2EDuration="22.103584119s" totalImagesPullingTime="6.792371155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:29.103236549 +0000 UTC m=+22.592574000" watchObservedRunningTime="2026-07-14 00:44:29.103584119 +0000 UTC m=+22.592921559" Jul 14 00:44:29.115999 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.115969 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h5c6h" podStartSLOduration=3.717799261 podStartE2EDuration="22.115958174s" totalImagesPullingTime="18.398158913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:29.115678358 +0000 UTC m=+22.605015814" watchObservedRunningTime="2026-07-14 00:44:29.115958174 +0000 UTC m=+22.605295615" Jul 14 00:44:29.129711 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.129671 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d5kjk" podStartSLOduration=11.912885075 podStartE2EDuration="22.129658451s" totalImagesPullingTime="10.216773376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:29.12936253 +0000 UTC m=+22.618699970" watchObservedRunningTime="2026-07-14 00:44:29.129658451 +0000 UTC m=+22.618995886" Jul 14 00:44:29.527052 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.527028 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 00:44:29.866007 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.865847 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T00:44:29.527045Z","UUID":"eb3203ff-af89-4802-899e-f8fb2a69adc3","Handler":null,"Name":"","Endpoint":""} Jul 14 00:44:29.867558 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.867540 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 00:44:29.867679 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.867576 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 00:44:29.970157 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:29.970129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:29.970317 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:29.970247 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:30.064899 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:30.064864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" event={"ID":"5f79072967abef080669ef8a984458ba","Type":"ContainerStarted","Data":"165aafbdd16b7292d7ea93620cc0235a698028625a4b09e2fd46100e273337ab"} Jul 14 00:44:30.067237 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:30.067208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" event={"ID":"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9","Type":"ContainerStarted","Data":"c051b96b7c7904d82f44145b77ac868fe609995ac651f0304a0e29cf07ddc973"} Jul 14 00:44:30.081129 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:30.081085 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-60.ec2.internal" podStartSLOduration=22.081056894 podStartE2EDuration="22.081056894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:30.081023402 +0000 UTC m=+23.570360867" watchObservedRunningTime="2026-07-14 00:44:30.081056894 +0000 UTC m=+23.570394334" Jul 14 00:44:30.081538 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:30.081364 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w79xj" podStartSLOduration=4.726439865 podStartE2EDuration="23.08135427s" totalImagesPullingTime="18.354914405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:29.144099421 +0000 UTC m=+22.633436879" watchObservedRunningTime="2026-07-14 00:44:30.08135427 +0000 UTC m=+23.570691708" Jul 14 00:44:30.969500 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:30.969465 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:30.969684 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:30.969515 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:30.969684 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:30.969611 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:30.969793 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:30.969713 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:31.071579 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:31.071500 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:44:31.071953 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:31.071864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"1615ad9334f6632ae44ca46a75c58744c39f4b4d6566251c4ef4051efe89efd7"} Jul 14 00:44:31.073658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:31.073624 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" event={"ID":"77b0b0cc-c977-4cbe-83cd-47b4eb6f36a9","Type":"ContainerStarted","Data":"904d3df1e5ffffc697a2ca766a9a3f8f5bc7e4bd385f1f9a415c2143276dba92"} Jul 14 00:44:31.092955 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:31.092914 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6kqw" podStartSLOduration=11.543272993 podStartE2EDuration="24.092902427s" totalImagesPullingTime="12.549629434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:31.092619095 +0000 UTC m=+24.581956547" watchObservedRunningTime="2026-07-14 00:44:31.092902427 +0000 UTC m=+24.582239867" Jul 14 00:44:31.969286 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:31.969258 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:31.969450 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:31.969375 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:32.479621 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:32.479590 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:32.480219 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:32.480205 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:32.969513 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:32.969482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:32.969674 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:32.969487 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:32.969674 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:32.969606 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:32.969792 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:32.969695 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:33.078061 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:33.078032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:33.078592 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:33.078571 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w79xj" Jul 14 00:44:33.969320 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:33.969154 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:33.969986 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:33.969387 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:34.085689 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.085665 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:44:34.086051 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.086024 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"9ebf989d48411fa6cbd9f6f128703a0d7acb663efdea5966703a4e9029a88db5"} Jul 14 00:44:34.086362 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.086341 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:34.086473 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.086443 2575 scope.go:117] "RemoveContainer" containerID="7984e4bd9177e962b1db7db252477e8f9ac7d54166eff137cbc6c198d99ea4e6" Jul 14 00:44:34.087824 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.087799 2575 generic.go:356] "Generic (PLEG): container finished" podID="5d569466-c10f-4c9a-a991-2738b0372661" containerID="9330d1fe6eaa6fb628a50993b339e7633cec546eb1f9d4ca68b219669471b00b" exitCode=0 Jul 14 00:44:34.087936 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.087870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdssk" event={"ID":"5d569466-c10f-4c9a-a991-2738b0372661","Type":"ContainerDied","Data":"9330d1fe6eaa6fb628a50993b339e7633cec546eb1f9d4ca68b219669471b00b"} Jul 14 00:44:34.101495 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.101477 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:34.970299 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.970055 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:34.970735 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:34.970055 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:34.970735 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:34.970421 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:34.970735 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:34.970587 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:35.094096 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.094006 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:44:35.094521 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.094485 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" event={"ID":"0d1da8d6-2211-46ae-b7dd-fd5ca380dfda","Type":"ContainerStarted","Data":"a68143d0067512b567c0ee15ace98ab034f63d7a78785c00b337ee8e2383501f"} Jul 14 00:44:35.094916 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.094894 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:35.095022 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.094957 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:35.110026 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.110003 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:44:35.123823 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.123776 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" podStartSLOduration=9.649673779 podStartE2EDuration="28.123762001s" totalImagesPullingTime="18.474088222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:35.123354495 +0000 UTC m=+28.612691945" watchObservedRunningTime="2026-07-14 00:44:35.123762001 +0000 UTC m=+28.613099485" Jul 14 00:44:35.431714 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.431691 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rq4ld"] Jul 14 00:44:35.431826 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.431816 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:35.431907 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:35.431892 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:35.434560 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.434541 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ffbmn"] Jul 14 00:44:35.434641 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.434622 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:35.434707 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:35.434691 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:35.435439 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.435255 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vbw62"] Jul 14 00:44:35.435439 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:35.435354 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:35.435439 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:35.435425 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:36.098924 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:36.098883 2575 generic.go:356] "Generic (PLEG): container finished" podID="5d569466-c10f-4c9a-a991-2738b0372661" containerID="703d29fe4481d74df03f64889ea25904d45e37e052e6c397ab0cba1bb6c9a7b6" exitCode=0 Jul 14 00:44:36.099339 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:36.098961 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdssk" event={"ID":"5d569466-c10f-4c9a-a991-2738b0372661","Type":"ContainerDied","Data":"703d29fe4481d74df03f64889ea25904d45e37e052e6c397ab0cba1bb6c9a7b6"} Jul 14 00:44:36.970378 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:36.970345 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:36.970561 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:36.970448 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:36.970561 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:36.970467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:36.970561 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:36.970495 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:36.970719 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:36.970590 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:36.970719 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:36.970682 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:38.107017 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:38.106974 2575 generic.go:356] "Generic (PLEG): container finished" podID="5d569466-c10f-4c9a-a991-2738b0372661" containerID="3f2f016059bcd797782136a3e46d99c185acf1acb34865120b2a49d8a9e40299" exitCode=0 Jul 14 00:44:38.107017 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:38.107020 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdssk" event={"ID":"5d569466-c10f-4c9a-a991-2738b0372661","Type":"ContainerDied","Data":"3f2f016059bcd797782136a3e46d99c185acf1acb34865120b2a49d8a9e40299"} Jul 14 00:44:38.970062 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:38.970026 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:38.970244 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:38.970032 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:38.970244 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:38.970164 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbmn" podUID="ab0d2657-485c-451f-9895-d620ae4b7aee" Jul 14 00:44:38.970244 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:38.970033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:38.970365 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:38.970273 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq4ld" podUID="92683eb7-9da4-407b-ac51-ac53b3400ad2" Jul 14 00:44:38.970365 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:38.970290 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:44:40.576548 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.576518 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:40.576933 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:40.576663 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:40.576933 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:40.576715 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret podName:92683eb7-9da4-407b-ac51-ac53b3400ad2 nodeName:}" failed. No retries permitted until 2026-07-14 00:45:12.576696632 +0000 UTC m=+66.066034051 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret") pod "global-pull-secret-syncer-rq4ld" (UID: "92683eb7-9da4-407b-ac51-ac53b3400ad2") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:44:40.677707 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.677674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:40.677882 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.677756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:40.677882 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:40.677839 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:40.678107 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:40.677890 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:44:40.678107 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:40.677912 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:44:40.678107 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:40.677926 2575 projected.go:196] Error preparing data for projected volume kube-api-access-76c6w for pod openshift-network-diagnostics/network-check-target-ffbmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:40.678107 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:40.677913 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:45:12.677893641 +0000 UTC m=+66.167231064 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:44:40.678107 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:40.678013 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w podName:ab0d2657-485c-451f-9895-d620ae4b7aee nodeName:}" failed. No retries permitted until 2026-07-14 00:45:12.677980214 +0000 UTC m=+66.167317637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-76c6w" (UniqueName: "kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w") pod "network-check-target-ffbmn" (UID: "ab0d2657-485c-451f-9895-d620ae4b7aee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:44:40.868029 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.867946 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-60.ec2.internal" event="NodeReady" Jul 14 00:44:40.868202 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.868113 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 00:44:40.903625 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.903596 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c56d947b7-djn2g"] Jul 14 00:44:40.908420 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.908399 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fb9mw"] Jul 14 00:44:40.908549 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.908518 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:40.911505 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.911486 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-np425\"" Jul 14 00:44:40.911616 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.911494 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 00:44:40.911754 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.911738 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 00:44:40.911933 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.911915 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 00:44:40.912033 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.911918 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:40.914456 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.914439 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 00:44:40.914559 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.914437 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 00:44:40.914919 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.914902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lstqb\"" Jul 14 00:44:40.917656 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.917636 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 00:44:40.919984 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.919966 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hcppl"] Jul 14 00:44:40.925155 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.925138 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fb9mw"] Jul 14 00:44:40.925283 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.925172 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c56d947b7-djn2g"] Jul 14 00:44:40.925283 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.925191 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-skxgn"] Jul 14 00:44:40.925283 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.925267 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:40.927987 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.927969 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 00:44:40.928092 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.928006 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 00:44:40.928544 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.928386 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rvlnc\"" Jul 14 00:44:40.928748 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.928735 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-skxgn" Jul 14 00:44:40.931017 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.930962 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 00:44:40.931583 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.931321 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 00:44:40.931583 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.931322 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 00:44:40.931583 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.931425 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rd24t\"" Jul 14 00:44:40.933176 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.932508 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hcppl"] Jul 14 00:44:40.937009 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.936987 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-skxgn"] Jul 14 00:44:40.969272 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.969250 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:44:40.969408 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.969250 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:44:40.969726 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.969250 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:44:40.972029 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.972014 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 00:44:40.972232 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.972213 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 00:44:40.972424 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.972405 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 00:44:40.972533 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.972404 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 00:44:40.972629 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.972620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tbhhd\"" Jul 14 00:44:40.972984 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:40.972967 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cmcmt\"" Jul 14 00:44:41.071531 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.071489 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" limit=1024 Jul 14 00:44:41.080478 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080444 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sx86\" (UniqueName: \"kubernetes.io/projected/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-kube-api-access-6sx86\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.080478 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.080660 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c780bc8-8b4d-4996-8ed6-512ec2c36698-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:41.080660 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-config-volume\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.080660 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:41.080660 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-image-registry-private-configuration\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.080660 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-certificates\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.080660 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-tmp-dir\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.080914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-installation-pull-secrets\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.080914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-trusted-ca\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.080914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-bound-sa-token\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.080914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080761 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mhjz\" (UniqueName: \"kubernetes.io/projected/f47310b6-7f79-428b-87a8-178d10caaf14-kube-api-access-9mhjz\") pod \"ingress-canary-skxgn\" (UID: \"f47310b6-7f79-428b-87a8-178d10caaf14\") " pod="openshift-ingress-canary/ingress-canary-skxgn" Jul 14 00:44:41.080914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080802 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2244a14f-2653-4bae-ad51-4f8c004b7dc4-ca-trust-extracted\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.080914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dx8m\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-kube-api-access-2dx8m\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.080914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47310b6-7f79-428b-87a8-178d10caaf14-cert\") pod \"ingress-canary-skxgn\" (UID: \"f47310b6-7f79-428b-87a8-178d10caaf14\") " pod="openshift-ingress-canary/ingress-canary-skxgn" Jul 14 00:44:41.081230 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.080963 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.153275 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.153161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" limit=1024 Jul 14 00:44:41.182024 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.181998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sx86\" (UniqueName: \"kubernetes.io/projected/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-kube-api-access-6sx86\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.182024 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182029 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.182248 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c780bc8-8b4d-4996-8ed6-512ec2c36698-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:41.182248 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182196 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-config-volume\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.182248 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:41.182377 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-image-registry-private-configuration\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.182377 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.182199 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:44:41.182377 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.182294 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:44:41.182377 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-certificates\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.182377 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-tmp-dir\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.182377 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.182350 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:41.682330118 +0000 UTC m=+35.171667547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:44:41.182377 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.182371 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-installation-pull-secrets\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.182411 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:41.682400789 +0000 UTC m=+35.171738211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-trusted-ca\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-bound-sa-token\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mhjz\" (UniqueName: \"kubernetes.io/projected/f47310b6-7f79-428b-87a8-178d10caaf14-kube-api-access-9mhjz\") pod \"ingress-canary-skxgn\" (UID: \"f47310b6-7f79-428b-87a8-178d10caaf14\") " pod="openshift-ingress-canary/ingress-canary-skxgn" Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2244a14f-2653-4bae-ad51-4f8c004b7dc4-ca-trust-extracted\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dx8m\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-kube-api-access-2dx8m\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182578 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47310b6-7f79-428b-87a8-178d10caaf14-cert\") pod \"ingress-canary-skxgn\" (UID: \"f47310b6-7f79-428b-87a8-178d10caaf14\") " pod="openshift-ingress-canary/ingress-canary-skxgn" Jul 14 00:44:41.182658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182583 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-tmp-dir\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.182912 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.182912 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182702 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-config-volume\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.182912 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.182763 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:44:41.182912 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.182811 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:44:41.682793903 +0000 UTC m=+35.172131335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:44:41.182912 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.182814 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c780bc8-8b4d-4996-8ed6-512ec2c36698-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:41.183058 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.183035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-certificates\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.184626 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.183937 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2244a14f-2653-4bae-ad51-4f8c004b7dc4-ca-trust-extracted\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.184626 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.184256 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-trusted-ca\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.188081 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.188041 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-image-registry-private-configuration\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.188198 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.188045 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-installation-pull-secrets\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.190130 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.190108 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f47310b6-7f79-428b-87a8-178d10caaf14-cert\") pod \"ingress-canary-skxgn\" (UID: \"f47310b6-7f79-428b-87a8-178d10caaf14\") " pod="openshift-ingress-canary/ingress-canary-skxgn" Jul 14 00:44:41.191121 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.191099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sx86\" (UniqueName: \"kubernetes.io/projected/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-kube-api-access-6sx86\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.191284 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.191266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-bound-sa-token\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.191806 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.191790 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mhjz\" (UniqueName: \"kubernetes.io/projected/f47310b6-7f79-428b-87a8-178d10caaf14-kube-api-access-9mhjz\") pod \"ingress-canary-skxgn\" (UID: \"f47310b6-7f79-428b-87a8-178d10caaf14\") " pod="openshift-ingress-canary/ingress-canary-skxgn" Jul 14 00:44:41.191976 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.191958 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dx8m\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-kube-api-access-2dx8m\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.244963 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.244938 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-skxgn" Jul 14 00:44:41.686713 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.686681 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.686719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.686770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.686840 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.686894 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.686916 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:44:42.686897662 +0000 UTC m=+36.176235097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.686927 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.686951 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.686933 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:42.686924793 +0000 UTC m=+36.176262211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:44:41.687172 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:41.687038 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:42.687019156 +0000 UTC m=+36.176356575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:44:41.947534 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:41.947497 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-skxgn"] Jul 14 00:44:41.950498 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:44:41.950475 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47310b6_7f79_428b_87a8_178d10caaf14.slice/crio-d88ef884552a84f90ae2dcca3bfe5637464fe3aeb7a02efc4558f5178b8f2732 WatchSource:0}: Error finding container d88ef884552a84f90ae2dcca3bfe5637464fe3aeb7a02efc4558f5178b8f2732: Status 404 returned error can't find the container with id d88ef884552a84f90ae2dcca3bfe5637464fe3aeb7a02efc4558f5178b8f2732 Jul 14 00:44:42.119681 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:42.119646 2575 generic.go:356] "Generic (PLEG): container finished" podID="5d569466-c10f-4c9a-a991-2738b0372661" containerID="3931248e043af5e947abc0639f9901def473cce587494c3b758b2eea51e0fb16" exitCode=0 Jul 14 00:44:42.119843 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:42.119743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdssk" event={"ID":"5d569466-c10f-4c9a-a991-2738b0372661","Type":"ContainerDied","Data":"3931248e043af5e947abc0639f9901def473cce587494c3b758b2eea51e0fb16"} Jul 14 00:44:42.120848 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:42.120830 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-skxgn" event={"ID":"f47310b6-7f79-428b-87a8-178d10caaf14","Type":"ContainerStarted","Data":"d88ef884552a84f90ae2dcca3bfe5637464fe3aeb7a02efc4558f5178b8f2732"} Jul 14 00:44:42.696211 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:42.696182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:42.696216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:42.696335 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:42.696359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:42.696391 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:44:44.696376564 +0000 UTC m=+38.185713985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:42.696338 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:42.696428 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:42.696436 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:42.696465 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:44.696455529 +0000 UTC m=+38.185792948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:44:42.696745 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:42.696482 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:44.696471609 +0000 UTC m=+38.185809027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:44:43.124973 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:43.124895 2575 generic.go:356] "Generic (PLEG): container finished" podID="5d569466-c10f-4c9a-a991-2738b0372661" containerID="a6fb334d94ebb0c5ccb7a7afba38cf16dd93f350918db96a7c813baf0c64cdd4" exitCode=0 Jul 14 00:44:43.124973 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:43.124955 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdssk" event={"ID":"5d569466-c10f-4c9a-a991-2738b0372661","Type":"ContainerDied","Data":"a6fb334d94ebb0c5ccb7a7afba38cf16dd93f350918db96a7c813baf0c64cdd4"} Jul 14 00:44:44.131025 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:44.130842 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdssk" event={"ID":"5d569466-c10f-4c9a-a991-2738b0372661","Type":"ContainerStarted","Data":"b7361e073f04123216374066b77aa7101b70a99096edf875aae2f68db1bbbc84"} Jul 14 00:44:44.154314 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:44.154260 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mdssk" podStartSLOduration=8.038706204 podStartE2EDuration="37.154241358s" totalImagesPullingTime="29.115535154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:44.153055387 +0000 UTC m=+37.642392828" watchObservedRunningTime="2026-07-14 00:44:44.154241358 +0000 UTC m=+37.643578797" Jul 14 00:44:44.287897 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:44.287865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" limit=1024 Jul 14 00:44:44.338215 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:44.338186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" limit=1024 Jul 14 00:44:44.713748 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:44.713717 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:44.713748 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:44.713750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:44.713932 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:44.713781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:44.713932 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:44.713872 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:44:44.713932 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:44.713876 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:44:44.713932 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:44.713878 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:44:44.713932 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:44.713928 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:44:44.714100 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:44.713919 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:48.71390691 +0000 UTC m=+42.203244328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:44:44.714100 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:44.713973 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:44:48.71395553 +0000 UTC m=+42.203292949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:44:44.714100 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:44.713998 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:48.713989153 +0000 UTC m=+42.203326571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:44:45.228556 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:45.228522 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" limit=1024 Jul 14 00:44:45.329350 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:45.329316 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" limit=1024 Jul 14 00:44:45.515543 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:45.515459 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" limit=1024 Jul 14 00:44:45.617645 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:45.617609 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" limit=1024 Jul 14 00:44:47.139233 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:47.139202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-skxgn" event={"ID":"f47310b6-7f79-428b-87a8-178d10caaf14","Type":"ContainerStarted","Data":"90b52f400a5340c63ab7b79f9c42b38a765f9264af8e3fd79765615184053030"} Jul 14 00:44:47.158909 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:47.158862 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-skxgn" podStartSLOduration=3.010014416 podStartE2EDuration="7.158848576s" totalImagesPullingTime="4.14883416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:44:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:44:47.15780859 +0000 UTC m=+40.647146049" watchObservedRunningTime="2026-07-14 00:44:47.158848576 +0000 UTC m=+40.648186039" Jul 14 00:44:48.747001 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:48.746961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:48.747051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:48.747103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:48.747131 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:48.747181 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:48.747189 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:56.747174825 +0000 UTC m=+50.236512246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:48.747228 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:48.747241 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:48.747243 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:44:56.747224935 +0000 UTC m=+50.236562357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:44:48.747452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:48.747281 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:44:56.747269825 +0000 UTC m=+50.236607243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:44:56.800850 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:56.800806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:44:56.800850 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:56.800854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:44:56.801390 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:44:56.800905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:44:56.801390 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:56.800944 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:44:56.801390 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:56.801003 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:45:12.800987716 +0000 UTC m=+66.290325134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:44:56.801390 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:56.801007 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:44:56.801390 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:56.801014 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:44:56.801390 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:56.801022 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:44:56.801390 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:56.801063 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:45:12.801048458 +0000 UTC m=+66.290385878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:44:56.801390 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:44:56.801137 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:45:12.801113115 +0000 UTC m=+66.290450542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:45:07.112371 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:07.112322 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhh7" Jul 14 00:45:12.610706 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.610669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:45:12.614219 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.614197 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 00:45:12.624639 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.624617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92683eb7-9da4-407b-ac51-ac53b3400ad2-original-pull-secret\") pod \"global-pull-secret-syncer-rq4ld\" (UID: \"92683eb7-9da4-407b-ac51-ac53b3400ad2\") " pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:45:12.711517 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.711486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:45:12.711654 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.711540 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:45:12.715602 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.715587 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 00:45:12.715662 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.715606 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 00:45:12.721995 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.721977 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 00:45:12.722056 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.722044 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:46:16.722025292 +0000 UTC m=+130.211362716 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : secret "metrics-daemon-secret" not found Jul 14 00:45:12.724251 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.724235 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 00:45:12.734613 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.734594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76c6w\" (UniqueName: \"kubernetes.io/projected/ab0d2657-485c-451f-9895-d620ae4b7aee-kube-api-access-76c6w\") pod \"network-check-target-ffbmn\" (UID: \"ab0d2657-485c-451f-9895-d620ae4b7aee\") " pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:45:12.780613 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.780595 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq4ld" Jul 14 00:45:12.795689 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.795666 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tbhhd\"" Jul 14 00:45:12.803872 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.803855 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:45:12.812259 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.812236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:45:12.812341 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.812269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:45:12.812341 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.812312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:45:12.812452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.812394 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:45:12.812452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.812413 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:45:12.812452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.812391 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:45:12.812452 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.812445 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:45:12.812582 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.812475 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:45:44.812453023 +0000 UTC m=+98.301790451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:45:12.812582 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.812493 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:45:44.812485281 +0000 UTC m=+98.301822703 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:45:12.812582 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:12.812508 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:45:44.812499421 +0000 UTC m=+98.301836839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:45:12.950690 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.950612 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rq4ld"] Jul 14 00:45:12.954534 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:45:12.954509 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92683eb7_9da4_407b_ac51_ac53b3400ad2.slice/crio-0c89686dc5f50867b606f6c8aad64b99719c22e854f27a280b622195cbe71e35 WatchSource:0}: Error finding container 0c89686dc5f50867b606f6c8aad64b99719c22e854f27a280b622195cbe71e35: Status 404 returned error can't find the container with id 0c89686dc5f50867b606f6c8aad64b99719c22e854f27a280b622195cbe71e35 Jul 14 00:45:12.983347 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:12.983250 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ffbmn"] Jul 14 00:45:12.986330 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:45:12.986303 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0d2657_485c_451f_9895_d620ae4b7aee.slice/crio-889ced0991c28c3b1d61ddb342dd59474eae421554025b5fa0790b3a7f6053bf WatchSource:0}: Error finding container 889ced0991c28c3b1d61ddb342dd59474eae421554025b5fa0790b3a7f6053bf: Status 404 returned error can't find the container with id 889ced0991c28c3b1d61ddb342dd59474eae421554025b5fa0790b3a7f6053bf Jul 14 00:45:13.198273 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:13.198241 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rq4ld" event={"ID":"92683eb7-9da4-407b-ac51-ac53b3400ad2","Type":"ContainerStarted","Data":"0c89686dc5f50867b606f6c8aad64b99719c22e854f27a280b622195cbe71e35"} Jul 14 00:45:13.199204 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:13.199183 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ffbmn" event={"ID":"ab0d2657-485c-451f-9895-d620ae4b7aee","Type":"ContainerStarted","Data":"889ced0991c28c3b1d61ddb342dd59474eae421554025b5fa0790b3a7f6053bf"} Jul 14 00:45:18.213028 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:18.212995 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ffbmn" event={"ID":"ab0d2657-485c-451f-9895-d620ae4b7aee","Type":"ContainerStarted","Data":"1f2bc2dd69f4eae8a1c4cbc8bc3cf12f025024c84862e9c7e9daaa0755011296"} Jul 14 00:45:18.213463 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:18.213088 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:45:18.214329 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:18.214303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rq4ld" event={"ID":"92683eb7-9da4-407b-ac51-ac53b3400ad2","Type":"ContainerStarted","Data":"a0664a1068a92f1f09897c011267db743b4c7dc0d6e5c721718d1a6b78a9a4b2"} Jul 14 00:45:18.228229 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:18.228190 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ffbmn" podStartSLOduration=66.805990161 podStartE2EDuration="1m11.228178282s" totalImagesPullingTime="4.422188121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:45:18.227536871 +0000 UTC m=+71.716874311" watchObservedRunningTime="2026-07-14 00:45:18.228178282 +0000 UTC m=+71.717515721" Jul 14 00:45:18.242672 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:18.242625 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rq4ld" podStartSLOduration=66.736146919 podStartE2EDuration="1m11.242611151s" totalImagesPullingTime="4.506464232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:45:18.242220688 +0000 UTC m=+71.731558128" watchObservedRunningTime="2026-07-14 00:45:18.242611151 +0000 UTC m=+71.731948590" Jul 14 00:45:44.847998 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:44.847935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:44.848034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:44.848053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:44.848111 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:44.848151 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:44.848162 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:44.848178 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:46:48.848163146 +0000 UTC m=+162.337500564 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:44.848181 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:44.848203 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:46:48.848193155 +0000 UTC m=+162.337530573 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:45:44.848339 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:45:44.848236 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:46:48.848222002 +0000 UTC m=+162.337559423 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:45:49.218621 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:45:49.218586 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ffbmn" Jul 14 00:46:16.762945 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:46:16.762898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:46:16.763475 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:16.763041 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 00:46:16.763475 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:16.763124 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:18.763104037 +0000 UTC m=+252.252441456 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : secret "metrics-daemon-secret" not found Jul 14 00:46:43.921738 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:43.921684 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" Jul 14 00:46:43.928852 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:43.928827 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" podUID="0c780bc8-8b4d-4996-8ed6-512ec2c36698" Jul 14 00:46:43.939232 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:43.939203 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hcppl" podUID="42f902ed-ba3a-44cf-9a44-298fddd4ad7c" Jul 14 00:46:43.987809 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:43.987775 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:46:44.412601 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:46:44.412578 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:46:44.412751 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:46:44.412581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcppl" Jul 14 00:46:44.412751 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:46:44.412579 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:46:48.880399 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:46:48.880367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:46:48.880428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:46:48.880448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:48.880519 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:48.880532 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:48.880598 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls podName:42f902ed-ba3a-44cf-9a44-298fddd4ad7c nodeName:}" failed. No retries permitted until 2026-07-14 00:48:50.880575531 +0000 UTC m=+284.369912961 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls") pod "dns-default-hcppl" (UID: "42f902ed-ba3a-44cf-9a44-298fddd4ad7c") : secret "dns-default-metrics-tls" not found Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:48.880524 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:48.880614 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert podName:0c780bc8-8b4d-4996-8ed6-512ec2c36698 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:50.88060576 +0000 UTC m=+284.369943178 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fb9mw" (UID: "0c780bc8-8b4d-4996-8ed6-512ec2c36698") : secret "networking-console-plugin-cert" not found Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:48.880617 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c56d947b7-djn2g: secret "image-registry-tls" not found Jul 14 00:46:48.880825 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:46:48.880667 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls podName:2244a14f-2653-4bae-ad51-4f8c004b7dc4 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:50.880655739 +0000 UTC m=+284.369993157 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls") pod "image-registry-7c56d947b7-djn2g" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4") : secret "image-registry-tls" not found Jul 14 00:46:55.970086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:46:55.970037 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:48:12.616847 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.616814 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc"] Jul 14 00:48:12.619686 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.619657 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5"] Jul 14 00:48:12.619821 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.619784 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.624982 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.624930 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 00:48:12.624982 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.624952 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 00:48:12.625209 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.625187 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 00:48:12.625281 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.625218 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 00:48:12.625408 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.625344 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d4v2r\"" Jul 14 00:48:12.627106 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.627087 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-6t5n5"] Jul 14 00:48:12.627202 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.627136 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:12.629634 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.629616 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 00:48:12.629718 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.629638 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:48:12.629718 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.629671 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-757c6b86f6-f4szp"] Jul 14 00:48:12.629836 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.629821 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.629997 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.629979 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 00:48:12.630228 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.630205 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4zvqh\"" Jul 14 00:48:12.632400 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.632384 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.634519 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.634502 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:48:12.634519 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.634510 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 00:48:12.639245 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.638966 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 00:48:12.639507 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.639489 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xj4z4\"" Jul 14 00:48:12.639627 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.639613 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc"] Jul 14 00:48:12.640334 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.640317 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-6t5n5"] Jul 14 00:48:12.641786 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.641508 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 00:48:12.641786 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.641746 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 00:48:12.641958 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.641816 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 00:48:12.641958 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.641746 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 00:48:12.642097 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.642020 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 00:48:12.642097 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.642034 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 00:48:12.642640 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.642289 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 00:48:12.642640 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.642480 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bb6xp\"" Jul 14 00:48:12.643450 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.643428 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-757c6b86f6-f4szp"] Jul 14 00:48:12.647902 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.647882 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 00:48:12.651360 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.651342 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5"] Jul 14 00:48:12.707618 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.707588 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m"] Jul 14 00:48:12.710470 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.710456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.713411 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.713381 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 00:48:12.713701 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.713662 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 00:48:12.713961 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.713942 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rnfgz\"" Jul 14 00:48:12.714054 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.714010 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:48:12.714139 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.714059 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 00:48:12.714747 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.714730 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz"] Jul 14 00:48:12.717797 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.717781 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl"] Jul 14 00:48:12.717919 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.717904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.720252 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.720230 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 00:48:12.720561 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.720529 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl" Jul 14 00:48:12.720707 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.720566 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m"] Jul 14 00:48:12.720707 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.720601 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 00:48:12.720791 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.720772 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:48:12.720881 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.720867 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 00:48:12.720933 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.720895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m6dxb\"" Jul 14 00:48:12.723562 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.723542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5vz9x\"" Jul 14 00:48:12.728594 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.728577 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl"] Jul 14 00:48:12.729409 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.729393 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz"] Jul 14 00:48:12.738391 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:12.738492 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738439 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g596\" (UniqueName: \"kubernetes.io/projected/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-kube-api-access-6g596\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.738492 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77c239e6-26c2-4640-80e8-b8bc742c4d52-config\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.738594 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.738594 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-stats-auth\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.738594 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77c239e6-26c2-4640-80e8-b8bc742c4d52-serving-cert\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.738729 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738615 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.738729 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrll\" (UniqueName: \"kubernetes.io/projected/8875c09d-0228-471f-bfb6-24f21d712861-kube-api-access-psrll\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:12.738729 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738707 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ln7f\" (UniqueName: \"kubernetes.io/projected/2219064b-6999-40ed-a34a-a744da807a9f-kube-api-access-6ln7f\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.738864 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.738864 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.738864 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77c239e6-26c2-4640-80e8-b8bc742c4d52-trusted-ca\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.739005 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-default-certificate\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.739005 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.738902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfxs\" (UniqueName: \"kubernetes.io/projected/77c239e6-26c2-4640-80e8-b8bc742c4d52-kube-api-access-cnfxs\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.839204 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3167bf47-5320-458a-be2e-e2258f27c826-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.839204 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839205 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3167bf47-5320-458a-be2e-e2258f27c826-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.839419 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839255 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77c239e6-26c2-4640-80e8-b8bc742c4d52-serving-cert\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.839419 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.839419 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839316 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrll\" (UniqueName: \"kubernetes.io/projected/8875c09d-0228-471f-bfb6-24f21d712861-kube-api-access-psrll\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:12.839419 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ln7f\" (UniqueName: \"kubernetes.io/projected/2219064b-6999-40ed-a34a-a744da807a9f-kube-api-access-6ln7f\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.839419 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.839419 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqlfg\" (UniqueName: \"kubernetes.io/projected/addb0a1d-5f3b-4a93-a47c-8001277801e3-kube-api-access-qqlfg\") pod \"network-check-source-869dcfcdcd-jxlnl\" (UID: \"addb0a1d-5f3b-4a93-a47c-8001277801e3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl" Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:12.839437 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:13.339417007 +0000 UTC m=+246.828754450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : configmap references non-existent config key: service-ca.crt Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839459 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:12.839475 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77c239e6-26c2-4640-80e8-b8bc742c4d52-trusted-ca\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78rmf\" (UniqueName: \"kubernetes.io/projected/3167bf47-5320-458a-be2e-e2258f27c826-kube-api-access-78rmf\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:12.839534 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls podName:b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:13.339519942 +0000 UTC m=+246.828857372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-57lpc" (UID: "b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17") : secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-default-certificate\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfxs\" (UniqueName: \"kubernetes.io/projected/77c239e6-26c2-4640-80e8-b8bc742c4d52-kube-api-access-cnfxs\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc44308a-2e06-48a6-8325-1888467e90e6-config\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.839695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839675 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839717 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g596\" (UniqueName: \"kubernetes.io/projected/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-kube-api-access-6g596\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77c239e6-26c2-4640-80e8-b8bc742c4d52-config\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc44308a-2e06-48a6-8325-1888467e90e6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839890 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-stats-auth\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:12.839895 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.839916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q44j4\" (UniqueName: \"kubernetes.io/projected/fc44308a-2e06-48a6-8325-1888467e90e6-kube-api-access-q44j4\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:12.839959 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls podName:8875c09d-0228-471f-bfb6-24f21d712861 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:13.339941545 +0000 UTC m=+246.829278983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls") pod "cluster-samples-operator-65db858894-4rgm5" (UID: "8875c09d-0228-471f-bfb6-24f21d712861") : secret "samples-operator-tls" not found Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:12.840045 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 00:48:12.840266 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:12.840130 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:13.340114229 +0000 UTC m=+246.829451649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : secret "router-metrics-certs-default" not found Jul 14 00:48:12.840761 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.840305 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.840761 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.840394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77c239e6-26c2-4640-80e8-b8bc742c4d52-trusted-ca\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.840761 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.840702 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77c239e6-26c2-4640-80e8-b8bc742c4d52-config\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.841734 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.841709 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77c239e6-26c2-4640-80e8-b8bc742c4d52-serving-cert\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.842082 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.842038 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-default-certificate\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.842253 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.842237 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-stats-auth\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.853507 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.853487 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfxs\" (UniqueName: \"kubernetes.io/projected/77c239e6-26c2-4640-80e8-b8bc742c4d52-kube-api-access-cnfxs\") pod \"console-operator-7866497494-6t5n5\" (UID: \"77c239e6-26c2-4640-80e8-b8bc742c4d52\") " pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:12.853629 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.853617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ln7f\" (UniqueName: \"kubernetes.io/projected/2219064b-6999-40ed-a34a-a744da807a9f-kube-api-access-6ln7f\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:12.853813 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.853795 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g596\" (UniqueName: \"kubernetes.io/projected/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-kube-api-access-6g596\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:12.853926 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.853910 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrll\" (UniqueName: \"kubernetes.io/projected/8875c09d-0228-471f-bfb6-24f21d712861-kube-api-access-psrll\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:12.940685 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.940665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc44308a-2e06-48a6-8325-1888467e90e6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.940814 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.940695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q44j4\" (UniqueName: \"kubernetes.io/projected/fc44308a-2e06-48a6-8325-1888467e90e6-kube-api-access-q44j4\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.940814 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.940719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3167bf47-5320-458a-be2e-e2258f27c826-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.940928 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.940826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3167bf47-5320-458a-be2e-e2258f27c826-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.940990 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.940928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlfg\" (UniqueName: \"kubernetes.io/projected/addb0a1d-5f3b-4a93-a47c-8001277801e3-kube-api-access-qqlfg\") pod \"network-check-source-869dcfcdcd-jxlnl\" (UID: \"addb0a1d-5f3b-4a93-a47c-8001277801e3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl" Jul 14 00:48:12.940990 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.940963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78rmf\" (UniqueName: \"kubernetes.io/projected/3167bf47-5320-458a-be2e-e2258f27c826-kube-api-access-78rmf\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.941114 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.941006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc44308a-2e06-48a6-8325-1888467e90e6-config\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.941438 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.941418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3167bf47-5320-458a-be2e-e2258f27c826-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.941594 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.941580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc44308a-2e06-48a6-8325-1888467e90e6-config\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.942763 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.942744 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc44308a-2e06-48a6-8325-1888467e90e6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.942971 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.942851 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3167bf47-5320-458a-be2e-e2258f27c826-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.948351 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.948325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q44j4\" (UniqueName: \"kubernetes.io/projected/fc44308a-2e06-48a6-8325-1888467e90e6-kube-api-access-q44j4\") pod \"service-ca-operator-7695fc6c8c-h8b8m\" (UID: \"fc44308a-2e06-48a6-8325-1888467e90e6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:12.949256 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.949236 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78rmf\" (UniqueName: \"kubernetes.io/projected/3167bf47-5320-458a-be2e-e2258f27c826-kube-api-access-78rmf\") pod \"kube-storage-version-migrator-operator-799cb7f958-2nptz\" (UID: \"3167bf47-5320-458a-be2e-e2258f27c826\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:12.949331 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.949302 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqlfg\" (UniqueName: \"kubernetes.io/projected/addb0a1d-5f3b-4a93-a47c-8001277801e3-kube-api-access-qqlfg\") pod \"network-check-source-869dcfcdcd-jxlnl\" (UID: \"addb0a1d-5f3b-4a93-a47c-8001277801e3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl" Jul 14 00:48:12.952102 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:12.952084 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:13.019781 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.019755 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" Jul 14 00:48:13.027554 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.027529 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" Jul 14 00:48:13.034443 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.034414 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl" Jul 14 00:48:13.075940 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.075861 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-6t5n5"] Jul 14 00:48:13.079707 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:13.079674 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c239e6_26c2_4640_80e8_b8bc742c4d52.slice/crio-229242a84e9c387ea4a791b9132097ce977c0207de929ba3e8ed9a99ebd6d1d0 WatchSource:0}: Error finding container 229242a84e9c387ea4a791b9132097ce977c0207de929ba3e8ed9a99ebd6d1d0: Status 404 returned error can't find the container with id 229242a84e9c387ea4a791b9132097ce977c0207de929ba3e8ed9a99ebd6d1d0 Jul 14 00:48:13.165159 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.165129 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m"] Jul 14 00:48:13.168959 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:13.168932 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc44308a_2e06_48a6_8325_1888467e90e6.slice/crio-33dce76d3e46161ad5d761794462197d1fbf5f21e6e8852d52a0abb2fed83e10 WatchSource:0}: Error finding container 33dce76d3e46161ad5d761794462197d1fbf5f21e6e8852d52a0abb2fed83e10: Status 404 returned error can't find the container with id 33dce76d3e46161ad5d761794462197d1fbf5f21e6e8852d52a0abb2fed83e10 Jul 14 00:48:13.179575 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.179494 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz"] Jul 14 00:48:13.181931 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:13.181908 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3167bf47_5320_458a_be2e_e2258f27c826.slice/crio-b19822014a6c2d6de1fa81aec81f8b0625ae789ac6311e770bbbc72ee5026a14 WatchSource:0}: Error finding container b19822014a6c2d6de1fa81aec81f8b0625ae789ac6311e770bbbc72ee5026a14: Status 404 returned error can't find the container with id b19822014a6c2d6de1fa81aec81f8b0625ae789ac6311e770bbbc72ee5026a14 Jul 14 00:48:13.194985 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.194933 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl"] Jul 14 00:48:13.197696 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:13.197674 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddb0a1d_5f3b_4a93_a47c_8001277801e3.slice/crio-6aa1e44ed0b1e7034abffe24a47a1f72e3c785e34b9bc6f4784b1a4327cd8064 WatchSource:0}: Error finding container 6aa1e44ed0b1e7034abffe24a47a1f72e3c785e34b9bc6f4784b1a4327cd8064: Status 404 returned error can't find the container with id 6aa1e44ed0b1e7034abffe24a47a1f72e3c785e34b9bc6f4784b1a4327cd8064 Jul 14 00:48:13.344393 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.344353 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:13.344393 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.344403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:13.344638 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.344431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:13.344638 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.344471 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:13.344638 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:13.344502 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 00:48:13.344638 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:13.344557 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 00:48:13.344638 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:13.344568 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:13.344638 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:13.344565 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls podName:8875c09d-0228-471f-bfb6-24f21d712861 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:14.344550561 +0000 UTC m=+247.833887983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls") pod "cluster-samples-operator-65db858894-4rgm5" (UID: "8875c09d-0228-471f-bfb6-24f21d712861") : secret "samples-operator-tls" not found Jul 14 00:48:13.344638 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:13.344614 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:14.344597981 +0000 UTC m=+247.833935400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : secret "router-metrics-certs-default" not found Jul 14 00:48:13.344638 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:13.344633 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:14.34462364 +0000 UTC m=+247.833961065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : configmap references non-existent config key: service-ca.crt Jul 14 00:48:13.345029 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:13.344654 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls podName:b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:14.34464499 +0000 UTC m=+247.833982411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-57lpc" (UID: "b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17") : secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:13.622094 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.621986 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6t5n5" event={"ID":"77c239e6-26c2-4640-80e8-b8bc742c4d52","Type":"ContainerStarted","Data":"229242a84e9c387ea4a791b9132097ce977c0207de929ba3e8ed9a99ebd6d1d0"} Jul 14 00:48:13.623129 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.623106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" event={"ID":"fc44308a-2e06-48a6-8325-1888467e90e6","Type":"ContainerStarted","Data":"33dce76d3e46161ad5d761794462197d1fbf5f21e6e8852d52a0abb2fed83e10"} Jul 14 00:48:13.624162 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.624135 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" event={"ID":"3167bf47-5320-458a-be2e-e2258f27c826","Type":"ContainerStarted","Data":"b19822014a6c2d6de1fa81aec81f8b0625ae789ac6311e770bbbc72ee5026a14"} Jul 14 00:48:13.625438 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.625417 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl" event={"ID":"addb0a1d-5f3b-4a93-a47c-8001277801e3","Type":"ContainerStarted","Data":"45c9db5e0c23d6b47dfe492ec0c7a1ed39ae861ed11b5909d193aaccecf1a8ec"} Jul 14 00:48:13.625519 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.625455 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl" event={"ID":"addb0a1d-5f3b-4a93-a47c-8001277801e3","Type":"ContainerStarted","Data":"6aa1e44ed0b1e7034abffe24a47a1f72e3c785e34b9bc6f4784b1a4327cd8064"} Jul 14 00:48:13.640078 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:13.640014 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-jxlnl" podStartSLOduration=1.639998615 podStartE2EDuration="1.639998615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:13.639685894 +0000 UTC m=+247.129023335" watchObservedRunningTime="2026-07-14 00:48:13.639998615 +0000 UTC m=+247.129336054" Jul 14 00:48:14.354385 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:14.354344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:14.354581 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:14.354437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:14.354581 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:14.354493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:14.354581 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:14.354526 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:16.354504018 +0000 UTC m=+249.843841455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : configmap references non-existent config key: service-ca.crt Jul 14 00:48:14.354752 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:14.354595 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 00:48:14.354752 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:14.354603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:14.354752 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:14.354645 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls podName:8875c09d-0228-471f-bfb6-24f21d712861 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:16.354629273 +0000 UTC m=+249.843966706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls") pod "cluster-samples-operator-65db858894-4rgm5" (UID: "8875c09d-0228-471f-bfb6-24f21d712861") : secret "samples-operator-tls" not found Jul 14 00:48:14.354752 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:14.354685 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 00:48:14.354752 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:14.354717 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:16.354706879 +0000 UTC m=+249.844044321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : secret "router-metrics-certs-default" not found Jul 14 00:48:14.355009 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:14.354769 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:14.355009 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:14.354809 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls podName:b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:16.354797285 +0000 UTC m=+249.844134739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-57lpc" (UID: "b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17") : secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:16.375170 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.375122 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.375213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.375266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:16.375293 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.375319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:16.375376 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls podName:b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:20.37535345 +0000 UTC m=+253.864690871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-57lpc" (UID: "b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17") : secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:16.375380 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:16.375436 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:16.375462 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls podName:8875c09d-0228-471f-bfb6-24f21d712861 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:20.375444352 +0000 UTC m=+253.864781785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls") pod "cluster-samples-operator-65db858894-4rgm5" (UID: "8875c09d-0228-471f-bfb6-24f21d712861") : secret "samples-operator-tls" not found Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:16.375484 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:20.375473776 +0000 UTC m=+253.864811195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : configmap references non-existent config key: service-ca.crt Jul 14 00:48:16.375624 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:16.375529 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:20.375515188 +0000 UTC m=+253.864852619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : secret "router-metrics-certs-default" not found Jul 14 00:48:16.960804 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.960771 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-srnkw"] Jul 14 00:48:16.964360 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.964340 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:16.966822 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.966803 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 00:48:16.966917 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.966812 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 00:48:16.966989 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.966812 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 00:48:16.966989 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.966819 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-942xj\"" Jul 14 00:48:16.967116 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.966827 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 00:48:16.973685 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:16.973467 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-srnkw"] Jul 14 00:48:17.082479 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.082449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/643592c5-8987-41f5-bdaf-1f54af580371-crio-socket\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.082479 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.082481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/643592c5-8987-41f5-bdaf-1f54af580371-data-volume\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.082670 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.082503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.082670 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.082548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ks9s\" (UniqueName: \"kubernetes.io/projected/643592c5-8987-41f5-bdaf-1f54af580371-kube-api-access-8ks9s\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.082670 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.082593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643592c5-8987-41f5-bdaf-1f54af580371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.183964 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.183931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/643592c5-8987-41f5-bdaf-1f54af580371-crio-socket\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.183964 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.183964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/643592c5-8987-41f5-bdaf-1f54af580371-data-volume\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.184245 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.183992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.184245 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.184046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ks9s\" (UniqueName: \"kubernetes.io/projected/643592c5-8987-41f5-bdaf-1f54af580371-kube-api-access-8ks9s\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.184245 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.184086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/643592c5-8987-41f5-bdaf-1f54af580371-crio-socket\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.184245 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.184127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643592c5-8987-41f5-bdaf-1f54af580371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.184245 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:17.184209 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 00:48:17.184458 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:17.184283 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls podName:643592c5-8987-41f5-bdaf-1f54af580371 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:17.684262484 +0000 UTC m=+251.173599907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srnkw" (UID: "643592c5-8987-41f5-bdaf-1f54af580371") : secret "insights-runtime-extractor-tls" not found Jul 14 00:48:17.184458 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.184360 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/643592c5-8987-41f5-bdaf-1f54af580371-data-volume\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.184618 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.184602 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643592c5-8987-41f5-bdaf-1f54af580371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.192559 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.192534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ks9s\" (UniqueName: \"kubernetes.io/projected/643592c5-8987-41f5-bdaf-1f54af580371-kube-api-access-8ks9s\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.637134 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.637096 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" event={"ID":"3167bf47-5320-458a-be2e-e2258f27c826","Type":"ContainerStarted","Data":"b5c414fbfc9b781ca07a1f7eed4ed26b6ec32d08c51229acf413d899403f3746"} Jul 14 00:48:17.638552 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.638530 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/0.log" Jul 14 00:48:17.638677 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.638570 2575 generic.go:356] "Generic (PLEG): container finished" podID="77c239e6-26c2-4640-80e8-b8bc742c4d52" containerID="823566958fdebf1ab013554230fc0f339a2fe246ed64f79d3228f1b50f85a818" exitCode=255 Jul 14 00:48:17.638677 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.638649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6t5n5" event={"ID":"77c239e6-26c2-4640-80e8-b8bc742c4d52","Type":"ContainerDied","Data":"823566958fdebf1ab013554230fc0f339a2fe246ed64f79d3228f1b50f85a818"} Jul 14 00:48:17.638823 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.638806 2575 scope.go:117] "RemoveContainer" containerID="823566958fdebf1ab013554230fc0f339a2fe246ed64f79d3228f1b50f85a818" Jul 14 00:48:17.640001 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.639981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" event={"ID":"fc44308a-2e06-48a6-8325-1888467e90e6","Type":"ContainerStarted","Data":"ebb41ae9dd959a3289f9b56f94b0aad744d1cb1c299ef370e85e4b3abafa51ab"} Jul 14 00:48:17.672827 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.672782 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" podStartSLOduration=2.214273123 podStartE2EDuration="5.672768549s" totalImagesPullingTime="3.458495426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:17.656273526 +0000 UTC m=+251.145610980" watchObservedRunningTime="2026-07-14 00:48:17.672768549 +0000 UTC m=+251.162105993" Jul 14 00:48:17.685435 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.685390 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" podStartSLOduration=2.203765169 podStartE2EDuration="5.685373411s" totalImagesPullingTime="3.481608242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:17.684993632 +0000 UTC m=+251.174331094" watchObservedRunningTime="2026-07-14 00:48:17.685373411 +0000 UTC m=+251.174710853" Jul 14 00:48:17.689152 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:17.689121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:17.689265 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:17.689241 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 00:48:17.689320 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:17.689307 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls podName:643592c5-8987-41f5-bdaf-1f54af580371 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:18.689286018 +0000 UTC m=+252.178623437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srnkw" (UID: "643592c5-8987-41f5-bdaf-1f54af580371") : secret "insights-runtime-extractor-tls" not found Jul 14 00:48:18.644366 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:18.644336 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:48:18.644724 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:18.644709 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/0.log" Jul 14 00:48:18.644805 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:18.644741 2575 generic.go:356] "Generic (PLEG): container finished" podID="77c239e6-26c2-4640-80e8-b8bc742c4d52" containerID="6f15968b17473a9828117f5cdd4d877bc6bd6a60766e219ce11f731e8760934a" exitCode=255 Jul 14 00:48:18.644859 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:18.644834 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6t5n5" event={"ID":"77c239e6-26c2-4640-80e8-b8bc742c4d52","Type":"ContainerDied","Data":"6f15968b17473a9828117f5cdd4d877bc6bd6a60766e219ce11f731e8760934a"} Jul 14 00:48:18.644930 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:18.644917 2575 scope.go:117] "RemoveContainer" containerID="823566958fdebf1ab013554230fc0f339a2fe246ed64f79d3228f1b50f85a818" Jul 14 00:48:18.645274 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:18.645252 2575 scope.go:117] "RemoveContainer" containerID="6f15968b17473a9828117f5cdd4d877bc6bd6a60766e219ce11f731e8760934a" Jul 14 00:48:18.645439 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:18.645421 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6t5n5_openshift-console-operator(77c239e6-26c2-4640-80e8-b8bc742c4d52)\"" pod="openshift-console-operator/console-operator-7866497494-6t5n5" podUID="77c239e6-26c2-4640-80e8-b8bc742c4d52" Jul 14 00:48:18.699433 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:18.699409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:18.699576 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:18.699559 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 00:48:18.699630 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:18.699620 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls podName:643592c5-8987-41f5-bdaf-1f54af580371 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:20.699605662 +0000 UTC m=+254.188943084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srnkw" (UID: "643592c5-8987-41f5-bdaf-1f54af580371") : secret "insights-runtime-extractor-tls" not found Jul 14 00:48:18.800142 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:18.800108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:48:18.800402 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:18.800212 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 00:48:18.800496 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:18.800441 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs podName:d505356c-4ab9-4d74-a411-be8467553bf6 nodeName:}" failed. No retries permitted until 2026-07-14 00:50:20.800425387 +0000 UTC m=+374.289762809 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs") pod "network-metrics-daemon-vbw62" (UID: "d505356c-4ab9-4d74-a411-be8467553bf6") : secret "metrics-daemon-secret" not found Jul 14 00:48:19.155640 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:19.155610 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qtt9x_89e8396f-097a-429e-a698-a91fee24f257/dns-node-resolver/0.log" Jul 14 00:48:19.651323 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:19.651296 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:48:19.651662 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:19.651623 2575 scope.go:117] "RemoveContainer" containerID="6f15968b17473a9828117f5cdd4d877bc6bd6a60766e219ce11f731e8760934a" Jul 14 00:48:19.651787 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:19.651767 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6t5n5_openshift-console-operator(77c239e6-26c2-4640-80e8-b8bc742c4d52)\"" pod="openshift-console-operator/console-operator-7866497494-6t5n5" podUID="77c239e6-26c2-4640-80e8-b8bc742c4d52" Jul 14 00:48:19.754288 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:19.754267 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d5kjk_d09dae08-02ae-44c2-8f9b-95fc9c1913fc/node-ca/0.log" Jul 14 00:48:20.416129 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:20.416062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:20.416313 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:20.416160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:20.416313 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:20.416206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:20.416313 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.416223 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 00:48:20.416313 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:20.416242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:20.416313 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.416292 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:28.416274326 +0000 UTC m=+261.905611780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : secret "router-metrics-certs-default" not found Jul 14 00:48:20.416516 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.416321 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:28.416307151 +0000 UTC m=+261.905644608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : configmap references non-existent config key: service-ca.crt Jul 14 00:48:20.416516 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.416345 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 00:48:20.416516 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.416394 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls podName:8875c09d-0228-471f-bfb6-24f21d712861 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:28.416381585 +0000 UTC m=+261.905719029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls") pod "cluster-samples-operator-65db858894-4rgm5" (UID: "8875c09d-0228-471f-bfb6-24f21d712861") : secret "samples-operator-tls" not found Jul 14 00:48:20.416516 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.416346 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:20.416516 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.416432 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls podName:b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:28.416422628 +0000 UTC m=+261.905760049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-57lpc" (UID: "b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17") : secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:20.717867 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:20.717832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:20.718302 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.717953 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 00:48:20.718302 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:20.718006 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls podName:643592c5-8987-41f5-bdaf-1f54af580371 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:24.717992487 +0000 UTC m=+258.207329907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srnkw" (UID: "643592c5-8987-41f5-bdaf-1f54af580371") : secret "insights-runtime-extractor-tls" not found Jul 14 00:48:20.954948 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:20.954920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-skxgn_f47310b6-7f79-428b-87a8-178d10caaf14/serve-healthcheck-canary/0.log" Jul 14 00:48:22.952730 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:22.952689 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:22.953222 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:22.952744 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:22.953222 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:22.953183 2575 scope.go:117] "RemoveContainer" containerID="6f15968b17473a9828117f5cdd4d877bc6bd6a60766e219ce11f731e8760934a" Jul 14 00:48:22.953399 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:22.953376 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6t5n5_openshift-console-operator(77c239e6-26c2-4640-80e8-b8bc742c4d52)\"" pod="openshift-console-operator/console-operator-7866497494-6t5n5" podUID="77c239e6-26c2-4640-80e8-b8bc742c4d52" Jul 14 00:48:24.754522 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:24.754480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:24.755018 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:24.754659 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 00:48:24.755018 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:24.754741 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls podName:643592c5-8987-41f5-bdaf-1f54af580371 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:32.754720925 +0000 UTC m=+266.244058344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srnkw" (UID: "643592c5-8987-41f5-bdaf-1f54af580371") : secret "insights-runtime-extractor-tls" not found Jul 14 00:48:28.487944 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:28.487909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:28.488413 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:28.487962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:28.488413 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:28.488086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:28.488413 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:28.488172 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle podName:2219064b-6999-40ed-a34a-a744da807a9f nodeName:}" failed. No retries permitted until 2026-07-14 00:48:44.488157574 +0000 UTC m=+277.977494993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle") pod "router-default-757c6b86f6-f4szp" (UID: "2219064b-6999-40ed-a34a-a744da807a9f") : configmap references non-existent config key: service-ca.crt Jul 14 00:48:28.488413 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:28.488170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:28.488413 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:28.488292 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:28.488413 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:28.488348 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls podName:b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17 nodeName:}" failed. No retries permitted until 2026-07-14 00:48:44.488334567 +0000 UTC m=+277.977671986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-57lpc" (UID: "b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17") : secret "cluster-monitoring-operator-tls" not found Jul 14 00:48:28.490330 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:28.490301 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8875c09d-0228-471f-bfb6-24f21d712861-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-4rgm5\" (UID: \"8875c09d-0228-471f-bfb6-24f21d712861\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:28.490466 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:28.490358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2219064b-6999-40ed-a34a-a744da807a9f-metrics-certs\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:28.539765 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:28.539740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" Jul 14 00:48:28.656844 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:28.656774 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5"] Jul 14 00:48:29.683625 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:29.683589 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" event={"ID":"8875c09d-0228-471f-bfb6-24f21d712861","Type":"ContainerStarted","Data":"9265aeba585bd774759e846b9f684bee4f24486e430cf30f2ccc94c141626166"} Jul 14 00:48:30.688302 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:30.688272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" event={"ID":"8875c09d-0228-471f-bfb6-24f21d712861","Type":"ContainerStarted","Data":"3c05e56dab107d8a5e2dad46ad126990ad9c11b07d85c68169b1b5fd440792c6"} Jul 14 00:48:30.688659 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:30.688329 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" event={"ID":"8875c09d-0228-471f-bfb6-24f21d712861","Type":"ContainerStarted","Data":"8cf8d170e6da6bfe1fe414d2d478d071e5cf7e49a78c2018d64c264fd78f99a9"} Jul 14 00:48:30.704815 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:30.704603 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-4rgm5" podStartSLOduration=16.854073299 podStartE2EDuration="18.704581889s" totalImagesPullingTime="1.85050859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:30.703444492 +0000 UTC m=+264.192781959" watchObservedRunningTime="2026-07-14 00:48:30.704581889 +0000 UTC m=+264.193919330" Jul 14 00:48:32.822195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:32.822166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:32.824361 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:32.824327 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643592c5-8987-41f5-bdaf-1f54af580371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srnkw\" (UID: \"643592c5-8987-41f5-bdaf-1f54af580371\") " pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:32.876671 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:32.876649 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-srnkw" Jul 14 00:48:32.997319 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:32.997287 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-srnkw"] Jul 14 00:48:33.000864 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:33.000842 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643592c5_8987_41f5_bdaf_1f54af580371.slice/crio-998c7490c18e55fab379a1608d1ed68b8ab975866838aecccf19cbeb87e6c338 WatchSource:0}: Error finding container 998c7490c18e55fab379a1608d1ed68b8ab975866838aecccf19cbeb87e6c338: Status 404 returned error can't find the container with id 998c7490c18e55fab379a1608d1ed68b8ab975866838aecccf19cbeb87e6c338 Jul 14 00:48:33.699796 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:33.699751 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-srnkw" event={"ID":"643592c5-8987-41f5-bdaf-1f54af580371","Type":"ContainerStarted","Data":"998c7490c18e55fab379a1608d1ed68b8ab975866838aecccf19cbeb87e6c338"} Jul 14 00:48:34.970353 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:34.970326 2575 scope.go:117] "RemoveContainer" containerID="6f15968b17473a9828117f5cdd4d877bc6bd6a60766e219ce11f731e8760934a" Jul 14 00:48:36.712240 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:36.712220 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:48:37.721328 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:37.721249 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:48:37.721762 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:37.721348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6t5n5" event={"ID":"77c239e6-26c2-4640-80e8-b8bc742c4d52","Type":"ContainerStarted","Data":"0ad42058cf27d5b8af7710565dd6fcc1ed6ed58f37be0b3bcc77321147f74369"} Jul 14 00:48:37.721762 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:37.721667 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:37.723122 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:37.723101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-srnkw" event={"ID":"643592c5-8987-41f5-bdaf-1f54af580371","Type":"ContainerStarted","Data":"942981d965d82faf35a5b9d90a4d9396843b10ceaed00e3b0d3c38b4ec1e34f8"} Jul 14 00:48:37.723244 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:37.723141 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-srnkw" event={"ID":"643592c5-8987-41f5-bdaf-1f54af580371","Type":"ContainerStarted","Data":"f4d1309e87e22880c37c8c7f66e415d660340e84cb327f2e229f727b86b26093"} Jul 14 00:48:37.726423 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:37.726406 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-6t5n5" Jul 14 00:48:37.738256 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:37.738220 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-6t5n5" podStartSLOduration=22.173750323 podStartE2EDuration="25.738207222s" totalImagesPullingTime="3.564456899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:37.737344797 +0000 UTC m=+271.226682237" watchObservedRunningTime="2026-07-14 00:48:37.738207222 +0000 UTC m=+271.227544662" Jul 14 00:48:40.734539 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:40.734507 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-srnkw" event={"ID":"643592c5-8987-41f5-bdaf-1f54af580371","Type":"ContainerStarted","Data":"fe82477123b9541e6734aa867715c3ca88ccb7b5997ce115b4b9096abd41fcc6"} Jul 14 00:48:40.753558 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:40.753513 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-srnkw" podStartSLOduration=17.917715639 podStartE2EDuration="24.753498499s" totalImagesPullingTime="6.83578286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:48:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:40.752218785 +0000 UTC m=+274.241556226" watchObservedRunningTime="2026-07-14 00:48:40.753498499 +0000 UTC m=+274.242835944" Jul 14 00:48:44.520621 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:44.520570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:44.521016 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:44.520750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:44.521315 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:44.521293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2219064b-6999-40ed-a34a-a744da807a9f-service-ca-bundle\") pod \"router-default-757c6b86f6-f4szp\" (UID: \"2219064b-6999-40ed-a34a-a744da807a9f\") " pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:44.523172 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:44.523150 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-57lpc\" (UID: \"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:44.732916 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:44.732880 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" Jul 14 00:48:44.747211 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:44.747176 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:44.866966 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:44.866938 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc"] Jul 14 00:48:44.870100 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:44.870046 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03cb98a_7a6c_4760_ae4c_fe70aa0e5c17.slice/crio-8a32931f31403893339f9f6653038fcf36b3a6aa9f8d1ef585c9b636c2df66a3 WatchSource:0}: Error finding container 8a32931f31403893339f9f6653038fcf36b3a6aa9f8d1ef585c9b636c2df66a3: Status 404 returned error can't find the container with id 8a32931f31403893339f9f6653038fcf36b3a6aa9f8d1ef585c9b636c2df66a3 Jul 14 00:48:44.882742 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:44.882718 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-757c6b86f6-f4szp"] Jul 14 00:48:44.885319 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:44.885296 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2219064b_6999_40ed_a34a_a744da807a9f.slice/crio-5f01a6d548e1eecdacd809e500af269af12058da391e5954f9accb8b298d745f WatchSource:0}: Error finding container 5f01a6d548e1eecdacd809e500af269af12058da391e5954f9accb8b298d745f: Status 404 returned error can't find the container with id 5f01a6d548e1eecdacd809e500af269af12058da391e5954f9accb8b298d745f Jul 14 00:48:45.675436 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.675403 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68db8b49cc-zxstn"] Jul 14 00:48:45.678356 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.678338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.681251 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.681230 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 00:48:45.681349 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.681291 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 00:48:45.683094 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.683050 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 00:48:45.683208 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.683123 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 00:48:45.683208 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.683172 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 00:48:45.683208 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.683175 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 00:48:45.683391 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.683123 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4t8jn\"" Jul 14 00:48:45.683453 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.683440 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 00:48:45.687375 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.687327 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68db8b49cc-zxstn"] Jul 14 00:48:45.730157 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.730087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-oauth-serving-cert\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.730308 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.730225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-service-ca\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.730308 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.730263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t8g6\" (UniqueName: \"kubernetes.io/projected/1152245d-2a3e-4c00-82ae-12e5bf273926-kube-api-access-8t8g6\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.730308 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.730288 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-oauth-config\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.730445 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.730374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-console-config\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.730488 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.730467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-serving-cert\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.755248 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.755215 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-757c6b86f6-f4szp" event={"ID":"2219064b-6999-40ed-a34a-a744da807a9f","Type":"ContainerStarted","Data":"a9115837941a0e33839a669579b3d44ffb23ff2a14169965e8205c52d3ff0a86"} Jul 14 00:48:45.755389 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.755272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-757c6b86f6-f4szp" event={"ID":"2219064b-6999-40ed-a34a-a744da807a9f","Type":"ContainerStarted","Data":"5f01a6d548e1eecdacd809e500af269af12058da391e5954f9accb8b298d745f"} Jul 14 00:48:45.756549 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.756521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" event={"ID":"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17","Type":"ContainerStarted","Data":"8a32931f31403893339f9f6653038fcf36b3a6aa9f8d1ef585c9b636c2df66a3"} Jul 14 00:48:45.778112 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.778037 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-757c6b86f6-f4szp" podStartSLOduration=33.778017661 podStartE2EDuration="33.778017661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:45.776245128 +0000 UTC m=+279.265582615" watchObservedRunningTime="2026-07-14 00:48:45.778017661 +0000 UTC m=+279.267355083" Jul 14 00:48:45.831301 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.831271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t8g6\" (UniqueName: \"kubernetes.io/projected/1152245d-2a3e-4c00-82ae-12e5bf273926-kube-api-access-8t8g6\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.831435 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.831307 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-oauth-config\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.831435 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.831365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-console-config\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.831435 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.831425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-serving-cert\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.831587 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.831491 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-oauth-serving-cert\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.831587 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.831569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-service-ca\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.832291 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.832221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-console-config\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.832291 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.832266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-service-ca\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.832454 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.832308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-oauth-serving-cert\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.833706 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.833686 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-oauth-config\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.833889 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.833870 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-serving-cert\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.839321 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.839303 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t8g6\" (UniqueName: \"kubernetes.io/projected/1152245d-2a3e-4c00-82ae-12e5bf273926-kube-api-access-8t8g6\") pod \"console-68db8b49cc-zxstn\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:45.988356 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:45.988318 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:46.120842 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:46.120810 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68db8b49cc-zxstn"] Jul 14 00:48:46.123768 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:46.123678 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1152245d_2a3e_4c00_82ae_12e5bf273926.slice/crio-bc3b8ebcf993a316f9b2630378dd85b9b46cc9d79d7f362a65d1564fe4d2b550 WatchSource:0}: Error finding container bc3b8ebcf993a316f9b2630378dd85b9b46cc9d79d7f362a65d1564fe4d2b550: Status 404 returned error can't find the container with id bc3b8ebcf993a316f9b2630378dd85b9b46cc9d79d7f362a65d1564fe4d2b550 Jul 14 00:48:46.747505 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:46.747471 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:46.750392 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:46.750369 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:46.761164 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:46.761125 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68db8b49cc-zxstn" event={"ID":"1152245d-2a3e-4c00-82ae-12e5bf273926","Type":"ContainerStarted","Data":"bc3b8ebcf993a316f9b2630378dd85b9b46cc9d79d7f362a65d1564fe4d2b550"} Jul 14 00:48:46.761401 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:46.761372 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:46.762578 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:46.762558 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-757c6b86f6-f4szp" Jul 14 00:48:47.413031 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:47.412979 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" podUID="0c780bc8-8b4d-4996-8ed6-512ec2c36698" Jul 14 00:48:47.413234 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:47.413131 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" Jul 14 00:48:47.413234 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:47.413127 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hcppl" podUID="42f902ed-ba3a-44cf-9a44-298fddd4ad7c" Jul 14 00:48:47.770490 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:47.770442 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" event={"ID":"b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17","Type":"ContainerStarted","Data":"27ebbce928809c4490762ebf86a926a5783c7358a06aa0647d00da5b60544210"} Jul 14 00:48:47.770947 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:47.770504 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcppl" Jul 14 00:48:47.770947 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:47.770467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:48:47.771055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:47.771015 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:48:47.787590 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:47.787548 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-57lpc" podStartSLOduration=33.809177020999996 podStartE2EDuration="35.787534659s" totalImagesPullingTime="1.978357638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:47.785735898 +0000 UTC m=+281.275073368" watchObservedRunningTime="2026-07-14 00:48:47.787534659 +0000 UTC m=+281.276872100" Jul 14 00:48:49.779629 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:49.779590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68db8b49cc-zxstn" event={"ID":"1152245d-2a3e-4c00-82ae-12e5bf273926","Type":"ContainerStarted","Data":"445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada"} Jul 14 00:48:49.798765 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:49.798712 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68db8b49cc-zxstn" podStartSLOduration=1.260736786 podStartE2EDuration="4.798694347s" totalImagesPullingTime="3.537957561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:49.796719607 +0000 UTC m=+283.286057063" watchObservedRunningTime="2026-07-14 00:48:49.798694347 +0000 UTC m=+283.288031788" Jul 14 00:48:50.979389 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:50.979353 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:48:50.979389 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:50.979388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:48:50.979880 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:50.979415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:48:50.981771 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:50.981751 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f902ed-ba3a-44cf-9a44-298fddd4ad7c-metrics-tls\") pod \"dns-default-hcppl\" (UID: \"42f902ed-ba3a-44cf-9a44-298fddd4ad7c\") " pod="openshift-dns/dns-default-hcppl" Jul 14 00:48:50.981990 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:50.981969 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c780bc8-8b4d-4996-8ed6-512ec2c36698-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fb9mw\" (UID: \"0c780bc8-8b4d-4996-8ed6-512ec2c36698\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:48:50.982028 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:50.981969 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"image-registry-7c56d947b7-djn2g\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:48:51.075123 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.075095 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lstqb\"" Jul 14 00:48:51.075123 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.075122 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-np425\"" Jul 14 00:48:51.075296 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.075107 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rvlnc\"" Jul 14 00:48:51.082642 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.082614 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcppl" Jul 14 00:48:51.082642 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.082643 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:48:51.082792 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.082620 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" Jul 14 00:48:51.231477 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.231351 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c56d947b7-djn2g"] Jul 14 00:48:51.234724 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:51.234701 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2244a14f_2653_4bae_ad51_4f8c004b7dc4.slice/crio-a99358fb5bcd4f0330117cd71eb76b69acae28408a85de92a523d62bf7292e57 WatchSource:0}: Error finding container a99358fb5bcd4f0330117cd71eb76b69acae28408a85de92a523d62bf7292e57: Status 404 returned error can't find the container with id a99358fb5bcd4f0330117cd71eb76b69acae28408a85de92a523d62bf7292e57 Jul 14 00:48:51.455313 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.455275 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hcppl"] Jul 14 00:48:51.457991 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.457967 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fb9mw"] Jul 14 00:48:51.459390 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:51.459363 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f902ed_ba3a_44cf_9a44_298fddd4ad7c.slice/crio-e8b73bb7211f718b18edbc6a2230209b41d7caa251a141dea0e68ddcb0eb012b WatchSource:0}: Error finding container e8b73bb7211f718b18edbc6a2230209b41d7caa251a141dea0e68ddcb0eb012b: Status 404 returned error can't find the container with id e8b73bb7211f718b18edbc6a2230209b41d7caa251a141dea0e68ddcb0eb012b Jul 14 00:48:51.460756 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:51.460735 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c780bc8_8b4d_4996_8ed6_512ec2c36698.slice/crio-116e8798aab46826a0c894544fbe4ecd1931b349305cf31be783e4a21173b258 WatchSource:0}: Error finding container 116e8798aab46826a0c894544fbe4ecd1931b349305cf31be783e4a21173b258: Status 404 returned error can't find the container with id 116e8798aab46826a0c894544fbe4ecd1931b349305cf31be783e4a21173b258 Jul 14 00:48:51.786857 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.786823 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" event={"ID":"0c780bc8-8b4d-4996-8ed6-512ec2c36698","Type":"ContainerStarted","Data":"116e8798aab46826a0c894544fbe4ecd1931b349305cf31be783e4a21173b258"} Jul 14 00:48:51.788179 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.788156 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" event={"ID":"2244a14f-2653-4bae-ad51-4f8c004b7dc4","Type":"ContainerStarted","Data":"fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667"} Jul 14 00:48:51.788288 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.788196 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" event={"ID":"2244a14f-2653-4bae-ad51-4f8c004b7dc4","Type":"ContainerStarted","Data":"a99358fb5bcd4f0330117cd71eb76b69acae28408a85de92a523d62bf7292e57"} Jul 14 00:48:51.788288 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.788234 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:48:51.789226 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.789207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcppl" event={"ID":"42f902ed-ba3a-44cf-9a44-298fddd4ad7c","Type":"ContainerStarted","Data":"e8b73bb7211f718b18edbc6a2230209b41d7caa251a141dea0e68ddcb0eb012b"} Jul 14 00:48:51.809738 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:51.809697 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" podStartSLOduration=284.809682144 podStartE2EDuration="4m44.809682144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:51.808001962 +0000 UTC m=+285.297339415" watchObservedRunningTime="2026-07-14 00:48:51.809682144 +0000 UTC m=+285.299019585" Jul 14 00:48:53.469558 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.469522 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f88b48d9-qlrdk"] Jul 14 00:48:53.473216 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.473188 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.482761 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.482737 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 00:48:53.483510 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.483485 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f88b48d9-qlrdk"] Jul 14 00:48:53.601815 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.601792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-trusted-ca-bundle\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.601927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.601821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-console-config\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.601927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.601840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-serving-cert\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.601927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.601863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfr2b\" (UniqueName: \"kubernetes.io/projected/198a5be2-c774-4b9f-913a-ccf762710bf9-kube-api-access-xfr2b\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.602022 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.601957 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-oauth-serving-cert\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.602022 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.602013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-service-ca\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.602113 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.602035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-oauth-config\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.702940 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.702913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-oauth-serving-cert\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.703089 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.702974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-service-ca\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.703089 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.703004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-oauth-config\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.703089 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.703042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-trusted-ca-bundle\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.703089 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.703080 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-console-config\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.703305 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.703120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-serving-cert\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.703305 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.703142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfr2b\" (UniqueName: \"kubernetes.io/projected/198a5be2-c774-4b9f-913a-ccf762710bf9-kube-api-access-xfr2b\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.703935 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.703717 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-oauth-serving-cert\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.703935 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.703763 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-service-ca\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.704353 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.704238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-console-config\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.704590 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.704569 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-trusted-ca-bundle\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.705730 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.705709 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-oauth-config\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.705989 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.705971 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-serving-cert\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.714105 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.714084 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfr2b\" (UniqueName: \"kubernetes.io/projected/198a5be2-c774-4b9f-913a-ccf762710bf9-kube-api-access-xfr2b\") pod \"console-76f88b48d9-qlrdk\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.785091 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.785046 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:48:53.797607 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.797579 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" event={"ID":"0c780bc8-8b4d-4996-8ed6-512ec2c36698","Type":"ContainerStarted","Data":"18dd831465822fc18a1f246ed8fdff3e6180768923650e46de5112ac1963f4a9"} Jul 14 00:48:53.799361 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.799339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcppl" event={"ID":"42f902ed-ba3a-44cf-9a44-298fddd4ad7c","Type":"ContainerStarted","Data":"859f49f82c4f1b21f1ec6502cbb722a4cd3578940fa811aaf6f77641120466d5"} Jul 14 00:48:53.799455 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.799398 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcppl" event={"ID":"42f902ed-ba3a-44cf-9a44-298fddd4ad7c","Type":"ContainerStarted","Data":"b0939ae769d16e066f1815c0a35365f11c264662f7b4b40c37608665e80e54c2"} Jul 14 00:48:53.799455 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.799432 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hcppl" Jul 14 00:48:53.815083 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.815021 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-fb9mw" podStartSLOduration=278.531377902 podStartE2EDuration="4m39.815006073s" totalImagesPullingTime="1.283628171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:53.813908117 +0000 UTC m=+287.303245552" watchObservedRunningTime="2026-07-14 00:48:53.815006073 +0000 UTC m=+287.304343513" Jul 14 00:48:53.832141 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.832098 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hcppl" podStartSLOduration=251.740524697 podStartE2EDuration="4m13.832056276s" totalImagesPullingTime="2.091531579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:44:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:53.831370002 +0000 UTC m=+287.320707436" watchObservedRunningTime="2026-07-14 00:48:53.832056276 +0000 UTC m=+287.321393714" Jul 14 00:48:53.911475 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:53.911448 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f88b48d9-qlrdk"] Jul 14 00:48:53.914374 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:53.914352 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198a5be2_c774_4b9f_913a_ccf762710bf9.slice/crio-4d0d079ee5e7f7a7f2781a13ec6f05df053f0b6d4a84b819f0b70ba037277d16 WatchSource:0}: Error finding container 4d0d079ee5e7f7a7f2781a13ec6f05df053f0b6d4a84b819f0b70ba037277d16: Status 404 returned error can't find the container with id 4d0d079ee5e7f7a7f2781a13ec6f05df053f0b6d4a84b819f0b70ba037277d16 Jul 14 00:48:54.803996 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:54.803951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f88b48d9-qlrdk" event={"ID":"198a5be2-c774-4b9f-913a-ccf762710bf9","Type":"ContainerStarted","Data":"2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f"} Jul 14 00:48:54.804430 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:54.804014 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f88b48d9-qlrdk" event={"ID":"198a5be2-c774-4b9f-913a-ccf762710bf9","Type":"ContainerStarted","Data":"4d0d079ee5e7f7a7f2781a13ec6f05df053f0b6d4a84b819f0b70ba037277d16"} Jul 14 00:48:54.821651 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:54.821605 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76f88b48d9-qlrdk" podStartSLOduration=1.821589369 podStartE2EDuration="1.821589369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:54.820553013 +0000 UTC m=+288.309890454" watchObservedRunningTime="2026-07-14 00:48:54.821589369 +0000 UTC m=+288.310926810" Jul 14 00:48:55.988844 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:55.988808 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:55.989255 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:55.988883 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:48:55.990194 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:55.990166 2575 patch_prober.go:28] interesting pod/console-68db8b49cc-zxstn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jul 14 00:48:55.990279 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:55.990210 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-68db8b49cc-zxstn" podUID="1152245d-2a3e-4c00-82ae-12e5bf273926" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" Jul 14 00:48:56.723519 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.723485 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg"] Jul 14 00:48:56.727768 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.727748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.730881 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.730857 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l5b8h\"" Jul 14 00:48:56.731014 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.730856 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 14 00:48:56.731014 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.730858 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 14 00:48:56.732386 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.732367 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 00:48:56.740703 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.740681 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg"] Jul 14 00:48:56.754461 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.754439 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m76n9"] Jul 14 00:48:56.757968 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.757949 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.760538 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.760519 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 00:48:56.760619 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.760542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 00:48:56.760773 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.760761 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6nrc5\"" Jul 14 00:48:56.760834 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.760810 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 00:48:56.828773 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-sys\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.828959 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828781 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25540b44-b2de-4a18-8f90-8f00cde41f9a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.828959 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chqvz\" (UniqueName: \"kubernetes.io/projected/25540b44-b2de-4a18-8f90-8f00cde41f9a-kube-api-access-chqvz\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.828959 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-wtmp\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.828959 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sthtg\" (UniqueName: \"kubernetes.io/projected/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-kube-api-access-sthtg\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.828959 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.828959 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25540b44-b2de-4a18-8f90-8f00cde41f9a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.829266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-root\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.829266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.828989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.829266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.829021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-textfile\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.829266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.829053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-metrics-client-ca\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.829266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.829099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-tls\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.829266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.829132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25540b44-b2de-4a18-8f90-8f00cde41f9a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.929812 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.929779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-sys\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.929812 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.929818 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25540b44-b2de-4a18-8f90-8f00cde41f9a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.929836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chqvz\" (UniqueName: \"kubernetes.io/projected/25540b44-b2de-4a18-8f90-8f00cde41f9a-kube-api-access-chqvz\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.929859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-wtmp\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.929878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sthtg\" (UniqueName: \"kubernetes.io/projected/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-kube-api-access-sthtg\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.929912 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-sys\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.929923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.929973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25540b44-b2de-4a18-8f90-8f00cde41f9a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-root\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930014 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-wtmp\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930511 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-textfile\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930511 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930126 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-root\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930511 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-metrics-client-ca\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930511 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-tls\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930511 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25540b44-b2de-4a18-8f90-8f00cde41f9a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.930511 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930503 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-textfile\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930801 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930602 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.930933 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.930913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25540b44-b2de-4a18-8f90-8f00cde41f9a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.931033 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.931015 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-metrics-client-ca\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.932950 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.932925 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-tls\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.933048 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.932928 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.933048 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.932972 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25540b44-b2de-4a18-8f90-8f00cde41f9a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.933145 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.933053 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25540b44-b2de-4a18-8f90-8f00cde41f9a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:56.940682 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.940640 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sthtg\" (UniqueName: \"kubernetes.io/projected/7fe240fd-f86e-4aa7-adcd-c832d6a53dec-kube-api-access-sthtg\") pod \"node-exporter-m76n9\" (UID: \"7fe240fd-f86e-4aa7-adcd-c832d6a53dec\") " pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:56.940844 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:56.940747 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chqvz\" (UniqueName: \"kubernetes.io/projected/25540b44-b2de-4a18-8f90-8f00cde41f9a-kube-api-access-chqvz\") pod \"openshift-state-metrics-84bd68b896-sl8bg\" (UID: \"25540b44-b2de-4a18-8f90-8f00cde41f9a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:57.037365 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:57.037278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" Jul 14 00:48:57.066985 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:57.066952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m76n9" Jul 14 00:48:57.079915 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:57.079883 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe240fd_f86e_4aa7_adcd_c832d6a53dec.slice/crio-f4e44c15379a5c13cdfe931bc53d13f5868cc93fa43556e99053190f3db0f0e7 WatchSource:0}: Error finding container f4e44c15379a5c13cdfe931bc53d13f5868cc93fa43556e99053190f3db0f0e7: Status 404 returned error can't find the container with id f4e44c15379a5c13cdfe931bc53d13f5868cc93fa43556e99053190f3db0f0e7 Jul 14 00:48:57.190565 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:57.190536 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg"] Jul 14 00:48:57.193303 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:57.193276 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25540b44_b2de_4a18_8f90_8f00cde41f9a.slice/crio-11cd81ef1aab10ccff6904f62263aab438d522d4b1594ac920a9dc8579e6113f WatchSource:0}: Error finding container 11cd81ef1aab10ccff6904f62263aab438d522d4b1594ac920a9dc8579e6113f: Status 404 returned error can't find the container with id 11cd81ef1aab10ccff6904f62263aab438d522d4b1594ac920a9dc8579e6113f Jul 14 00:48:57.818453 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:57.818400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m76n9" event={"ID":"7fe240fd-f86e-4aa7-adcd-c832d6a53dec","Type":"ContainerStarted","Data":"f4e44c15379a5c13cdfe931bc53d13f5868cc93fa43556e99053190f3db0f0e7"} Jul 14 00:48:57.820636 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:57.820608 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" event={"ID":"25540b44-b2de-4a18-8f90-8f00cde41f9a","Type":"ContainerStarted","Data":"e985d7ca062ef04d867c0fdcc96c01095e32c844b7763cc0bbe9bac27df04fb5"} Jul 14 00:48:57.820769 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:57.820662 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" event={"ID":"25540b44-b2de-4a18-8f90-8f00cde41f9a","Type":"ContainerStarted","Data":"00b57d2ff686107272afeb8628aad5a269e0123dfea2bd82d38100d4fb950e62"} Jul 14 00:48:57.820769 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:57.820692 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" event={"ID":"25540b44-b2de-4a18-8f90-8f00cde41f9a","Type":"ContainerStarted","Data":"11cd81ef1aab10ccff6904f62263aab438d522d4b1594ac920a9dc8579e6113f"} Jul 14 00:48:58.722483 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.722454 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp"] Jul 14 00:48:58.729135 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.729111 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.731841 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.731817 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 00:48:58.731841 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.731827 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 00:48:58.732058 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.731841 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 00:48:58.732058 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.731857 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-be1l51d4da59l\"" Jul 14 00:48:58.732058 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.731863 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 00:48:58.732058 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.731895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6dl4q\"" Jul 14 00:48:58.732625 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.732609 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 00:48:58.737086 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.737048 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp"] Jul 14 00:48:58.827913 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.827881 2575 generic.go:356] "Generic (PLEG): container finished" podID="7fe240fd-f86e-4aa7-adcd-c832d6a53dec" containerID="b7210f5be824879dee7c8828e6b6ee47b2280c5b66eb4d1a396bbd7ded933983" exitCode=0 Jul 14 00:48:58.828089 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.827961 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m76n9" event={"ID":"7fe240fd-f86e-4aa7-adcd-c832d6a53dec","Type":"ContainerDied","Data":"b7210f5be824879dee7c8828e6b6ee47b2280c5b66eb4d1a396bbd7ded933983"} Jul 14 00:48:58.830107 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.830086 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" event={"ID":"25540b44-b2de-4a18-8f90-8f00cde41f9a","Type":"ContainerStarted","Data":"bee930cc2c402a9f76d0e2953ad4a4f338fbf3a92a65bec947f9a3487441d098"} Jul 14 00:48:58.845545 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.845521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a053893b-41d3-4a81-a56d-089546b00d24-metrics-client-ca\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.845638 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.845572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.845755 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.845642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.845755 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.845668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.845755 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.845697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-grpc-tls\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.845755 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.845720 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz2rf\" (UniqueName: \"kubernetes.io/projected/a053893b-41d3-4a81-a56d-089546b00d24-kube-api-access-vz2rf\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.845943 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.845809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-tls\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.845943 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.845845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.862367 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.862331 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-sl8bg" podStartSLOduration=1.542499098 podStartE2EDuration="2.862318264s" totalImagesPullingTime="1.319819166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:58.861094943 +0000 UTC m=+292.350432402" watchObservedRunningTime="2026-07-14 00:48:58.862318264 +0000 UTC m=+292.351655705" Jul 14 00:48:58.946659 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.946631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-grpc-tls\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.946773 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.946685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz2rf\" (UniqueName: \"kubernetes.io/projected/a053893b-41d3-4a81-a56d-089546b00d24-kube-api-access-vz2rf\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.946773 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.946743 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-tls\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.946773 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.946768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.946932 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.946835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a053893b-41d3-4a81-a56d-089546b00d24-metrics-client-ca\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.946932 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.946920 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.947036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.946999 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.947366 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.947261 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.948244 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.948216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a053893b-41d3-4a81-a56d-089546b00d24-metrics-client-ca\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.949421 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.949392 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.949491 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.949420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-grpc-tls\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.949944 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.949926 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.950138 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.950121 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.950178 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.950150 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.950231 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.950217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a053893b-41d3-4a81-a56d-089546b00d24-secret-thanos-querier-tls\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.954963 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:58.954944 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz2rf\" (UniqueName: \"kubernetes.io/projected/a053893b-41d3-4a81-a56d-089546b00d24-kube-api-access-vz2rf\") pod \"thanos-querier-75cdb58fd8-h8xzp\" (UID: \"a053893b-41d3-4a81-a56d-089546b00d24\") " pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:58.970914 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:48:58.970888 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vbw62" podUID="d505356c-4ab9-4d74-a411-be8467553bf6" Jul 14 00:48:59.039542 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:59.039511 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:48:59.165509 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:59.165488 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp"] Jul 14 00:48:59.167560 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:48:59.167539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda053893b_41d3_4a81_a56d_089546b00d24.slice/crio-084b02f1524478c1f64c46684443625218cd50b9fa8bca1ef60a4aa5f873c38e WatchSource:0}: Error finding container 084b02f1524478c1f64c46684443625218cd50b9fa8bca1ef60a4aa5f873c38e: Status 404 returned error can't find the container with id 084b02f1524478c1f64c46684443625218cd50b9fa8bca1ef60a4aa5f873c38e Jul 14 00:48:59.834932 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:59.834895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" event={"ID":"a053893b-41d3-4a81-a56d-089546b00d24","Type":"ContainerStarted","Data":"084b02f1524478c1f64c46684443625218cd50b9fa8bca1ef60a4aa5f873c38e"} Jul 14 00:48:59.836703 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:59.836679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m76n9" event={"ID":"7fe240fd-f86e-4aa7-adcd-c832d6a53dec","Type":"ContainerStarted","Data":"45f6279756f274803064e508de3eea8886e7a0b3bb08c6bcc1852e9bdfc9a612"} Jul 14 00:48:59.836819 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:59.836724 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m76n9" event={"ID":"7fe240fd-f86e-4aa7-adcd-c832d6a53dec","Type":"ContainerStarted","Data":"7c7f7e6bae67095c217c5f0353c71236d4b86172d0d0e9508a6ee81baa3af1d3"} Jul 14 00:48:59.857724 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:48:59.857657 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m76n9" podStartSLOduration=2.853802537 podStartE2EDuration="3.857642771s" totalImagesPullingTime="942.798203ms" totalInitContainerRuntime="61.042031ms" isStatefulPod=true podCreationTimestamp="2026-07-14 00:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:48:59.856500773 +0000 UTC m=+293.345838213" watchObservedRunningTime="2026-07-14 00:48:59.857642771 +0000 UTC m=+293.346980252" Jul 14 00:49:01.075671 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.075640 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79d98d6f9b-pzdp5"] Jul 14 00:49:01.078739 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.078719 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.081258 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.081234 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 00:49:01.082332 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.082319 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 00:49:01.082717 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.082702 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 00:49:01.082791 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.082732 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fi57o8v88bqs6\"" Jul 14 00:49:01.082791 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.082767 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vnjbr\"" Jul 14 00:49:01.082907 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.082733 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 00:49:01.089786 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.089763 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79d98d6f9b-pzdp5"] Jul 14 00:49:01.167801 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.167760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b4eca78a-710a-4588-8976-b9b808bafd0f-metrics-server-audit-profiles\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.167965 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.167809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-client-ca-bundle\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.167965 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.167855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4eca78a-710a-4588-8976-b9b808bafd0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.167965 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.167928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b4eca78a-710a-4588-8976-b9b808bafd0f-audit-log\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.168152 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.167973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-secret-metrics-server-tls\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.168152 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.168026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-secret-metrics-server-client-certs\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.168152 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.168055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbv5n\" (UniqueName: \"kubernetes.io/projected/b4eca78a-710a-4588-8976-b9b808bafd0f-kube-api-access-vbv5n\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.268800 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.268757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-secret-metrics-server-tls\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.268800 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.268804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-secret-metrics-server-client-certs\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.269028 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.268946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbv5n\" (UniqueName: \"kubernetes.io/projected/b4eca78a-710a-4588-8976-b9b808bafd0f-kube-api-access-vbv5n\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.269111 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.269048 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b4eca78a-710a-4588-8976-b9b808bafd0f-metrics-server-audit-profiles\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.269111 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.269089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-client-ca-bundle\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.269220 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.269132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4eca78a-710a-4588-8976-b9b808bafd0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.269220 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.269190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b4eca78a-710a-4588-8976-b9b808bafd0f-audit-log\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.269707 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.269678 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b4eca78a-710a-4588-8976-b9b808bafd0f-audit-log\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.269972 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.269951 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4eca78a-710a-4588-8976-b9b808bafd0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.270237 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.270217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b4eca78a-710a-4588-8976-b9b808bafd0f-metrics-server-audit-profiles\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.271991 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.271861 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-secret-metrics-server-client-certs\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.271991 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.271961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-secret-metrics-server-tls\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.272144 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.271961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4eca78a-710a-4588-8976-b9b808bafd0f-client-ca-bundle\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.277422 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.277404 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbv5n\" (UniqueName: \"kubernetes.io/projected/b4eca78a-710a-4588-8976-b9b808bafd0f-kube-api-access-vbv5n\") pod \"metrics-server-79d98d6f9b-pzdp5\" (UID: \"b4eca78a-710a-4588-8976-b9b808bafd0f\") " pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.388884 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.388807 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:01.548467 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.548425 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv"] Jul 14 00:49:01.551883 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.551857 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:01.554988 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.554852 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xdmqr\"" Jul 14 00:49:01.555146 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.555112 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 00:49:01.559759 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.559735 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv"] Jul 14 00:49:01.673456 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.672961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hxwj\" (UniqueName: \"kubernetes.io/projected/b1c715ff-ca61-4366-b10e-d879e4e9eb2a-kube-api-access-7hxwj\") pod \"monitoring-plugin-5f68df7f58-2pkpv\" (UID: \"b1c715ff-ca61-4366-b10e-d879e4e9eb2a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:01.673456 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.673126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1c715ff-ca61-4366-b10e-d879e4e9eb2a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2pkpv\" (UID: \"b1c715ff-ca61-4366-b10e-d879e4e9eb2a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:01.745575 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.745549 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79d98d6f9b-pzdp5"] Jul 14 00:49:01.757119 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:49:01.757050 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4eca78a_710a_4588_8976_b9b808bafd0f.slice/crio-532d55c261c1a32b960318ca810367c5ae3051a0552cb64a26de7e45f6965c3a WatchSource:0}: Error finding container 532d55c261c1a32b960318ca810367c5ae3051a0552cb64a26de7e45f6965c3a: Status 404 returned error can't find the container with id 532d55c261c1a32b960318ca810367c5ae3051a0552cb64a26de7e45f6965c3a Jul 14 00:49:01.774177 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.774151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1c715ff-ca61-4366-b10e-d879e4e9eb2a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2pkpv\" (UID: \"b1c715ff-ca61-4366-b10e-d879e4e9eb2a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:01.774256 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.774201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hxwj\" (UniqueName: \"kubernetes.io/projected/b1c715ff-ca61-4366-b10e-d879e4e9eb2a-kube-api-access-7hxwj\") pod \"monitoring-plugin-5f68df7f58-2pkpv\" (UID: \"b1c715ff-ca61-4366-b10e-d879e4e9eb2a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:01.776380 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.776290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1c715ff-ca61-4366-b10e-d879e4e9eb2a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2pkpv\" (UID: \"b1c715ff-ca61-4366-b10e-d879e4e9eb2a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:01.782214 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.782187 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hxwj\" (UniqueName: \"kubernetes.io/projected/b1c715ff-ca61-4366-b10e-d879e4e9eb2a-kube-api-access-7hxwj\") pod \"monitoring-plugin-5f68df7f58-2pkpv\" (UID: \"b1c715ff-ca61-4366-b10e-d879e4e9eb2a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:01.847035 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.847001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" event={"ID":"b4eca78a-710a-4588-8976-b9b808bafd0f","Type":"ContainerStarted","Data":"532d55c261c1a32b960318ca810367c5ae3051a0552cb64a26de7e45f6965c3a"} Jul 14 00:49:01.849500 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.849474 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" event={"ID":"a053893b-41d3-4a81-a56d-089546b00d24","Type":"ContainerStarted","Data":"a2a7cca55b806aeaa927b28e12de91522e8f46325a3e634e8db9cad40302dfaa"} Jul 14 00:49:01.849588 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.849534 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" event={"ID":"a053893b-41d3-4a81-a56d-089546b00d24","Type":"ContainerStarted","Data":"f929cfb0110806528f47c55f12b202fccd50f41997b1429dc8fd325e27769eb1"} Jul 14 00:49:01.865492 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.865471 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:01.976809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.976780 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6fbffb985b-8rqxq"] Jul 14 00:49:01.981208 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.981187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:01.983937 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.983913 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 00:49:01.984132 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.984118 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 00:49:01.984317 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.984299 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-97nm9\"" Jul 14 00:49:01.984388 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.984303 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 00:49:01.984572 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.984557 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 00:49:01.985460 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.985428 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 00:49:01.990036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.990016 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 00:49:01.993217 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.993201 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv"] Jul 14 00:49:01.995530 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:49:01.995506 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c715ff_ca61_4366_b10e_d879e4e9eb2a.slice/crio-d587a601198785fe44733998c4c182af775d7a290d24476c4ad6344865d5b9d3 WatchSource:0}: Error finding container d587a601198785fe44733998c4c182af775d7a290d24476c4ad6344865d5b9d3: Status 404 returned error can't find the container with id d587a601198785fe44733998c4c182af775d7a290d24476c4ad6344865d5b9d3 Jul 14 00:49:01.997117 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:01.997097 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fbffb985b-8rqxq"] Jul 14 00:49:02.077531 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.077498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-metrics-client-ca\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.077880 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.077566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-serving-certs-ca-bundle\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.077880 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.077600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.077880 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.077623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.077880 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.077646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-federate-client-tls\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.077880 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.077701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-secret-telemeter-client\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.077880 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.077726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djv8g\" (UniqueName: \"kubernetes.io/projected/21be1a0d-511d-4191-815c-0001d6d7fff3-kube-api-access-djv8g\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.077880 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.077793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-telemeter-client-tls\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.178921 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.178844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.178921 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.178878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-federate-client-tls\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.178921 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.178906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-secret-telemeter-client\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.179145 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.179046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djv8g\" (UniqueName: \"kubernetes.io/projected/21be1a0d-511d-4191-815c-0001d6d7fff3-kube-api-access-djv8g\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.179236 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.179139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-telemeter-client-tls\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.179236 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.179209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-metrics-client-ca\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.179318 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.179270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-serving-certs-ca-bundle\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.179366 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.179316 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.179896 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.179872 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.180080 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.180042 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-metrics-client-ca\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.180129 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.180094 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21be1a0d-511d-4191-815c-0001d6d7fff3-serving-certs-ca-bundle\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.181548 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.181514 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-telemeter-client-tls\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.181622 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.181585 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-secret-telemeter-client\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.181814 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.181799 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.181892 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.181876 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21be1a0d-511d-4191-815c-0001d6d7fff3-federate-client-tls\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.186543 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.186526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djv8g\" (UniqueName: \"kubernetes.io/projected/21be1a0d-511d-4191-815c-0001d6d7fff3-kube-api-access-djv8g\") pod \"telemeter-client-6fbffb985b-8rqxq\" (UID: \"21be1a0d-511d-4191-815c-0001d6d7fff3\") " pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.292088 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.292034 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" Jul 14 00:49:02.446159 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.446131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fbffb985b-8rqxq"] Jul 14 00:49:02.448904 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:49:02.448880 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21be1a0d_511d_4191_815c_0001d6d7fff3.slice/crio-bb755470009d5d9b6d0d4649ab7495b39678907c628ca40d731ca45bdcb8468b WatchSource:0}: Error finding container bb755470009d5d9b6d0d4649ab7495b39678907c628ca40d731ca45bdcb8468b: Status 404 returned error can't find the container with id bb755470009d5d9b6d0d4649ab7495b39678907c628ca40d731ca45bdcb8468b Jul 14 00:49:02.685026 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.684995 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68db8b49cc-zxstn"] Jul 14 00:49:02.714750 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.714680 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-679b5d9997-t7hjb"] Jul 14 00:49:02.717995 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.717944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.729208 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.729082 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679b5d9997-t7hjb"] Jul 14 00:49:02.858724 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.858669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" event={"ID":"a053893b-41d3-4a81-a56d-089546b00d24","Type":"ContainerStarted","Data":"7554710f06186422e446b3e39360de996747289470d488e99c84cad3cea2805d"} Jul 14 00:49:02.860226 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.860200 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" event={"ID":"21be1a0d-511d-4191-815c-0001d6d7fff3","Type":"ContainerStarted","Data":"bb755470009d5d9b6d0d4649ab7495b39678907c628ca40d731ca45bdcb8468b"} Jul 14 00:49:02.861891 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.861860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" event={"ID":"b1c715ff-ca61-4366-b10e-d879e4e9eb2a","Type":"ContainerStarted","Data":"d587a601198785fe44733998c4c182af775d7a290d24476c4ad6344865d5b9d3"} Jul 14 00:49:02.885168 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.885135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-service-ca\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.885310 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.885208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-console-config\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.885310 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.885252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-trusted-ca-bundle\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.885396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.885328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-oauth-serving-cert\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.885396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.885356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-serving-cert\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.885396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.885376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkpfq\" (UniqueName: \"kubernetes.io/projected/f41169eb-c639-44b5-9fec-69e095067ada-kube-api-access-mkpfq\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.885517 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.885457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-oauth-config\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.986818 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.986786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-oauth-config\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.986979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.986838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-service-ca\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.986979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.986890 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-console-config\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.986979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.986936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-trusted-ca-bundle\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.986979 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.986977 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-oauth-serving-cert\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.987314 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.987010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-serving-cert\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.987314 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.987042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkpfq\" (UniqueName: \"kubernetes.io/projected/f41169eb-c639-44b5-9fec-69e095067ada-kube-api-access-mkpfq\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.988084 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.987999 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-service-ca\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.988084 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.988006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-oauth-serving-cert\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.988244 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.988135 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-console-config\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.988477 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.988452 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-trusted-ca-bundle\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.990170 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.990134 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-serving-cert\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.990286 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.990266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-oauth-config\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:02.995331 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:02.995294 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkpfq\" (UniqueName: \"kubernetes.io/projected/f41169eb-c639-44b5-9fec-69e095067ada-kube-api-access-mkpfq\") pod \"console-679b5d9997-t7hjb\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:03.031906 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:03.031884 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:03.785423 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:03.785386 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:49:03.785879 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:03.785456 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:49:03.786849 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:03.786819 2575 patch_prober.go:28] interesting pod/console-76f88b48d9-qlrdk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jul 14 00:49:03.786980 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:03.786871 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76f88b48d9-qlrdk" podUID="198a5be2-c774-4b9f-913a-ccf762710bf9" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jul 14 00:49:03.812897 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:03.812505 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hcppl" Jul 14 00:49:03.882955 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:03.882921 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" event={"ID":"a053893b-41d3-4a81-a56d-089546b00d24","Type":"ContainerStarted","Data":"6f2c791c5e9bceba71502518bbb82986ada10879e57560bf5a88d5345e06c5c3"} Jul 14 00:49:03.972104 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:03.972057 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679b5d9997-t7hjb"] Jul 14 00:49:03.974594 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:49:03.974569 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41169eb_c639_44b5_9fec_69e095067ada.slice/crio-f271b5ab893fd045ba2277a26710cb8de06088513949ffee5d6ad04f76c626dc WatchSource:0}: Error finding container f271b5ab893fd045ba2277a26710cb8de06088513949ffee5d6ad04f76c626dc: Status 404 returned error can't find the container with id f271b5ab893fd045ba2277a26710cb8de06088513949ffee5d6ad04f76c626dc Jul 14 00:49:04.888528 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.888495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" event={"ID":"b1c715ff-ca61-4366-b10e-d879e4e9eb2a","Type":"ContainerStarted","Data":"e353145d5a16b5bab3e5a711b62eb8223e229f3f1f1d916ac6cab81629a3a3d5"} Jul 14 00:49:04.888906 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.888681 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:04.890266 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.890240 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" event={"ID":"b4eca78a-710a-4588-8976-b9b808bafd0f","Type":"ContainerStarted","Data":"64366f34303b41c5ce1fdfd1b2d8161eab3accd46777078b89503928e80be217"} Jul 14 00:49:04.893525 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.893502 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" event={"ID":"a053893b-41d3-4a81-a56d-089546b00d24","Type":"ContainerStarted","Data":"32997503609b81196d081ae3a514a0f050770c517e0d415b2c4ad655963d8ed1"} Jul 14 00:49:04.893643 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.893598 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:49:04.893698 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.893645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" event={"ID":"a053893b-41d3-4a81-a56d-089546b00d24","Type":"ContainerStarted","Data":"b4a9f997357cb6f44425c0156a5665f85aad1e8f7a458473ae01f6b66af47e36"} Jul 14 00:49:04.894715 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.894694 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" Jul 14 00:49:04.895263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.895238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679b5d9997-t7hjb" event={"ID":"f41169eb-c639-44b5-9fec-69e095067ada","Type":"ContainerStarted","Data":"71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30"} Jul 14 00:49:04.895402 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.895279 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679b5d9997-t7hjb" event={"ID":"f41169eb-c639-44b5-9fec-69e095067ada","Type":"ContainerStarted","Data":"f271b5ab893fd045ba2277a26710cb8de06088513949ffee5d6ad04f76c626dc"} Jul 14 00:49:04.903788 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.903743 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2pkpv" podStartSLOduration=2.089317083 podStartE2EDuration="3.903729569s" totalImagesPullingTime="1.814412486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:49:04.9034559 +0000 UTC m=+298.392793343" watchObservedRunningTime="2026-07-14 00:49:04.903729569 +0000 UTC m=+298.393067012" Jul 14 00:49:04.927088 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.927017 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" podStartSLOduration=3.350246286 podStartE2EDuration="6.926996652s" totalImagesPullingTime="3.576750366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:48:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:49:04.925110835 +0000 UTC m=+298.414448295" watchObservedRunningTime="2026-07-14 00:49:04.926996652 +0000 UTC m=+298.416334094" Jul 14 00:49:04.957097 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.957031 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-679b5d9997-t7hjb" podStartSLOduration=2.9570137709999997 podStartE2EDuration="2.957013771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:49:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:49:04.955420266 +0000 UTC m=+298.444757710" watchObservedRunningTime="2026-07-14 00:49:04.957013771 +0000 UTC m=+298.446351211" Jul 14 00:49:04.985449 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:04.985391 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" podStartSLOduration=1.9374180239999998 podStartE2EDuration="3.985368832s" totalImagesPullingTime="2.047950808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:49:04.984930043 +0000 UTC m=+298.474267485" watchObservedRunningTime="2026-07-14 00:49:04.985368832 +0000 UTC m=+298.474706276" Jul 14 00:49:05.900596 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:05.900557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" event={"ID":"21be1a0d-511d-4191-815c-0001d6d7fff3","Type":"ContainerStarted","Data":"38106dd7745d9fd59130ff454eaa6bedb84011f341a91953f3da5c0120e235bd"} Jul 14 00:49:06.831607 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:06.831578 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:49:06.831889 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:06.831869 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:49:06.838882 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:06.838857 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:49:06.839109 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:06.839097 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:49:06.842251 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:06.842233 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 00:49:06.906127 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:06.906088 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" event={"ID":"21be1a0d-511d-4191-815c-0001d6d7fff3","Type":"ContainerStarted","Data":"424c4b83f04a769cae37a69d283ffff108fe8f7f6cabae1118d64459aa4c9c53"} Jul 14 00:49:06.906550 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:06.906182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" event={"ID":"21be1a0d-511d-4191-815c-0001d6d7fff3","Type":"ContainerStarted","Data":"05b3d2c0dd5c4cd584c1d5593b0051b3daa7cd050db342507b406544e8106abe"} Jul 14 00:49:06.931712 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:06.931667 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6fbffb985b-8rqxq" podStartSLOduration=2.537718182 podStartE2EDuration="5.931651454s" totalImagesPullingTime="3.393933272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:49:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:49:06.929672405 +0000 UTC m=+300.419009824" watchObservedRunningTime="2026-07-14 00:49:06.931651454 +0000 UTC m=+300.420988931" Jul 14 00:49:07.682334 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:07.682295 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f88b48d9-qlrdk"] Jul 14 00:49:10.907326 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:10.907300 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75cdb58fd8-h8xzp" Jul 14 00:49:11.087424 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:11.087393 2575 patch_prober.go:28] interesting pod/image-registry-7c56d947b7-djn2g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 00:49:11.087698 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:11.087440 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 00:49:11.528408 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:11.528373 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c56d947b7-djn2g"] Jul 14 00:49:11.532660 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:11.532631 2575 patch_prober.go:28] interesting pod/image-registry-7c56d947b7-djn2g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 00:49:11.532797 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:11.532680 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 00:49:13.032295 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:13.032268 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:13.032659 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:13.032315 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:13.036750 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:13.036726 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:13.941926 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:13.941893 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:13.969796 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:13.969768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:49:18.689695 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:18.689659 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679b5d9997-t7hjb"] Jul 14 00:49:21.389658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:21.389624 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:21.390020 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:21.389681 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:21.533249 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:21.533216 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:49:27.715186 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.715135 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68db8b49cc-zxstn" podUID="1152245d-2a3e-4c00-82ae-12e5bf273926" containerName="console" containerID="cri-o://445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada" gracePeriod=15 Jul 14 00:49:27.957600 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.957577 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:49:27.993055 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.992988 2575 generic.go:356] "Generic (PLEG): container finished" podID="3167bf47-5320-458a-be2e-e2258f27c826" containerID="b5c414fbfc9b781ca07a1f7eed4ed26b6ec32d08c51229acf413d899403f3746" exitCode=0 Jul 14 00:49:27.993184 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.993054 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" event={"ID":"3167bf47-5320-458a-be2e-e2258f27c826","Type":"ContainerDied","Data":"b5c414fbfc9b781ca07a1f7eed4ed26b6ec32d08c51229acf413d899403f3746"} Jul 14 00:49:27.993406 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.993389 2575 scope.go:117] "RemoveContainer" containerID="b5c414fbfc9b781ca07a1f7eed4ed26b6ec32d08c51229acf413d899403f3746" Jul 14 00:49:27.994541 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.994522 2575 generic.go:356] "Generic (PLEG): container finished" podID="1152245d-2a3e-4c00-82ae-12e5bf273926" containerID="445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada" exitCode=0 Jul 14 00:49:27.994645 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.994574 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68db8b49cc-zxstn" Jul 14 00:49:27.994645 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.994625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68db8b49cc-zxstn" event={"ID":"1152245d-2a3e-4c00-82ae-12e5bf273926","Type":"ContainerDied","Data":"445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada"} Jul 14 00:49:27.994826 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.994664 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68db8b49cc-zxstn" event={"ID":"1152245d-2a3e-4c00-82ae-12e5bf273926","Type":"ContainerDied","Data":"bc3b8ebcf993a316f9b2630378dd85b9b46cc9d79d7f362a65d1564fe4d2b550"} Jul 14 00:49:27.994826 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:27.994692 2575 scope.go:117] "RemoveContainer" containerID="445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada" Jul 14 00:49:28.000950 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.000932 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-console-config\") pod \"1152245d-2a3e-4c00-82ae-12e5bf273926\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " Jul 14 00:49:28.001045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.000967 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-serving-cert\") pod \"1152245d-2a3e-4c00-82ae-12e5bf273926\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " Jul 14 00:49:28.001045 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001005 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-service-ca\") pod \"1152245d-2a3e-4c00-82ae-12e5bf273926\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " Jul 14 00:49:28.001174 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001120 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-oauth-config\") pod \"1152245d-2a3e-4c00-82ae-12e5bf273926\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " Jul 14 00:49:28.001228 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001194 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-oauth-serving-cert\") pod \"1152245d-2a3e-4c00-82ae-12e5bf273926\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " Jul 14 00:49:28.001289 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001266 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t8g6\" (UniqueName: \"kubernetes.io/projected/1152245d-2a3e-4c00-82ae-12e5bf273926-kube-api-access-8t8g6\") pod \"1152245d-2a3e-4c00-82ae-12e5bf273926\" (UID: \"1152245d-2a3e-4c00-82ae-12e5bf273926\") " Jul 14 00:49:28.001382 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001358 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-service-ca" (OuterVolumeSpecName: "service-ca") pod "1152245d-2a3e-4c00-82ae-12e5bf273926" (UID: "1152245d-2a3e-4c00-82ae-12e5bf273926"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:28.001527 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001365 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-console-config" (OuterVolumeSpecName: "console-config") pod "1152245d-2a3e-4c00-82ae-12e5bf273926" (UID: "1152245d-2a3e-4c00-82ae-12e5bf273926"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:28.001620 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001598 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-console-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:28.001680 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001624 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:28.001786 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.001765 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1152245d-2a3e-4c00-82ae-12e5bf273926" (UID: "1152245d-2a3e-4c00-82ae-12e5bf273926"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:28.003409 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.003370 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1152245d-2a3e-4c00-82ae-12e5bf273926" (UID: "1152245d-2a3e-4c00-82ae-12e5bf273926"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:49:28.003651 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.003627 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1152245d-2a3e-4c00-82ae-12e5bf273926-kube-api-access-8t8g6" (OuterVolumeSpecName: "kube-api-access-8t8g6") pod "1152245d-2a3e-4c00-82ae-12e5bf273926" (UID: "1152245d-2a3e-4c00-82ae-12e5bf273926"). InnerVolumeSpecName "kube-api-access-8t8g6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:49:28.003722 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.003685 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1152245d-2a3e-4c00-82ae-12e5bf273926" (UID: "1152245d-2a3e-4c00-82ae-12e5bf273926"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:49:28.006221 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.006204 2575 scope.go:117] "RemoveContainer" containerID="445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada" Jul 14 00:49:28.006502 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:49:28.006479 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada\": container with ID starting with 445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada not found: ID does not exist" containerID="445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada" Jul 14 00:49:28.006568 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.006512 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada"} err="failed to get container status \"445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada\": rpc error: code = NotFound desc = could not find container \"445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada\": container with ID starting with 445b7b8fdd739a10910101d9785831c27703dec0c71b9578716258c548dacada not found: ID does not exist" Jul 14 00:49:28.102372 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.102347 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1152245d-2a3e-4c00-82ae-12e5bf273926-oauth-serving-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:28.102372 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.102370 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t8g6\" (UniqueName: \"kubernetes.io/projected/1152245d-2a3e-4c00-82ae-12e5bf273926-kube-api-access-8t8g6\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:28.102372 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.102380 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-serving-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:28.102578 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.102390 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1152245d-2a3e-4c00-82ae-12e5bf273926-console-oauth-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:28.316219 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.316188 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68db8b49cc-zxstn"] Jul 14 00:49:28.320554 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.320528 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68db8b49cc-zxstn"] Jul 14 00:49:28.975401 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:28.975366 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1152245d-2a3e-4c00-82ae-12e5bf273926" path="/var/lib/kubelet/pods/1152245d-2a3e-4c00-82ae-12e5bf273926/volumes" Jul 14 00:49:29.001573 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:29.001538 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2nptz" event={"ID":"3167bf47-5320-458a-be2e-e2258f27c826","Type":"ContainerStarted","Data":"ddc7ec3170d182b7c502384e5a81f659a752898ec962a6b30f1854c9e0d1ff1d"} Jul 14 00:49:32.703406 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:32.703368 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76f88b48d9-qlrdk" podUID="198a5be2-c774-4b9f-913a-ccf762710bf9" containerName="console" containerID="cri-o://2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f" gracePeriod=15 Jul 14 00:49:32.948732 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:32.948710 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:49:33.019655 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.019572 2575 generic.go:356] "Generic (PLEG): container finished" podID="198a5be2-c774-4b9f-913a-ccf762710bf9" containerID="2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f" exitCode=0 Jul 14 00:49:33.019655 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.019611 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f88b48d9-qlrdk" Jul 14 00:49:33.019655 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.019621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f88b48d9-qlrdk" event={"ID":"198a5be2-c774-4b9f-913a-ccf762710bf9","Type":"ContainerDied","Data":"2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f"} Jul 14 00:49:33.019938 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.019666 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f88b48d9-qlrdk" event={"ID":"198a5be2-c774-4b9f-913a-ccf762710bf9","Type":"ContainerDied","Data":"4d0d079ee5e7f7a7f2781a13ec6f05df053f0b6d4a84b819f0b70ba037277d16"} Jul 14 00:49:33.019938 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.019689 2575 scope.go:117] "RemoveContainer" containerID="2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f" Jul 14 00:49:33.027560 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.027540 2575 scope.go:117] "RemoveContainer" containerID="2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f" Jul 14 00:49:33.027814 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:49:33.027795 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f\": container with ID starting with 2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f not found: ID does not exist" containerID="2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f" Jul 14 00:49:33.027857 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.027823 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f"} err="failed to get container status \"2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f\": rpc error: code = NotFound desc = could not find container \"2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f\": container with ID starting with 2c87156006955d4d7779d979c79ed6913c2118b7e498ad4d804884c78e1d249f not found: ID does not exist" Jul 14 00:49:33.044277 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044259 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-console-config\") pod \"198a5be2-c774-4b9f-913a-ccf762710bf9\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " Jul 14 00:49:33.044345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044297 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-serving-cert\") pod \"198a5be2-c774-4b9f-913a-ccf762710bf9\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " Jul 14 00:49:33.044345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044316 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-service-ca\") pod \"198a5be2-c774-4b9f-913a-ccf762710bf9\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " Jul 14 00:49:33.044345 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044334 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-oauth-serving-cert\") pod \"198a5be2-c774-4b9f-913a-ccf762710bf9\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " Jul 14 00:49:33.044458 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044367 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-trusted-ca-bundle\") pod \"198a5be2-c774-4b9f-913a-ccf762710bf9\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " Jul 14 00:49:33.044458 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044389 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-oauth-config\") pod \"198a5be2-c774-4b9f-913a-ccf762710bf9\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " Jul 14 00:49:33.044458 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044433 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfr2b\" (UniqueName: \"kubernetes.io/projected/198a5be2-c774-4b9f-913a-ccf762710bf9-kube-api-access-xfr2b\") pod \"198a5be2-c774-4b9f-913a-ccf762710bf9\" (UID: \"198a5be2-c774-4b9f-913a-ccf762710bf9\") " Jul 14 00:49:33.044669 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044641 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-console-config" (OuterVolumeSpecName: "console-config") pod "198a5be2-c774-4b9f-913a-ccf762710bf9" (UID: "198a5be2-c774-4b9f-913a-ccf762710bf9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:33.044796 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044766 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-service-ca" (OuterVolumeSpecName: "service-ca") pod "198a5be2-c774-4b9f-913a-ccf762710bf9" (UID: "198a5be2-c774-4b9f-913a-ccf762710bf9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:33.044857 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044787 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "198a5be2-c774-4b9f-913a-ccf762710bf9" (UID: "198a5be2-c774-4b9f-913a-ccf762710bf9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:33.044857 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.044834 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "198a5be2-c774-4b9f-913a-ccf762710bf9" (UID: "198a5be2-c774-4b9f-913a-ccf762710bf9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:33.046363 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.046343 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "198a5be2-c774-4b9f-913a-ccf762710bf9" (UID: "198a5be2-c774-4b9f-913a-ccf762710bf9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:49:33.046460 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.046440 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "198a5be2-c774-4b9f-913a-ccf762710bf9" (UID: "198a5be2-c774-4b9f-913a-ccf762710bf9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:49:33.046566 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.046543 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198a5be2-c774-4b9f-913a-ccf762710bf9-kube-api-access-xfr2b" (OuterVolumeSpecName: "kube-api-access-xfr2b") pod "198a5be2-c774-4b9f-913a-ccf762710bf9" (UID: "198a5be2-c774-4b9f-913a-ccf762710bf9"). InnerVolumeSpecName "kube-api-access-xfr2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:49:33.145794 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.145769 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-trusted-ca-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:33.145794 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.145789 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-oauth-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:33.145924 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.145801 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfr2b\" (UniqueName: \"kubernetes.io/projected/198a5be2-c774-4b9f-913a-ccf762710bf9-kube-api-access-xfr2b\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:33.145924 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.145811 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-console-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:33.145924 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.145820 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/198a5be2-c774-4b9f-913a-ccf762710bf9-console-serving-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:33.145924 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.145828 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:33.145924 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.145836 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/198a5be2-c774-4b9f-913a-ccf762710bf9-oauth-serving-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:33.340134 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.340110 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f88b48d9-qlrdk"] Jul 14 00:49:33.343803 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:33.343780 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76f88b48d9-qlrdk"] Jul 14 00:49:34.975701 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:34.975663 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198a5be2-c774-4b9f-913a-ccf762710bf9" path="/var/lib/kubelet/pods/198a5be2-c774-4b9f-913a-ccf762710bf9/volumes" Jul 14 00:49:36.548208 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.548170 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" containerName="registry" containerID="cri-o://fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667" gracePeriod=30 Jul 14 00:49:36.791363 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.791343 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:49:36.875457 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875367 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dx8m\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-kube-api-access-2dx8m\") pod \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " Jul 14 00:49:36.875457 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875413 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-trusted-ca\") pod \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " Jul 14 00:49:36.875457 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875455 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2244a14f-2653-4bae-ad51-4f8c004b7dc4-ca-trust-extracted\") pod \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " Jul 14 00:49:36.875684 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875503 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-installation-pull-secrets\") pod \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " Jul 14 00:49:36.875684 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875535 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-image-registry-private-configuration\") pod \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " Jul 14 00:49:36.875684 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875588 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-bound-sa-token\") pod \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " Jul 14 00:49:36.875684 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875616 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") pod \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " Jul 14 00:49:36.875684 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875663 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-certificates\") pod \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\" (UID: \"2244a14f-2653-4bae-ad51-4f8c004b7dc4\") " Jul 14 00:49:36.875968 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.875931 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2244a14f-2653-4bae-ad51-4f8c004b7dc4" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:36.876372 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.876313 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2244a14f-2653-4bae-ad51-4f8c004b7dc4" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:36.878143 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.878117 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2244a14f-2653-4bae-ad51-4f8c004b7dc4" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:49:36.878236 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.878155 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-kube-api-access-2dx8m" (OuterVolumeSpecName: "kube-api-access-2dx8m") pod "2244a14f-2653-4bae-ad51-4f8c004b7dc4" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4"). InnerVolumeSpecName "kube-api-access-2dx8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:49:36.878375 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.878345 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2244a14f-2653-4bae-ad51-4f8c004b7dc4" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:49:36.878484 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.878388 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2244a14f-2653-4bae-ad51-4f8c004b7dc4" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:49:36.878484 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.878422 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2244a14f-2653-4bae-ad51-4f8c004b7dc4" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:49:36.884088 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.884051 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2244a14f-2653-4bae-ad51-4f8c004b7dc4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2244a14f-2653-4bae-ad51-4f8c004b7dc4" (UID: "2244a14f-2653-4bae-ad51-4f8c004b7dc4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 00:49:36.976536 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.976504 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2244a14f-2653-4bae-ad51-4f8c004b7dc4-ca-trust-extracted\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:36.976536 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.976528 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-installation-pull-secrets\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:36.976536 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.976539 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2244a14f-2653-4bae-ad51-4f8c004b7dc4-image-registry-private-configuration\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:36.976756 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.976550 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-bound-sa-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:36.976756 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.976558 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-tls\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:36.976756 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.976565 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-registry-certificates\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:36.976756 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.976574 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dx8m\" (UniqueName: \"kubernetes.io/projected/2244a14f-2653-4bae-ad51-4f8c004b7dc4-kube-api-access-2dx8m\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:36.976756 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:36.976583 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2244a14f-2653-4bae-ad51-4f8c004b7dc4-trusted-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:37.038796 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.038760 2575 generic.go:356] "Generic (PLEG): container finished" podID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" containerID="fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667" exitCode=0 Jul 14 00:49:37.038931 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.038801 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" Jul 14 00:49:37.038931 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.038827 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" event={"ID":"2244a14f-2653-4bae-ad51-4f8c004b7dc4","Type":"ContainerDied","Data":"fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667"} Jul 14 00:49:37.038931 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.038870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c56d947b7-djn2g" event={"ID":"2244a14f-2653-4bae-ad51-4f8c004b7dc4","Type":"ContainerDied","Data":"a99358fb5bcd4f0330117cd71eb76b69acae28408a85de92a523d62bf7292e57"} Jul 14 00:49:37.038931 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.038891 2575 scope.go:117] "RemoveContainer" containerID="fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667" Jul 14 00:49:37.046830 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.046805 2575 scope.go:117] "RemoveContainer" containerID="fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667" Jul 14 00:49:37.047090 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:49:37.047055 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667\": container with ID starting with fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667 not found: ID does not exist" containerID="fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667" Jul 14 00:49:37.047156 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.047098 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667"} err="failed to get container status \"fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667\": rpc error: code = NotFound desc = could not find container \"fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667\": container with ID starting with fa4af293adca5fe9ebafdd5457f20fb3398bbf92cc69c2237bd0156a51d19667 not found: ID does not exist" Jul 14 00:49:37.054836 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.054813 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c56d947b7-djn2g"] Jul 14 00:49:37.062473 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:37.060147 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c56d947b7-djn2g"] Jul 14 00:49:38.975022 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:38.974991 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" path="/var/lib/kubelet/pods/2244a14f-2653-4bae-ad51-4f8c004b7dc4/volumes" Jul 14 00:49:41.394688 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:41.394659 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:41.398291 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:41.398269 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79d98d6f9b-pzdp5" Jul 14 00:49:43.709814 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:43.709757 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-679b5d9997-t7hjb" podUID="f41169eb-c639-44b5-9fec-69e095067ada" containerName="console" containerID="cri-o://71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30" gracePeriod=15 Jul 14 00:49:43.955636 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:43.955614 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:44.040729 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.040647 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-console-config\") pod \"f41169eb-c639-44b5-9fec-69e095067ada\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " Jul 14 00:49:44.040729 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.040683 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-service-ca\") pod \"f41169eb-c639-44b5-9fec-69e095067ada\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " Jul 14 00:49:44.040729 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.040705 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-trusted-ca-bundle\") pod \"f41169eb-c639-44b5-9fec-69e095067ada\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " Jul 14 00:49:44.041005 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.040732 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-serving-cert\") pod \"f41169eb-c639-44b5-9fec-69e095067ada\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " Jul 14 00:49:44.041005 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.040775 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-oauth-config\") pod \"f41169eb-c639-44b5-9fec-69e095067ada\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " Jul 14 00:49:44.041005 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.040811 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkpfq\" (UniqueName: \"kubernetes.io/projected/f41169eb-c639-44b5-9fec-69e095067ada-kube-api-access-mkpfq\") pod \"f41169eb-c639-44b5-9fec-69e095067ada\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " Jul 14 00:49:44.041005 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.040840 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-oauth-serving-cert\") pod \"f41169eb-c639-44b5-9fec-69e095067ada\" (UID: \"f41169eb-c639-44b5-9fec-69e095067ada\") " Jul 14 00:49:44.041234 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.041048 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-console-config" (OuterVolumeSpecName: "console-config") pod "f41169eb-c639-44b5-9fec-69e095067ada" (UID: "f41169eb-c639-44b5-9fec-69e095067ada"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:44.041234 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.041107 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-service-ca" (OuterVolumeSpecName: "service-ca") pod "f41169eb-c639-44b5-9fec-69e095067ada" (UID: "f41169eb-c639-44b5-9fec-69e095067ada"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:44.041637 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.041374 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-console-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:44.041637 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.041399 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:44.041637 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.041577 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f41169eb-c639-44b5-9fec-69e095067ada" (UID: "f41169eb-c639-44b5-9fec-69e095067ada"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:44.041637 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.041621 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f41169eb-c639-44b5-9fec-69e095067ada" (UID: "f41169eb-c639-44b5-9fec-69e095067ada"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:49:44.043013 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.042990 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41169eb-c639-44b5-9fec-69e095067ada-kube-api-access-mkpfq" (OuterVolumeSpecName: "kube-api-access-mkpfq") pod "f41169eb-c639-44b5-9fec-69e095067ada" (UID: "f41169eb-c639-44b5-9fec-69e095067ada"). InnerVolumeSpecName "kube-api-access-mkpfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:49:44.043420 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.043395 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f41169eb-c639-44b5-9fec-69e095067ada" (UID: "f41169eb-c639-44b5-9fec-69e095067ada"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:49:44.043517 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.043416 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f41169eb-c639-44b5-9fec-69e095067ada" (UID: "f41169eb-c639-44b5-9fec-69e095067ada"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:49:44.067994 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.067966 2575 generic.go:356] "Generic (PLEG): container finished" podID="f41169eb-c639-44b5-9fec-69e095067ada" containerID="71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30" exitCode=0 Jul 14 00:49:44.068096 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.068018 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679b5d9997-t7hjb" Jul 14 00:49:44.068096 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.068046 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679b5d9997-t7hjb" event={"ID":"f41169eb-c639-44b5-9fec-69e095067ada","Type":"ContainerDied","Data":"71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30"} Jul 14 00:49:44.068190 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.068109 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679b5d9997-t7hjb" event={"ID":"f41169eb-c639-44b5-9fec-69e095067ada","Type":"ContainerDied","Data":"f271b5ab893fd045ba2277a26710cb8de06088513949ffee5d6ad04f76c626dc"} Jul 14 00:49:44.068190 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.068129 2575 scope.go:117] "RemoveContainer" containerID="71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30" Jul 14 00:49:44.076285 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.076267 2575 scope.go:117] "RemoveContainer" containerID="71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30" Jul 14 00:49:44.076512 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:49:44.076495 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30\": container with ID starting with 71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30 not found: ID does not exist" containerID="71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30" Jul 14 00:49:44.076568 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.076523 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30"} err="failed to get container status \"71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30\": rpc error: code = NotFound desc = could not find container \"71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30\": container with ID starting with 71abd85512bba540d64a759e8c1a7647f35173f25c48a87e6f7334488cafde30 not found: ID does not exist" Jul 14 00:49:44.087859 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.087835 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679b5d9997-t7hjb"] Jul 14 00:49:44.092609 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.092589 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-679b5d9997-t7hjb"] Jul 14 00:49:44.141889 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.141869 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-trusted-ca-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:44.141889 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.141890 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-serving-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:44.142035 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.141902 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41169eb-c639-44b5-9fec-69e095067ada-console-oauth-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:44.142035 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.141910 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkpfq\" (UniqueName: \"kubernetes.io/projected/f41169eb-c639-44b5-9fec-69e095067ada-kube-api-access-mkpfq\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:44.142035 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.141918 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41169eb-c639-44b5-9fec-69e095067ada-oauth-serving-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:49:44.940139 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.940104 2575 patch_prober.go:28] interesting pod/console-679b5d9997-t7hjb container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.25:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 00:49:44.940491 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.940159 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-679b5d9997-t7hjb" podUID="f41169eb-c639-44b5-9fec-69e095067ada" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 14 00:49:44.974734 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:44.974704 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41169eb-c639-44b5-9fec-69e095067ada" path="/var/lib/kubelet/pods/f41169eb-c639-44b5-9fec-69e095067ada/volumes" Jul 14 00:49:48.086148 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:48.086114 2575 generic.go:356] "Generic (PLEG): container finished" podID="fc44308a-2e06-48a6-8325-1888467e90e6" containerID="ebb41ae9dd959a3289f9b56f94b0aad744d1cb1c299ef370e85e4b3abafa51ab" exitCode=0 Jul 14 00:49:48.086519 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:48.086191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" event={"ID":"fc44308a-2e06-48a6-8325-1888467e90e6","Type":"ContainerDied","Data":"ebb41ae9dd959a3289f9b56f94b0aad744d1cb1c299ef370e85e4b3abafa51ab"} Jul 14 00:49:48.086519 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:48.086463 2575 scope.go:117] "RemoveContainer" containerID="ebb41ae9dd959a3289f9b56f94b0aad744d1cb1c299ef370e85e4b3abafa51ab" Jul 14 00:49:49.091470 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:49:49.091437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h8b8m" event={"ID":"fc44308a-2e06-48a6-8325-1888467e90e6","Type":"ContainerStarted","Data":"5579462dbccdf70cd2f9374698b7bb549b56e0fea098555346b075eeecbade2c"} Jul 14 00:50:20.847026 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:20.846982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:50:20.849386 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:20.849363 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d505356c-4ab9-4d74-a411-be8467553bf6-metrics-certs\") pod \"network-metrics-daemon-vbw62\" (UID: \"d505356c-4ab9-4d74-a411-be8467553bf6\") " pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:50:20.872967 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:20.872941 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cmcmt\"" Jul 14 00:50:20.881102 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:20.881085 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbw62" Jul 14 00:50:21.011215 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:21.011189 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vbw62"] Jul 14 00:50:21.013862 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:50:21.013835 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd505356c_4ab9_4d74_a411_be8467553bf6.slice/crio-2e568aac0bd470f7ebfa1082a65baaea66b59d72424562e88c70e76593b77523 WatchSource:0}: Error finding container 2e568aac0bd470f7ebfa1082a65baaea66b59d72424562e88c70e76593b77523: Status 404 returned error can't find the container with id 2e568aac0bd470f7ebfa1082a65baaea66b59d72424562e88c70e76593b77523 Jul 14 00:50:21.016326 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:21.016307 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 00:50:21.212452 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:21.212420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbw62" event={"ID":"d505356c-4ab9-4d74-a411-be8467553bf6","Type":"ContainerStarted","Data":"2e568aac0bd470f7ebfa1082a65baaea66b59d72424562e88c70e76593b77523"} Jul 14 00:50:23.221637 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:23.221596 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbw62" event={"ID":"d505356c-4ab9-4d74-a411-be8467553bf6","Type":"ContainerStarted","Data":"a497c84a04bbf477bc4a8bdada954c2f00d53b7389c6b7bf86ae91bf47921986"} Jul 14 00:50:23.222021 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:23.221656 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbw62" event={"ID":"d505356c-4ab9-4d74-a411-be8467553bf6","Type":"ContainerStarted","Data":"c6fc906b404b0e402ea4bdeb11080415cb90dc1a8980aa145dc6b35a3a311a0b"} Jul 14 00:50:23.237896 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:23.237835 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vbw62" podStartSLOduration=375.097232222 podStartE2EDuration="6m16.237820849s" totalImagesPullingTime="1.140588627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:50:23.236642284 +0000 UTC m=+376.725979727" watchObservedRunningTime="2026-07-14 00:50:23.237820849 +0000 UTC m=+376.727158290" Jul 14 00:50:37.772859 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.772819 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-746f486489-cvpqb"] Jul 14 00:50:37.773387 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773304 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41169eb-c639-44b5-9fec-69e095067ada" containerName="console" Jul 14 00:50:37.773387 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773324 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41169eb-c639-44b5-9fec-69e095067ada" containerName="console" Jul 14 00:50:37.773387 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773341 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1152245d-2a3e-4c00-82ae-12e5bf273926" containerName="console" Jul 14 00:50:37.773387 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773351 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1152245d-2a3e-4c00-82ae-12e5bf273926" containerName="console" Jul 14 00:50:37.773387 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773367 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" containerName="registry" Jul 14 00:50:37.773387 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773376 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" containerName="registry" Jul 14 00:50:37.773673 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773397 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198a5be2-c774-4b9f-913a-ccf762710bf9" containerName="console" Jul 14 00:50:37.773673 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773407 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="198a5be2-c774-4b9f-913a-ccf762710bf9" containerName="console" Jul 14 00:50:37.773673 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773507 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="198a5be2-c774-4b9f-913a-ccf762710bf9" containerName="console" Jul 14 00:50:37.773673 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773520 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1152245d-2a3e-4c00-82ae-12e5bf273926" containerName="console" Jul 14 00:50:37.773673 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773529 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41169eb-c639-44b5-9fec-69e095067ada" containerName="console" Jul 14 00:50:37.773673 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.773538 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2244a14f-2653-4bae-ad51-4f8c004b7dc4" containerName="registry" Jul 14 00:50:37.776658 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.776640 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.779335 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.779313 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 00:50:37.779481 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.779313 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 00:50:37.780271 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.780253 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 00:50:37.780365 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.780295 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 00:50:37.780365 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.780268 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4t8jn\"" Jul 14 00:50:37.780365 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.780341 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 00:50:37.780551 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.780264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 00:50:37.780624 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.780606 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 00:50:37.784693 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.784671 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 00:50:37.787519 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.787498 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746f486489-cvpqb"] Jul 14 00:50:37.893169 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.893140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-trusted-ca-bundle\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.893169 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.893168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-oauth-serving-cert\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.893343 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.893191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-service-ca\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.893343 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.893220 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-oauth-config\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.893343 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.893293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-console-config\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.893343 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.893310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chn9l\" (UniqueName: \"kubernetes.io/projected/c988394f-3c2c-439f-8719-506096249c37-kube-api-access-chn9l\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.893343 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.893332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-serving-cert\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.994355 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.994330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-console-config\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.994507 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.994359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chn9l\" (UniqueName: \"kubernetes.io/projected/c988394f-3c2c-439f-8719-506096249c37-kube-api-access-chn9l\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.994507 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.994385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-serving-cert\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.994507 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.994413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-trusted-ca-bundle\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.994676 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.994550 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-oauth-serving-cert\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.994676 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.994630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-service-ca\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.994798 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.994664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-oauth-config\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.995178 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.995151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-console-config\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.995178 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.995178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-oauth-serving-cert\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.995403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.995297 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-trusted-ca-bundle\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.995403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.995307 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-service-ca\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.996932 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.996903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-oauth-config\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:37.997028 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:37.997012 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-serving-cert\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:38.002691 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:38.002673 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chn9l\" (UniqueName: \"kubernetes.io/projected/c988394f-3c2c-439f-8719-506096249c37-kube-api-access-chn9l\") pod \"console-746f486489-cvpqb\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:38.087536 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:38.087468 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:38.221946 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:38.221912 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746f486489-cvpqb"] Jul 14 00:50:38.225480 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:50:38.225450 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc988394f_3c2c_439f_8719_506096249c37.slice/crio-9730fdc742e07b19c1155f46d67c922e77e157e92d882c08bc2dff43cfc9387f WatchSource:0}: Error finding container 9730fdc742e07b19c1155f46d67c922e77e157e92d882c08bc2dff43cfc9387f: Status 404 returned error can't find the container with id 9730fdc742e07b19c1155f46d67c922e77e157e92d882c08bc2dff43cfc9387f Jul 14 00:50:38.283657 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:38.283632 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746f486489-cvpqb" event={"ID":"c988394f-3c2c-439f-8719-506096249c37","Type":"ContainerStarted","Data":"9730fdc742e07b19c1155f46d67c922e77e157e92d882c08bc2dff43cfc9387f"} Jul 14 00:50:39.289058 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:39.289019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746f486489-cvpqb" event={"ID":"c988394f-3c2c-439f-8719-506096249c37","Type":"ContainerStarted","Data":"d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd"} Jul 14 00:50:39.306729 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:39.306661 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-746f486489-cvpqb" podStartSLOduration=2.306644607 podStartE2EDuration="2.306644607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:50:39.305749125 +0000 UTC m=+392.795086589" watchObservedRunningTime="2026-07-14 00:50:39.306644607 +0000 UTC m=+392.795982048" Jul 14 00:50:48.088300 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:48.088260 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:48.088686 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:48.088320 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:48.093059 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:48.093035 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:50:48.326239 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:50:48.326212 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:51:51.173411 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.173327 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g"] Jul 14 00:51:51.176771 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.176750 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.179814 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.179797 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qtf2m\"" Jul 14 00:51:51.180047 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.180027 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 00:51:51.181126 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.181109 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 00:51:51.192162 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.192129 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g"] Jul 14 00:51:51.271128 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.271093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.271128 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.271136 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.271365 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.271154 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zh7s\" (UniqueName: \"kubernetes.io/projected/291b06a2-71d4-4008-8803-da3230446e1f-kube-api-access-2zh7s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.372620 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.372570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.372825 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.372632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.372825 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.372658 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zh7s\" (UniqueName: \"kubernetes.io/projected/291b06a2-71d4-4008-8803-da3230446e1f-kube-api-access-2zh7s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.372983 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.372962 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.373040 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.372989 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.381108 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.381060 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zh7s\" (UniqueName: \"kubernetes.io/projected/291b06a2-71d4-4008-8803-da3230446e1f-kube-api-access-2zh7s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.491181 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.491153 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:51:51.617401 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:51.617378 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g"] Jul 14 00:51:51.619731 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:51:51.619707 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291b06a2_71d4_4008_8803_da3230446e1f.slice/crio-d786ef561d946ca094d44417f1d85d101a02241a81dbde20ce1e82007dd441cd WatchSource:0}: Error finding container d786ef561d946ca094d44417f1d85d101a02241a81dbde20ce1e82007dd441cd: Status 404 returned error can't find the container with id d786ef561d946ca094d44417f1d85d101a02241a81dbde20ce1e82007dd441cd Jul 14 00:51:52.565431 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:52.565388 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" event={"ID":"291b06a2-71d4-4008-8803-da3230446e1f","Type":"ContainerStarted","Data":"d786ef561d946ca094d44417f1d85d101a02241a81dbde20ce1e82007dd441cd"} Jul 14 00:51:54.438701 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.438667 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m"] Jul 14 00:51:54.442281 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.442258 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" Jul 14 00:51:54.444975 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.444953 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 00:51:54.445102 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.444953 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dzddm\"" Jul 14 00:51:54.445992 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.445971 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 00:51:54.449014 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.448997 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m"] Jul 14 00:51:54.601586 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.601554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5jm\" (UniqueName: \"kubernetes.io/projected/c55cc4ec-ddc4-4600-b794-4ed6d39c8e78-kube-api-access-ng5jm\") pod \"cert-manager-cainjector-559cdd8c87-gkf4m\" (UID: \"c55cc4ec-ddc4-4600-b794-4ed6d39c8e78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" Jul 14 00:51:54.601759 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.601608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c55cc4ec-ddc4-4600-b794-4ed6d39c8e78-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gkf4m\" (UID: \"c55cc4ec-ddc4-4600-b794-4ed6d39c8e78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" Jul 14 00:51:54.702196 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.702121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c55cc4ec-ddc4-4600-b794-4ed6d39c8e78-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gkf4m\" (UID: \"c55cc4ec-ddc4-4600-b794-4ed6d39c8e78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" Jul 14 00:51:54.702334 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.702218 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5jm\" (UniqueName: \"kubernetes.io/projected/c55cc4ec-ddc4-4600-b794-4ed6d39c8e78-kube-api-access-ng5jm\") pod \"cert-manager-cainjector-559cdd8c87-gkf4m\" (UID: \"c55cc4ec-ddc4-4600-b794-4ed6d39c8e78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" Jul 14 00:51:54.711624 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.711600 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5jm\" (UniqueName: \"kubernetes.io/projected/c55cc4ec-ddc4-4600-b794-4ed6d39c8e78-kube-api-access-ng5jm\") pod \"cert-manager-cainjector-559cdd8c87-gkf4m\" (UID: \"c55cc4ec-ddc4-4600-b794-4ed6d39c8e78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" Jul 14 00:51:54.711739 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.711600 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c55cc4ec-ddc4-4600-b794-4ed6d39c8e78-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gkf4m\" (UID: \"c55cc4ec-ddc4-4600-b794-4ed6d39c8e78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" Jul 14 00:51:54.765706 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.765674 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" Jul 14 00:51:54.911545 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:54.911515 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m"] Jul 14 00:51:54.915286 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:51:54.915258 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc55cc4ec_ddc4_4600_b794_4ed6d39c8e78.slice/crio-0de7a9eb2154c558045434bf4f6ee47b094c73ba41a83f79cae710086cb0382a WatchSource:0}: Error finding container 0de7a9eb2154c558045434bf4f6ee47b094c73ba41a83f79cae710086cb0382a: Status 404 returned error can't find the container with id 0de7a9eb2154c558045434bf4f6ee47b094c73ba41a83f79cae710086cb0382a Jul 14 00:51:55.581620 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:51:55.581529 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" event={"ID":"c55cc4ec-ddc4-4600-b794-4ed6d39c8e78","Type":"ContainerStarted","Data":"0de7a9eb2154c558045434bf4f6ee47b094c73ba41a83f79cae710086cb0382a"} Jul 14 00:52:00.605739 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:00.605705 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" event={"ID":"c55cc4ec-ddc4-4600-b794-4ed6d39c8e78","Type":"ContainerStarted","Data":"a56ddc969d0fb865ab3301af767f5debc751c05a40614abb50fe4bdb4494e6d0"} Jul 14 00:52:00.607309 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:00.607278 2575 generic.go:356] "Generic (PLEG): container finished" podID="291b06a2-71d4-4008-8803-da3230446e1f" containerID="756c6ff6e8878632cb63bd1f5d9ad0fbacf696ab853c82bb3c099ff0825d5287" exitCode=0 Jul 14 00:52:00.607418 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:00.607328 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" event={"ID":"291b06a2-71d4-4008-8803-da3230446e1f","Type":"ContainerDied","Data":"756c6ff6e8878632cb63bd1f5d9ad0fbacf696ab853c82bb3c099ff0825d5287"} Jul 14 00:52:00.624019 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:00.623976 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gkf4m" podStartSLOduration=1.873690255 podStartE2EDuration="6.623962806s" totalImagesPullingTime="4.750272551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:52:00.622394958 +0000 UTC m=+474.111732399" watchObservedRunningTime="2026-07-14 00:52:00.623962806 +0000 UTC m=+474.113300247" Jul 14 00:52:03.622002 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:03.621964 2575 generic.go:356] "Generic (PLEG): container finished" podID="291b06a2-71d4-4008-8803-da3230446e1f" containerID="688d236e488a8fa8a2dbe955ce8b92115ea4d43a6f17a5c70010dfda961b5478" exitCode=0 Jul 14 00:52:03.622451 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:03.622037 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" event={"ID":"291b06a2-71d4-4008-8803-da3230446e1f","Type":"ContainerDied","Data":"688d236e488a8fa8a2dbe955ce8b92115ea4d43a6f17a5c70010dfda961b5478"} Jul 14 00:52:11.660436 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:11.660404 2575 generic.go:356] "Generic (PLEG): container finished" podID="291b06a2-71d4-4008-8803-da3230446e1f" containerID="753e86c630bacbf1c8238e42863ab991a04cbb2f902914c4ca52673df9de55fc" exitCode=0 Jul 14 00:52:11.660778 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:11.660462 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" event={"ID":"291b06a2-71d4-4008-8803-da3230446e1f","Type":"ContainerDied","Data":"753e86c630bacbf1c8238e42863ab991a04cbb2f902914c4ca52673df9de55fc"} Jul 14 00:52:12.835844 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:12.835815 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:52:12.951323 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:12.951299 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-bundle\") pod \"291b06a2-71d4-4008-8803-da3230446e1f\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " Jul 14 00:52:12.951472 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:12.951349 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zh7s\" (UniqueName: \"kubernetes.io/projected/291b06a2-71d4-4008-8803-da3230446e1f-kube-api-access-2zh7s\") pod \"291b06a2-71d4-4008-8803-da3230446e1f\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " Jul 14 00:52:12.951472 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:12.951382 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-util\") pod \"291b06a2-71d4-4008-8803-da3230446e1f\" (UID: \"291b06a2-71d4-4008-8803-da3230446e1f\") " Jul 14 00:52:12.951761 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:12.951738 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-bundle" (OuterVolumeSpecName: "bundle") pod "291b06a2-71d4-4008-8803-da3230446e1f" (UID: "291b06a2-71d4-4008-8803-da3230446e1f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 00:52:12.953635 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:12.953602 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/291b06a2-71d4-4008-8803-da3230446e1f-kube-api-access-2zh7s" (OuterVolumeSpecName: "kube-api-access-2zh7s") pod "291b06a2-71d4-4008-8803-da3230446e1f" (UID: "291b06a2-71d4-4008-8803-da3230446e1f"). InnerVolumeSpecName "kube-api-access-2zh7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:52:12.958463 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:12.958435 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-util" (OuterVolumeSpecName: "util") pod "291b06a2-71d4-4008-8803-da3230446e1f" (UID: "291b06a2-71d4-4008-8803-da3230446e1f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 00:52:13.052587 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:13.052557 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zh7s\" (UniqueName: \"kubernetes.io/projected/291b06a2-71d4-4008-8803-da3230446e1f-kube-api-access-2zh7s\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:52:13.052587 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:13.052581 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-util\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:52:13.052587 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:13.052591 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291b06a2-71d4-4008-8803-da3230446e1f-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:52:13.670283 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:13.670255 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" Jul 14 00:52:13.670433 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:13.670247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz8g7g" event={"ID":"291b06a2-71d4-4008-8803-da3230446e1f","Type":"ContainerDied","Data":"d786ef561d946ca094d44417f1d85d101a02241a81dbde20ce1e82007dd441cd"} Jul 14 00:52:13.670433 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:13.670411 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d786ef561d946ca094d44417f1d85d101a02241a81dbde20ce1e82007dd441cd" Jul 14 00:52:21.069704 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.069664 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl"] Jul 14 00:52:21.070309 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.070141 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="291b06a2-71d4-4008-8803-da3230446e1f" containerName="pull" Jul 14 00:52:21.070309 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.070160 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="291b06a2-71d4-4008-8803-da3230446e1f" containerName="pull" Jul 14 00:52:21.070309 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.070178 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="291b06a2-71d4-4008-8803-da3230446e1f" containerName="util" Jul 14 00:52:21.070309 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.070187 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="291b06a2-71d4-4008-8803-da3230446e1f" containerName="util" Jul 14 00:52:21.070309 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.070199 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="291b06a2-71d4-4008-8803-da3230446e1f" containerName="extract" Jul 14 00:52:21.070309 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.070208 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="291b06a2-71d4-4008-8803-da3230446e1f" containerName="extract" Jul 14 00:52:21.070309 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.070307 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="291b06a2-71d4-4008-8803-da3230446e1f" containerName="extract" Jul 14 00:52:21.074344 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.074323 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" Jul 14 00:52:21.076819 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.076797 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 00:52:21.077770 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.077756 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:52:21.077836 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.077792 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cwxrt\"" Jul 14 00:52:21.082449 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.082425 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl"] Jul 14 00:52:21.117506 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.117467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmdn9\" (UniqueName: \"kubernetes.io/projected/32a67848-b77b-40f0-9ec0-484ac624a3a6-kube-api-access-dmdn9\") pod \"openshift-lws-operator-fd8ccff4c-xf2hl\" (UID: \"32a67848-b77b-40f0-9ec0-484ac624a3a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" Jul 14 00:52:21.117675 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.117548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a67848-b77b-40f0-9ec0-484ac624a3a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xf2hl\" (UID: \"32a67848-b77b-40f0-9ec0-484ac624a3a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" Jul 14 00:52:21.218050 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.218011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a67848-b77b-40f0-9ec0-484ac624a3a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xf2hl\" (UID: \"32a67848-b77b-40f0-9ec0-484ac624a3a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" Jul 14 00:52:21.218305 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.218088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmdn9\" (UniqueName: \"kubernetes.io/projected/32a67848-b77b-40f0-9ec0-484ac624a3a6-kube-api-access-dmdn9\") pod \"openshift-lws-operator-fd8ccff4c-xf2hl\" (UID: \"32a67848-b77b-40f0-9ec0-484ac624a3a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" Jul 14 00:52:21.218411 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.218390 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a67848-b77b-40f0-9ec0-484ac624a3a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xf2hl\" (UID: \"32a67848-b77b-40f0-9ec0-484ac624a3a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" Jul 14 00:52:21.225863 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.225839 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmdn9\" (UniqueName: \"kubernetes.io/projected/32a67848-b77b-40f0-9ec0-484ac624a3a6-kube-api-access-dmdn9\") pod \"openshift-lws-operator-fd8ccff4c-xf2hl\" (UID: \"32a67848-b77b-40f0-9ec0-484ac624a3a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" Jul 14 00:52:21.383938 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.383840 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" Jul 14 00:52:21.511504 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.511476 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl"] Jul 14 00:52:21.514846 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:52:21.514821 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32a67848_b77b_40f0_9ec0_484ac624a3a6.slice/crio-43c7799b6d204e0a2ec8b143a092ad87f5df237ebdd8716e674f4d64b274decf WatchSource:0}: Error finding container 43c7799b6d204e0a2ec8b143a092ad87f5df237ebdd8716e674f4d64b274decf: Status 404 returned error can't find the container with id 43c7799b6d204e0a2ec8b143a092ad87f5df237ebdd8716e674f4d64b274decf Jul 14 00:52:21.703730 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:21.703698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" event={"ID":"32a67848-b77b-40f0-9ec0-484ac624a3a6","Type":"ContainerStarted","Data":"43c7799b6d204e0a2ec8b143a092ad87f5df237ebdd8716e674f4d64b274decf"} Jul 14 00:52:23.714741 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:23.714707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" event={"ID":"32a67848-b77b-40f0-9ec0-484ac624a3a6","Type":"ContainerStarted","Data":"89c5155794e78df812ba4b9f145f8338f12389e9437b03ff7433e758d4ed7647"} Jul 14 00:52:23.731855 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:23.731801 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xf2hl" podStartSLOduration=1.003319577 podStartE2EDuration="2.731785933s" totalImagesPullingTime="1.728466356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:52:23.73137922 +0000 UTC m=+497.220716663" watchObservedRunningTime="2026-07-14 00:52:23.731785933 +0000 UTC m=+497.221123374" Jul 14 00:52:40.748014 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.747978 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7"] Jul 14 00:52:40.751204 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.751182 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.754809 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.754789 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f5mkw\"" Jul 14 00:52:40.754914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.754810 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 00:52:40.754914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.754795 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 00:52:40.754914 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.754868 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 00:52:40.763046 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.763026 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7"] Jul 14 00:52:40.880507 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.880468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85109528-bcb8-435a-9b3b-5c042022d1aa-metrics-cert\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.880690 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.880527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llgx9\" (UniqueName: \"kubernetes.io/projected/85109528-bcb8-435a-9b3b-5c042022d1aa-kube-api-access-llgx9\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.880690 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.880625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85109528-bcb8-435a-9b3b-5c042022d1aa-cert\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.880690 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.880671 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85109528-bcb8-435a-9b3b-5c042022d1aa-manager-config\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.981283 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.981253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85109528-bcb8-435a-9b3b-5c042022d1aa-metrics-cert\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.981465 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.981299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llgx9\" (UniqueName: \"kubernetes.io/projected/85109528-bcb8-435a-9b3b-5c042022d1aa-kube-api-access-llgx9\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.981465 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.981332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85109528-bcb8-435a-9b3b-5c042022d1aa-cert\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.981465 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.981439 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85109528-bcb8-435a-9b3b-5c042022d1aa-manager-config\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.982027 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.982005 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85109528-bcb8-435a-9b3b-5c042022d1aa-manager-config\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.983730 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.983703 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85109528-bcb8-435a-9b3b-5c042022d1aa-cert\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.983855 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.983746 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85109528-bcb8-435a-9b3b-5c042022d1aa-metrics-cert\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:40.994672 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:40.994652 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llgx9\" (UniqueName: \"kubernetes.io/projected/85109528-bcb8-435a-9b3b-5c042022d1aa-kube-api-access-llgx9\") pod \"lws-controller-manager-5bd544bbf-45jv7\" (UID: \"85109528-bcb8-435a-9b3b-5c042022d1aa\") " pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:41.060416 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.060345 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:41.192006 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.191973 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7"] Jul 14 00:52:41.195096 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:52:41.195048 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85109528_bcb8_435a_9b3b_5c042022d1aa.slice/crio-b94a9e0f720e632c36b0d2fd75fac132830b5aa2ec1d7f489f1c959243c6ba85 WatchSource:0}: Error finding container b94a9e0f720e632c36b0d2fd75fac132830b5aa2ec1d7f489f1c959243c6ba85: Status 404 returned error can't find the container with id b94a9e0f720e632c36b0d2fd75fac132830b5aa2ec1d7f489f1c959243c6ba85 Jul 14 00:52:41.796674 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.796635 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" event={"ID":"85109528-bcb8-435a-9b3b-5c042022d1aa","Type":"ContainerStarted","Data":"b94a9e0f720e632c36b0d2fd75fac132830b5aa2ec1d7f489f1c959243c6ba85"} Jul 14 00:52:41.857387 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.857344 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f"] Jul 14 00:52:41.861895 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.861873 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:41.866536 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.866509 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 00:52:41.866536 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.866531 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 00:52:41.866725 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.866522 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 00:52:41.866725 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.866550 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 00:52:41.866895 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.866880 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k2lvq\"" Jul 14 00:52:41.887132 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.887106 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f"] Jul 14 00:52:41.991747 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.991722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzzp\" (UniqueName: \"kubernetes.io/projected/2abf2233-e2e4-4127-be00-6ed70701797d-kube-api-access-ktzzp\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:41.991911 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.991757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abf2233-e2e4-4127-be00-6ed70701797d-tmp\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:41.991911 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.991793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2abf2233-e2e4-4127-be00-6ed70701797d-manifests\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:41.992037 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.991915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2abf2233-e2e4-4127-be00-6ed70701797d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:41.992037 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:41.991967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2abf2233-e2e4-4127-be00-6ed70701797d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.092472 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.092397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2abf2233-e2e4-4127-be00-6ed70701797d-manifests\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.092472 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.092458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2abf2233-e2e4-4127-be00-6ed70701797d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.092702 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.092488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2abf2233-e2e4-4127-be00-6ed70701797d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.092702 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.092515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzzp\" (UniqueName: \"kubernetes.io/projected/2abf2233-e2e4-4127-be00-6ed70701797d-kube-api-access-ktzzp\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.092702 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.092538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abf2233-e2e4-4127-be00-6ed70701797d-tmp\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.092895 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.092869 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2abf2233-e2e4-4127-be00-6ed70701797d-manifests\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.094928 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.094904 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abf2233-e2e4-4127-be00-6ed70701797d-tmp\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.095024 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.095007 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2abf2233-e2e4-4127-be00-6ed70701797d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.095129 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.095114 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2abf2233-e2e4-4127-be00-6ed70701797d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.103815 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.103794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzzp\" (UniqueName: \"kubernetes.io/projected/2abf2233-e2e4-4127-be00-6ed70701797d-kube-api-access-ktzzp\") pod \"opendatahub-operator-controller-manager-6b7d6985f7-d9s7f\" (UID: \"2abf2233-e2e4-4127-be00-6ed70701797d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.173152 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.173122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:42.317611 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.317587 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f"] Jul 14 00:52:42.319607 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:52:42.319580 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abf2233_e2e4_4127_be00_6ed70701797d.slice/crio-251f023c5833c3b745ac04d8fd9a8e9e69523d3726953f584279b3f35629e132 WatchSource:0}: Error finding container 251f023c5833c3b745ac04d8fd9a8e9e69523d3726953f584279b3f35629e132: Status 404 returned error can't find the container with id 251f023c5833c3b745ac04d8fd9a8e9e69523d3726953f584279b3f35629e132 Jul 14 00:52:42.803667 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:42.803630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" event={"ID":"2abf2233-e2e4-4127-be00-6ed70701797d","Type":"ContainerStarted","Data":"251f023c5833c3b745ac04d8fd9a8e9e69523d3726953f584279b3f35629e132"} Jul 14 00:52:43.810872 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:43.810836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" event={"ID":"85109528-bcb8-435a-9b3b-5c042022d1aa","Type":"ContainerStarted","Data":"751079fcc381394b3ac33d415b228e8afb6c13b0f4872fb6bb235ba4905ae921"} Jul 14 00:52:43.811475 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:43.811444 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:43.830776 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:43.830721 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" podStartSLOduration=1.6943828189999999 podStartE2EDuration="3.830701055s" totalImagesPullingTime="2.136318236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:52:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:52:43.828699413 +0000 UTC m=+517.318036874" watchObservedRunningTime="2026-07-14 00:52:43.830701055 +0000 UTC m=+517.320038499" Jul 14 00:52:46.826264 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:46.826229 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" event={"ID":"2abf2233-e2e4-4127-be00-6ed70701797d","Type":"ContainerStarted","Data":"a3dc82f966629ef11c47db2875f3de4b43e4cc8893162f619e0ed63bd8e5fd95"} Jul 14 00:52:47.832351 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:47.832315 2575 generic.go:356] "Generic (PLEG): container finished" podID="2abf2233-e2e4-4127-be00-6ed70701797d" containerID="a3dc82f966629ef11c47db2875f3de4b43e4cc8893162f619e0ed63bd8e5fd95" exitCode=0 Jul 14 00:52:47.832770 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:47.832372 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" event={"ID":"2abf2233-e2e4-4127-be00-6ed70701797d","Type":"ContainerDied","Data":"a3dc82f966629ef11c47db2875f3de4b43e4cc8893162f619e0ed63bd8e5fd95"} Jul 14 00:52:48.838925 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:48.838888 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" event={"ID":"2abf2233-e2e4-4127-be00-6ed70701797d","Type":"ContainerStarted","Data":"1cb447510d6d8d73e3251411f9f77a774bda4244ecf3a9e195e8660ea4fd9503"} Jul 14 00:52:48.839373 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:48.839005 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:52:48.862182 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:48.862133 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" podStartSLOduration=2.725661126 podStartE2EDuration="7.862120187s" totalImagesPullingTime="4.120365771s" totalInitContainerRuntime="1.01609329s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:52:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:52:48.859569135 +0000 UTC m=+522.348906578" watchObservedRunningTime="2026-07-14 00:52:48.862120187 +0000 UTC m=+522.351457628" Jul 14 00:52:55.823580 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:55.823548 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bd544bbf-45jv7" Jul 14 00:52:59.845884 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:52:59.845808 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b7d6985f7-d9s7f" Jul 14 00:53:09.934058 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:09.934025 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2"] Jul 14 00:53:09.938884 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:09.938866 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:09.941382 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:09.941361 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 00:53:09.941602 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:09.941581 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 00:53:09.941662 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:09.941636 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h5472\"" Jul 14 00:53:09.941927 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:09.941895 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 00:53:09.942036 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:09.942017 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 00:53:09.949286 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:09.949266 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2"] Jul 14 00:53:10.037310 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.037284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.037430 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.037316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.037430 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.037342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.037430 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.037361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ttcb\" (UniqueName: \"kubernetes.io/projected/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-kube-api-access-5ttcb\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.037532 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.037453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.037532 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.037489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.037532 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.037510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.137955 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.137932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.138062 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.137967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.138062 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.137987 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.138062 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.138009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.138062 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.138044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.138282 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.138222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.138282 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.138272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ttcb\" (UniqueName: \"kubernetes.io/projected/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-kube-api-access-5ttcb\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.138649 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.138626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.140536 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.140512 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.140536 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.140529 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.140728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.140707 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.140873 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.140856 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.146182 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.146159 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ttcb\" (UniqueName: \"kubernetes.io/projected/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-kube-api-access-5ttcb\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.146586 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.146568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca9de1b-7d73-4bcd-b7c2-a73dcae92a10-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-66dg2\" (UID: \"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.249157 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.249133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:10.408806 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.408784 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2"] Jul 14 00:53:10.410657 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:53:10.410631 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca9de1b_7d73_4bcd_b7c2_a73dcae92a10.slice/crio-b7d8f2c91462d4cc1c3982cfaa9f56aaf2e0f8691e052bdd45e2e174cdf68100 WatchSource:0}: Error finding container b7d8f2c91462d4cc1c3982cfaa9f56aaf2e0f8691e052bdd45e2e174cdf68100: Status 404 returned error can't find the container with id b7d8f2c91462d4cc1c3982cfaa9f56aaf2e0f8691e052bdd45e2e174cdf68100 Jul 14 00:53:10.939328 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:10.939288 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" event={"ID":"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10","Type":"ContainerStarted","Data":"b7d8f2c91462d4cc1c3982cfaa9f56aaf2e0f8691e052bdd45e2e174cdf68100"} Jul 14 00:53:12.634952 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:12.634906 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 00:53:12.635254 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:12.634972 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 00:53:12.952311 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:12.952239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" event={"ID":"aca9de1b-7d73-4bcd-b7c2-a73dcae92a10","Type":"ContainerStarted","Data":"02ab070bc0ada68e9a2947867cb774b18b73f67d1e331999cbcdf94780ab6a3e"} Jul 14 00:53:12.952499 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:12.952319 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:53:12.979635 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:12.979579 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" podStartSLOduration=1.757401088 podStartE2EDuration="3.979561822s" totalImagesPullingTime="2.222160734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:53:12.977800435 +0000 UTC m=+546.467137875" watchObservedRunningTime="2026-07-14 00:53:12.979561822 +0000 UTC m=+546.468899263" Jul 14 00:53:13.964379 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:53:13.964351 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-66dg2" Jul 14 00:54:06.860356 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:54:06.860324 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:54:06.861540 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:54:06.861516 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:54:06.866450 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:54:06.866431 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:54:06.867792 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:54:06.867773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:54:48.149608 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:54:48.149534 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746f486489-cvpqb"] Jul 14 00:55:04.081112 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.081076 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn"] Jul 14 00:55:04.083372 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.083352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:04.086332 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.086307 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nxppt\"" Jul 14 00:55:04.086522 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.086502 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 00:55:04.086801 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.086783 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 00:55:04.101146 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.101123 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn"] Jul 14 00:55:04.234728 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.234700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d914b329-5ebb-4f55-b649-1434d89c69cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" (UID: \"d914b329-5ebb-4f55-b649-1434d89c69cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:04.234882 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.234753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k576m\" (UniqueName: \"kubernetes.io/projected/d914b329-5ebb-4f55-b649-1434d89c69cd-kube-api-access-k576m\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" (UID: \"d914b329-5ebb-4f55-b649-1434d89c69cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:04.335305 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.335221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k576m\" (UniqueName: \"kubernetes.io/projected/d914b329-5ebb-4f55-b649-1434d89c69cd-kube-api-access-k576m\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" (UID: \"d914b329-5ebb-4f55-b649-1434d89c69cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:04.335305 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.335289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d914b329-5ebb-4f55-b649-1434d89c69cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" (UID: \"d914b329-5ebb-4f55-b649-1434d89c69cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:04.335590 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.335572 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d914b329-5ebb-4f55-b649-1434d89c69cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" (UID: \"d914b329-5ebb-4f55-b649-1434d89c69cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:04.350493 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.350464 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k576m\" (UniqueName: \"kubernetes.io/projected/d914b329-5ebb-4f55-b649-1434d89c69cd-kube-api-access-k576m\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" (UID: \"d914b329-5ebb-4f55-b649-1434d89c69cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:04.393198 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.393176 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:04.525691 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.525658 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn"] Jul 14 00:55:04.528695 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:55:04.528669 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd914b329_5ebb_4f55_b649_1434d89c69cd.slice/crio-ec851f899cddf0cc0d9b78e86528cc7d114abf6f855ab2f0722e7913f6e54aed WatchSource:0}: Error finding container ec851f899cddf0cc0d9b78e86528cc7d114abf6f855ab2f0722e7913f6e54aed: Status 404 returned error can't find the container with id ec851f899cddf0cc0d9b78e86528cc7d114abf6f855ab2f0722e7913f6e54aed Jul 14 00:55:04.805146 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.805115 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn"] Jul 14 00:55:04.811132 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.811103 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn"] Jul 14 00:55:04.828222 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.828196 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d"] Jul 14 00:55:04.830952 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.830929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:04.838765 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.838639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8dc2d\" (UID: \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:04.838902 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.838793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thtpp\" (UniqueName: \"kubernetes.io/projected/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-kube-api-access-thtpp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8dc2d\" (UID: \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:04.848821 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.848763 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d"] Jul 14 00:55:04.939588 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.939558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thtpp\" (UniqueName: \"kubernetes.io/projected/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-kube-api-access-thtpp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8dc2d\" (UID: \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:04.939740 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.939594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8dc2d\" (UID: \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:04.940026 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.940008 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8dc2d\" (UID: \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:04.947541 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:04.947517 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thtpp\" (UniqueName: \"kubernetes.io/projected/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-kube-api-access-thtpp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8dc2d\" (UID: \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:05.141900 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:05.141825 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:05.431318 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:05.430899 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d"] Jul 14 00:55:05.433825 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:55:05.433794 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7ad791_e0ba_4a5b_bf76_a22ad35cc1da.slice/crio-a3f3457443ec1982bbdebccddb6609b2d10446c5751b2df3384dfba56a65d499 WatchSource:0}: Error finding container a3f3457443ec1982bbdebccddb6609b2d10446c5751b2df3384dfba56a65d499: Status 404 returned error can't find the container with id a3f3457443ec1982bbdebccddb6609b2d10446c5751b2df3384dfba56a65d499 Jul 14 00:55:05.443656 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:05.443623 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" event={"ID":"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da","Type":"ContainerStarted","Data":"a3f3457443ec1982bbdebccddb6609b2d10446c5751b2df3384dfba56a65d499"} Jul 14 00:55:10.473663 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.473629 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" containerName="manager" containerID="cri-o://42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9" gracePeriod=2 Jul 14 00:55:10.475200 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.475174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" event={"ID":"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da","Type":"ContainerStarted","Data":"62ba7fce36b1b35c555c2a53c7181551dba18f844ff7cbb32a3fbd67d385d525"} Jul 14 00:55:10.475298 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.475260 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:10.475883 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:55:10.475855 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:10.493471 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.493433 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" podStartSLOduration=2.484752136 podStartE2EDuration="6.493420219s" totalImagesPullingTime="4.008668083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:55:10.491494997 +0000 UTC m=+663.980832458" watchObservedRunningTime="2026-07-14 00:55:10.493420219 +0000 UTC m=+663.982757658" Jul 14 00:55:10.493685 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:55:10.493662 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:10.710690 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.710669 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:10.712827 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:55:10.712805 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:10.792285 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.792233 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d914b329-5ebb-4f55-b649-1434d89c69cd-extensions-socket-volume\") pod \"d914b329-5ebb-4f55-b649-1434d89c69cd\" (UID: \"d914b329-5ebb-4f55-b649-1434d89c69cd\") " Jul 14 00:55:10.792285 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.792280 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k576m\" (UniqueName: \"kubernetes.io/projected/d914b329-5ebb-4f55-b649-1434d89c69cd-kube-api-access-k576m\") pod \"d914b329-5ebb-4f55-b649-1434d89c69cd\" (UID: \"d914b329-5ebb-4f55-b649-1434d89c69cd\") " Jul 14 00:55:10.792478 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.792457 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d914b329-5ebb-4f55-b649-1434d89c69cd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d914b329-5ebb-4f55-b649-1434d89c69cd" (UID: "d914b329-5ebb-4f55-b649-1434d89c69cd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 00:55:10.794347 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.794324 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d914b329-5ebb-4f55-b649-1434d89c69cd-kube-api-access-k576m" (OuterVolumeSpecName: "kube-api-access-k576m") pod "d914b329-5ebb-4f55-b649-1434d89c69cd" (UID: "d914b329-5ebb-4f55-b649-1434d89c69cd"). InnerVolumeSpecName "kube-api-access-k576m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:55:10.893367 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.893342 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k576m\" (UniqueName: \"kubernetes.io/projected/d914b329-5ebb-4f55-b649-1434d89c69cd-kube-api-access-k576m\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:10.893367 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.893363 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d914b329-5ebb-4f55-b649-1434d89c69cd-extensions-socket-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:10.975009 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:10.974982 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" path="/var/lib/kubelet/pods/d914b329-5ebb-4f55-b649-1434d89c69cd/volumes" Jul 14 00:55:11.481198 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:11.481164 2575 generic.go:356] "Generic (PLEG): container finished" podID="d914b329-5ebb-4f55-b649-1434d89c69cd" containerID="42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9" exitCode=2 Jul 14 00:55:11.481667 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:11.481208 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:11.481667 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:11.481257 2575 scope.go:117] "RemoveContainer" containerID="42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9" Jul 14 00:55:11.483778 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:55:11.483755 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:11.486092 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:55:11.486047 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzqkn\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzqkn" Jul 14 00:55:11.489478 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:11.489453 2575 scope.go:117] "RemoveContainer" containerID="42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9" Jul 14 00:55:11.489741 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:55:11.489723 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9\": container with ID starting with 42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9 not found: ID does not exist" containerID="42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9" Jul 14 00:55:11.489796 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:11.489748 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9"} err="failed to get container status \"42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9\": rpc error: code = NotFound desc = could not find container \"42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9\": container with ID starting with 42d6bbed71697cca2911881675b36643f2ddfa06a7e74c4e254726dbfdfb0ae9 not found: ID does not exist" Jul 14 00:55:13.173238 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.173193 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-746f486489-cvpqb" podUID="c988394f-3c2c-439f-8719-506096249c37" containerName="console" containerID="cri-o://d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd" gracePeriod=15 Jul 14 00:55:13.413248 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.413227 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:55:13.498304 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.498272 2575 generic.go:356] "Generic (PLEG): container finished" podID="c988394f-3c2c-439f-8719-506096249c37" containerID="d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd" exitCode=0 Jul 14 00:55:13.498457 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.498301 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746f486489-cvpqb" event={"ID":"c988394f-3c2c-439f-8719-506096249c37","Type":"ContainerDied","Data":"d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd"} Jul 14 00:55:13.498457 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.498362 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746f486489-cvpqb" event={"ID":"c988394f-3c2c-439f-8719-506096249c37","Type":"ContainerDied","Data":"9730fdc742e07b19c1155f46d67c922e77e157e92d882c08bc2dff43cfc9387f"} Jul 14 00:55:13.498457 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.498315 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746f486489-cvpqb" Jul 14 00:55:13.498457 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.498389 2575 scope.go:117] "RemoveContainer" containerID="d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd" Jul 14 00:55:13.506482 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.506466 2575 scope.go:117] "RemoveContainer" containerID="d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd" Jul 14 00:55:13.506753 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:55:13.506736 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd\": container with ID starting with d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd not found: ID does not exist" containerID="d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd" Jul 14 00:55:13.506800 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.506761 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd"} err="failed to get container status \"d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd\": rpc error: code = NotFound desc = could not find container \"d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd\": container with ID starting with d0207ae8c151cdeb32fbb55275732a8c190863950aa5170814591cd8200c00cd not found: ID does not exist" Jul 14 00:55:13.516012 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.515995 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-serving-cert\") pod \"c988394f-3c2c-439f-8719-506096249c37\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " Jul 14 00:55:13.516089 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516036 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-service-ca\") pod \"c988394f-3c2c-439f-8719-506096249c37\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " Jul 14 00:55:13.516089 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516055 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-trusted-ca-bundle\") pod \"c988394f-3c2c-439f-8719-506096249c37\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " Jul 14 00:55:13.516156 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516105 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-console-config\") pod \"c988394f-3c2c-439f-8719-506096249c37\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " Jul 14 00:55:13.516156 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516147 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-oauth-serving-cert\") pod \"c988394f-3c2c-439f-8719-506096249c37\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " Jul 14 00:55:13.516254 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516205 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chn9l\" (UniqueName: \"kubernetes.io/projected/c988394f-3c2c-439f-8719-506096249c37-kube-api-access-chn9l\") pod \"c988394f-3c2c-439f-8719-506096249c37\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " Jul 14 00:55:13.516254 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516232 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-oauth-config\") pod \"c988394f-3c2c-439f-8719-506096249c37\" (UID: \"c988394f-3c2c-439f-8719-506096249c37\") " Jul 14 00:55:13.516622 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516369 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-service-ca" (OuterVolumeSpecName: "service-ca") pod "c988394f-3c2c-439f-8719-506096249c37" (UID: "c988394f-3c2c-439f-8719-506096249c37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:55:13.516622 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516528 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c988394f-3c2c-439f-8719-506096249c37" (UID: "c988394f-3c2c-439f-8719-506096249c37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:55:13.516622 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516569 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-console-config" (OuterVolumeSpecName: "console-config") pod "c988394f-3c2c-439f-8719-506096249c37" (UID: "c988394f-3c2c-439f-8719-506096249c37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:55:13.516803 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.516650 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c988394f-3c2c-439f-8719-506096249c37" (UID: "c988394f-3c2c-439f-8719-506096249c37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:55:13.518030 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.518013 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c988394f-3c2c-439f-8719-506096249c37" (UID: "c988394f-3c2c-439f-8719-506096249c37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:55:13.518211 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.518191 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c988394f-3c2c-439f-8719-506096249c37" (UID: "c988394f-3c2c-439f-8719-506096249c37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:55:13.518343 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.518324 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c988394f-3c2c-439f-8719-506096249c37-kube-api-access-chn9l" (OuterVolumeSpecName: "kube-api-access-chn9l") pod "c988394f-3c2c-439f-8719-506096249c37" (UID: "c988394f-3c2c-439f-8719-506096249c37"). InnerVolumeSpecName "kube-api-access-chn9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:55:13.617520 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.617484 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-console-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:13.617520 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.617518 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-oauth-serving-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:13.617520 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.617528 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chn9l\" (UniqueName: \"kubernetes.io/projected/c988394f-3c2c-439f-8719-506096249c37-kube-api-access-chn9l\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:13.617697 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.617536 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-oauth-config\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:13.617697 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.617545 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988394f-3c2c-439f-8719-506096249c37-console-serving-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:13.617697 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.617553 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:13.617697 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.617562 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988394f-3c2c-439f-8719-506096249c37-trusted-ca-bundle\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:13.819573 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.819542 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746f486489-cvpqb"] Jul 14 00:55:13.825396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:13.825373 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-746f486489-cvpqb"] Jul 14 00:55:14.975495 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:14.975462 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c988394f-3c2c-439f-8719-506096249c37" path="/var/lib/kubelet/pods/c988394f-3c2c-439f-8719-506096249c37/volumes" Jul 14 00:55:21.483448 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:21.483421 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:33.346720 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.346686 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d"] Jul 14 00:55:33.347159 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.346871 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" podUID="7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da" containerName="manager" containerID="cri-o://62ba7fce36b1b35c555c2a53c7181551dba18f844ff7cbb32a3fbd67d385d525" gracePeriod=10 Jul 14 00:55:33.599573 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.599508 2575 generic.go:356] "Generic (PLEG): container finished" podID="7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da" containerID="62ba7fce36b1b35c555c2a53c7181551dba18f844ff7cbb32a3fbd67d385d525" exitCode=0 Jul 14 00:55:33.599573 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.599548 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" event={"ID":"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da","Type":"ContainerDied","Data":"62ba7fce36b1b35c555c2a53c7181551dba18f844ff7cbb32a3fbd67d385d525"} Jul 14 00:55:33.599702 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.599585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" event={"ID":"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da","Type":"ContainerDied","Data":"a3f3457443ec1982bbdebccddb6609b2d10446c5751b2df3384dfba56a65d499"} Jul 14 00:55:33.599702 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.599601 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3f3457443ec1982bbdebccddb6609b2d10446c5751b2df3384dfba56a65d499" Jul 14 00:55:33.605918 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.605899 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:33.686326 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.686299 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thtpp\" (UniqueName: \"kubernetes.io/projected/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-kube-api-access-thtpp\") pod \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\" (UID: \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\") " Jul 14 00:55:33.686499 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.686368 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-extensions-socket-volume\") pod \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\" (UID: \"7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da\") " Jul 14 00:55:33.686829 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.686799 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da" (UID: "7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 00:55:33.688330 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.688310 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-kube-api-access-thtpp" (OuterVolumeSpecName: "kube-api-access-thtpp") pod "7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da" (UID: "7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da"). InnerVolumeSpecName "kube-api-access-thtpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:55:33.787479 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.787452 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-extensions-socket-volume\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:33.787479 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:33.787479 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thtpp\" (UniqueName: \"kubernetes.io/projected/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da-kube-api-access-thtpp\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:55:34.604486 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:34.604450 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d" Jul 14 00:55:34.631152 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:34.631123 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d"] Jul 14 00:55:34.633661 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:34.633636 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8dc2d"] Jul 14 00:55:34.974787 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:34.974748 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da" path="/var/lib/kubelet/pods/7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da/volumes" Jul 14 00:55:50.864783 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.864749 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gdx4n"] Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865096 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" containerName="manager" Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865110 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" containerName="manager" Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865122 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c988394f-3c2c-439f-8719-506096249c37" containerName="console" Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865128 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c988394f-3c2c-439f-8719-506096249c37" containerName="console" Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865140 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da" containerName="manager" Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865145 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da" containerName="manager" Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865212 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d914b329-5ebb-4f55-b649-1434d89c69cd" containerName="manager" Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865220 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7ad791-e0ba-4a5b-bf76-a22ad35cc1da" containerName="manager" Jul 14 00:55:50.865263 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.865226 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c988394f-3c2c-439f-8719-506096249c37" containerName="console" Jul 14 00:55:50.870771 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.870755 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:50.875403 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.875370 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gdx4n"] Jul 14 00:55:50.877124 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.877099 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 00:55:50.877251 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.877138 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n2brf\"" Jul 14 00:55:50.877251 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.877138 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 00:55:50.877251 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.877106 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 00:55:50.961554 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:50.961522 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gdx4n"] Jul 14 00:55:51.032958 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.032925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49be55ee-c57a-4a6a-9553-7f333d52ac45-config-file\") pod \"limitador-limitador-64c94fd64f-gdx4n\" (UID: \"49be55ee-c57a-4a6a-9553-7f333d52ac45\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:51.033144 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.032979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqgg7\" (UniqueName: \"kubernetes.io/projected/49be55ee-c57a-4a6a-9553-7f333d52ac45-kube-api-access-pqgg7\") pod \"limitador-limitador-64c94fd64f-gdx4n\" (UID: \"49be55ee-c57a-4a6a-9553-7f333d52ac45\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:51.134488 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.134392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqgg7\" (UniqueName: \"kubernetes.io/projected/49be55ee-c57a-4a6a-9553-7f333d52ac45-kube-api-access-pqgg7\") pod \"limitador-limitador-64c94fd64f-gdx4n\" (UID: \"49be55ee-c57a-4a6a-9553-7f333d52ac45\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:51.134661 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.134494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49be55ee-c57a-4a6a-9553-7f333d52ac45-config-file\") pod \"limitador-limitador-64c94fd64f-gdx4n\" (UID: \"49be55ee-c57a-4a6a-9553-7f333d52ac45\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:51.135127 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.135103 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49be55ee-c57a-4a6a-9553-7f333d52ac45-config-file\") pod \"limitador-limitador-64c94fd64f-gdx4n\" (UID: \"49be55ee-c57a-4a6a-9553-7f333d52ac45\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:51.143678 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.143654 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqgg7\" (UniqueName: \"kubernetes.io/projected/49be55ee-c57a-4a6a-9553-7f333d52ac45-kube-api-access-pqgg7\") pod \"limitador-limitador-64c94fd64f-gdx4n\" (UID: \"49be55ee-c57a-4a6a-9553-7f333d52ac45\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:51.181561 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.181536 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:51.308820 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.308756 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gdx4n"] Jul 14 00:55:51.311263 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:55:51.311236 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49be55ee_c57a_4a6a_9553_7f333d52ac45.slice/crio-548f47672289e25a48487c692ab0a27a9f322ad309f9b00f6a3eac0386a97694 WatchSource:0}: Error finding container 548f47672289e25a48487c692ab0a27a9f322ad309f9b00f6a3eac0386a97694: Status 404 returned error can't find the container with id 548f47672289e25a48487c692ab0a27a9f322ad309f9b00f6a3eac0386a97694 Jul 14 00:55:51.313486 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.313469 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 00:55:51.687395 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:51.687355 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" event={"ID":"49be55ee-c57a-4a6a-9553-7f333d52ac45","Type":"ContainerStarted","Data":"548f47672289e25a48487c692ab0a27a9f322ad309f9b00f6a3eac0386a97694"} Jul 14 00:55:54.704349 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:54.704314 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" event={"ID":"49be55ee-c57a-4a6a-9553-7f333d52ac45","Type":"ContainerStarted","Data":"13de0a0fb9ccec575cac80de49037e15a58b011ab7eafb413de3f961a92b0b35"} Jul 14 00:55:54.704741 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:54.704378 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:55:54.720455 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:55:54.720410 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" podStartSLOduration=1.9142110639999999 podStartE2EDuration="4.720395233s" totalImagesPullingTime="2.806184169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:55:54.719165113 +0000 UTC m=+708.208502573" watchObservedRunningTime="2026-07-14 00:55:54.720395233 +0000 UTC m=+708.209732672" Jul 14 00:56:05.709567 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:05.709537 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:56:06.221874 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.221831 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gdx4n"] Jul 14 00:56:06.222058 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.222003 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" podUID="49be55ee-c57a-4a6a-9553-7f333d52ac45" containerName="limitador" containerID="cri-o://13de0a0fb9ccec575cac80de49037e15a58b011ab7eafb413de3f961a92b0b35" gracePeriod=30 Jul 14 00:56:06.765438 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.765409 2575 generic.go:356] "Generic (PLEG): container finished" podID="49be55ee-c57a-4a6a-9553-7f333d52ac45" containerID="13de0a0fb9ccec575cac80de49037e15a58b011ab7eafb413de3f961a92b0b35" exitCode=0 Jul 14 00:56:06.765750 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.765480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" event={"ID":"49be55ee-c57a-4a6a-9553-7f333d52ac45","Type":"ContainerDied","Data":"13de0a0fb9ccec575cac80de49037e15a58b011ab7eafb413de3f961a92b0b35"} Jul 14 00:56:06.765750 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.765525 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" event={"ID":"49be55ee-c57a-4a6a-9553-7f333d52ac45","Type":"ContainerDied","Data":"548f47672289e25a48487c692ab0a27a9f322ad309f9b00f6a3eac0386a97694"} Jul 14 00:56:06.765750 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.765543 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="548f47672289e25a48487c692ab0a27a9f322ad309f9b00f6a3eac0386a97694" Jul 14 00:56:06.770457 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.770437 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:56:06.844136 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.844039 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49be55ee-c57a-4a6a-9553-7f333d52ac45-config-file\") pod \"49be55ee-c57a-4a6a-9553-7f333d52ac45\" (UID: \"49be55ee-c57a-4a6a-9553-7f333d52ac45\") " Jul 14 00:56:06.844275 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.844152 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqgg7\" (UniqueName: \"kubernetes.io/projected/49be55ee-c57a-4a6a-9553-7f333d52ac45-kube-api-access-pqgg7\") pod \"49be55ee-c57a-4a6a-9553-7f333d52ac45\" (UID: \"49be55ee-c57a-4a6a-9553-7f333d52ac45\") " Jul 14 00:56:06.844398 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.844374 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49be55ee-c57a-4a6a-9553-7f333d52ac45-config-file" (OuterVolumeSpecName: "config-file") pod "49be55ee-c57a-4a6a-9553-7f333d52ac45" (UID: "49be55ee-c57a-4a6a-9553-7f333d52ac45"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 00:56:06.846152 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.846127 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49be55ee-c57a-4a6a-9553-7f333d52ac45-kube-api-access-pqgg7" (OuterVolumeSpecName: "kube-api-access-pqgg7") pod "49be55ee-c57a-4a6a-9553-7f333d52ac45" (UID: "49be55ee-c57a-4a6a-9553-7f333d52ac45"). InnerVolumeSpecName "kube-api-access-pqgg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:56:06.944835 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.944801 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49be55ee-c57a-4a6a-9553-7f333d52ac45-config-file\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:56:06.945003 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:06.944850 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqgg7\" (UniqueName: \"kubernetes.io/projected/49be55ee-c57a-4a6a-9553-7f333d52ac45-kube-api-access-pqgg7\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:56:07.770231 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:07.770202 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gdx4n" Jul 14 00:56:07.786458 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:07.786432 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gdx4n"] Jul 14 00:56:07.789744 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:07.789721 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gdx4n"] Jul 14 00:56:08.975264 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:08.975230 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49be55ee-c57a-4a6a-9553-7f333d52ac45" path="/var/lib/kubelet/pods/49be55ee-c57a-4a6a-9553-7f333d52ac45/volumes" Jul 14 00:56:12.414990 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.414955 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd"] Jul 14 00:56:12.415513 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.415497 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49be55ee-c57a-4a6a-9553-7f333d52ac45" containerName="limitador" Jul 14 00:56:12.415558 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.415516 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="49be55ee-c57a-4a6a-9553-7f333d52ac45" containerName="limitador" Jul 14 00:56:12.415627 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.415615 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="49be55ee-c57a-4a6a-9553-7f333d52ac45" containerName="limitador" Jul 14 00:56:12.420228 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.420207 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:12.422603 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.422577 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 00:56:12.422603 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.422596 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rx9dq\"" Jul 14 00:56:12.422603 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.422606 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 00:56:12.423859 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.423817 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 00:56:12.425800 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.425778 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd"] Jul 14 00:56:12.487694 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.487660 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65l94\" (UniqueName: \"kubernetes.io/projected/07921f12-805e-4420-bf47-9e8966eb7511-kube-api-access-65l94\") pod \"postgres-69fb4594cf-qqhnd\" (UID: \"07921f12-805e-4420-bf47-9e8966eb7511\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:12.487850 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.487702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/07921f12-805e-4420-bf47-9e8966eb7511-data\") pod \"postgres-69fb4594cf-qqhnd\" (UID: \"07921f12-805e-4420-bf47-9e8966eb7511\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:12.588418 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.588381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65l94\" (UniqueName: \"kubernetes.io/projected/07921f12-805e-4420-bf47-9e8966eb7511-kube-api-access-65l94\") pod \"postgres-69fb4594cf-qqhnd\" (UID: \"07921f12-805e-4420-bf47-9e8966eb7511\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:12.588418 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.588425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/07921f12-805e-4420-bf47-9e8966eb7511-data\") pod \"postgres-69fb4594cf-qqhnd\" (UID: \"07921f12-805e-4420-bf47-9e8966eb7511\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:12.588734 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.588719 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/07921f12-805e-4420-bf47-9e8966eb7511-data\") pod \"postgres-69fb4594cf-qqhnd\" (UID: \"07921f12-805e-4420-bf47-9e8966eb7511\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:12.596972 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.596950 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65l94\" (UniqueName: \"kubernetes.io/projected/07921f12-805e-4420-bf47-9e8966eb7511-kube-api-access-65l94\") pod \"postgres-69fb4594cf-qqhnd\" (UID: \"07921f12-805e-4420-bf47-9e8966eb7511\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:12.734272 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.734239 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:12.864368 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:12.864342 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd"] Jul 14 00:56:12.866480 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:56:12.866449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07921f12_805e_4420_bf47_9e8966eb7511.slice/crio-34b79344f741971ecda7a6134a4f33aa5dbb5b5da0a6b3e0e2e8f232bf12d605 WatchSource:0}: Error finding container 34b79344f741971ecda7a6134a4f33aa5dbb5b5da0a6b3e0e2e8f232bf12d605: Status 404 returned error can't find the container with id 34b79344f741971ecda7a6134a4f33aa5dbb5b5da0a6b3e0e2e8f232bf12d605 Jul 14 00:56:13.799353 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:13.799318 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" event={"ID":"07921f12-805e-4420-bf47-9e8966eb7511","Type":"ContainerStarted","Data":"34b79344f741971ecda7a6134a4f33aa5dbb5b5da0a6b3e0e2e8f232bf12d605"} Jul 14 00:56:18.828051 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:18.828014 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" event={"ID":"07921f12-805e-4420-bf47-9e8966eb7511","Type":"ContainerStarted","Data":"0e10f5ab438e952fe0dcc415abea8b1718c61c5459cdb649493fee3a064bd366"} Jul 14 00:56:18.828420 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:18.828106 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:18.844606 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:18.844560 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" podStartSLOduration=1.10945334 podStartE2EDuration="6.84454297s" totalImagesPullingTime="5.73508963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:56:18.842193765 +0000 UTC m=+732.331531208" watchObservedRunningTime="2026-07-14 00:56:18.84454297 +0000 UTC m=+732.333880411" Jul 14 00:56:24.868053 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:24.868025 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qqhnd" Jul 14 00:56:32.413407 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.413370 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fb6c5ffb6-vlg4m"] Jul 14 00:56:32.416717 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.416701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:32.420032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.420010 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 00:56:32.420032 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.420028 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d49g9\"" Jul 14 00:56:32.421370 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.421351 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 00:56:32.426796 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.426776 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fb6c5ffb6-vlg4m"] Jul 14 00:56:32.563793 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.563756 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8049a9a5-5862-482d-b071-2787aa058943-webhook-cert\") pod \"maas-controller-5fb6c5ffb6-vlg4m\" (UID: \"8049a9a5-5862-482d-b071-2787aa058943\") " pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:32.563968 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.563829 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqwjm\" (UniqueName: \"kubernetes.io/projected/8049a9a5-5862-482d-b071-2787aa058943-kube-api-access-jqwjm\") pod \"maas-controller-5fb6c5ffb6-vlg4m\" (UID: \"8049a9a5-5862-482d-b071-2787aa058943\") " pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:32.590018 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.589978 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fb5967cff-k52mr"] Jul 14 00:56:32.593518 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.593496 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:32.603349 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.603325 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb5967cff-k52mr"] Jul 14 00:56:32.664739 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.664671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8049a9a5-5862-482d-b071-2787aa058943-webhook-cert\") pod \"maas-controller-5fb6c5ffb6-vlg4m\" (UID: \"8049a9a5-5862-482d-b071-2787aa058943\") " pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:32.664739 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.664718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1be361-2032-4d89-a2db-0d7e8c51a95d-webhook-cert\") pod \"maas-controller-7fb5967cff-k52mr\" (UID: \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\") " pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:32.664925 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.664753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjdt4\" (UniqueName: \"kubernetes.io/projected/2b1be361-2032-4d89-a2db-0d7e8c51a95d-kube-api-access-bjdt4\") pod \"maas-controller-7fb5967cff-k52mr\" (UID: \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\") " pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:32.664925 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.664780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqwjm\" (UniqueName: \"kubernetes.io/projected/8049a9a5-5862-482d-b071-2787aa058943-kube-api-access-jqwjm\") pod \"maas-controller-5fb6c5ffb6-vlg4m\" (UID: \"8049a9a5-5862-482d-b071-2787aa058943\") " pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:32.667078 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.667040 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8049a9a5-5862-482d-b071-2787aa058943-webhook-cert\") pod \"maas-controller-5fb6c5ffb6-vlg4m\" (UID: \"8049a9a5-5862-482d-b071-2787aa058943\") " pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:32.673107 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.673081 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqwjm\" (UniqueName: \"kubernetes.io/projected/8049a9a5-5862-482d-b071-2787aa058943-kube-api-access-jqwjm\") pod \"maas-controller-5fb6c5ffb6-vlg4m\" (UID: \"8049a9a5-5862-482d-b071-2787aa058943\") " pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:32.726752 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.726732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:32.766018 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.765983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1be361-2032-4d89-a2db-0d7e8c51a95d-webhook-cert\") pod \"maas-controller-7fb5967cff-k52mr\" (UID: \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\") " pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:32.766672 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.766556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjdt4\" (UniqueName: \"kubernetes.io/projected/2b1be361-2032-4d89-a2db-0d7e8c51a95d-kube-api-access-bjdt4\") pod \"maas-controller-7fb5967cff-k52mr\" (UID: \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\") " pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:32.768733 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.768711 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1be361-2032-4d89-a2db-0d7e8c51a95d-webhook-cert\") pod \"maas-controller-7fb5967cff-k52mr\" (UID: \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\") " pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:32.774436 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.774415 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjdt4\" (UniqueName: \"kubernetes.io/projected/2b1be361-2032-4d89-a2db-0d7e8c51a95d-kube-api-access-bjdt4\") pod \"maas-controller-7fb5967cff-k52mr\" (UID: \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\") " pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:32.855274 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.855250 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fb6c5ffb6-vlg4m"] Jul 14 00:56:32.857120 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:56:32.857087 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8049a9a5_5862_482d_b071_2787aa058943.slice/crio-95b59e763aa19e2755c878ce9195838c94de6ae191547b495e0cd55ce0c3a681 WatchSource:0}: Error finding container 95b59e763aa19e2755c878ce9195838c94de6ae191547b495e0cd55ce0c3a681: Status 404 returned error can't find the container with id 95b59e763aa19e2755c878ce9195838c94de6ae191547b495e0cd55ce0c3a681 Jul 14 00:56:32.900150 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.900123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" event={"ID":"8049a9a5-5862-482d-b071-2787aa058943","Type":"ContainerStarted","Data":"95b59e763aa19e2755c878ce9195838c94de6ae191547b495e0cd55ce0c3a681"} Jul 14 00:56:32.903267 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:32.903239 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:33.044248 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:33.038765 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb5967cff-k52mr"] Jul 14 00:56:33.909629 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:33.909589 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb5967cff-k52mr" event={"ID":"2b1be361-2032-4d89-a2db-0d7e8c51a95d","Type":"ContainerStarted","Data":"40bdc5702b1a98be7e6ee35383408aca80102cc4ba0becfcb919b1e2dca0bb2a"} Jul 14 00:56:35.921019 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:35.920977 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" event={"ID":"8049a9a5-5862-482d-b071-2787aa058943","Type":"ContainerStarted","Data":"9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e"} Jul 14 00:56:35.921483 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:35.921048 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:35.922471 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:35.922450 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb5967cff-k52mr" event={"ID":"2b1be361-2032-4d89-a2db-0d7e8c51a95d","Type":"ContainerStarted","Data":"d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4"} Jul 14 00:56:35.922566 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:35.922491 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:35.945298 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:35.945250 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" podStartSLOduration=1.448938001 podStartE2EDuration="3.945231223s" totalImagesPullingTime="2.496293222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:56:35.942526051 +0000 UTC m=+749.431863493" watchObservedRunningTime="2026-07-14 00:56:35.945231223 +0000 UTC m=+749.434568664" Jul 14 00:56:35.961392 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:35.961323 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fb5967cff-k52mr" podStartSLOduration=1.6375121190000002 podStartE2EDuration="3.961303109s" totalImagesPullingTime="2.32379099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:56:35.960543124 +0000 UTC m=+749.449880589" watchObservedRunningTime="2026-07-14 00:56:35.961303109 +0000 UTC m=+749.450640554" Jul 14 00:56:46.929498 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:46.929467 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 00:56:46.929949 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:46.929540 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:46.991668 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:46.991635 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fb6c5ffb6-vlg4m"] Jul 14 00:56:46.991853 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:46.991829 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" podUID="8049a9a5-5862-482d-b071-2787aa058943" containerName="manager" containerID="cri-o://9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e" gracePeriod=30 Jul 14 00:56:47.232697 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.232672 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:47.399210 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.399177 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqwjm\" (UniqueName: \"kubernetes.io/projected/8049a9a5-5862-482d-b071-2787aa058943-kube-api-access-jqwjm\") pod \"8049a9a5-5862-482d-b071-2787aa058943\" (UID: \"8049a9a5-5862-482d-b071-2787aa058943\") " Jul 14 00:56:47.399375 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.399228 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8049a9a5-5862-482d-b071-2787aa058943-webhook-cert\") pod \"8049a9a5-5862-482d-b071-2787aa058943\" (UID: \"8049a9a5-5862-482d-b071-2787aa058943\") " Jul 14 00:56:47.401377 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.401349 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8049a9a5-5862-482d-b071-2787aa058943-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8049a9a5-5862-482d-b071-2787aa058943" (UID: "8049a9a5-5862-482d-b071-2787aa058943"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 00:56:47.401509 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.401400 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8049a9a5-5862-482d-b071-2787aa058943-kube-api-access-jqwjm" (OuterVolumeSpecName: "kube-api-access-jqwjm") pod "8049a9a5-5862-482d-b071-2787aa058943" (UID: "8049a9a5-5862-482d-b071-2787aa058943"). InnerVolumeSpecName "kube-api-access-jqwjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:56:47.500541 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.500475 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqwjm\" (UniqueName: \"kubernetes.io/projected/8049a9a5-5862-482d-b071-2787aa058943-kube-api-access-jqwjm\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:56:47.500541 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.500499 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8049a9a5-5862-482d-b071-2787aa058943-webhook-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 00:56:47.979011 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.978978 2575 generic.go:356] "Generic (PLEG): container finished" podID="8049a9a5-5862-482d-b071-2787aa058943" containerID="9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e" exitCode=0 Jul 14 00:56:47.979436 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.979017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" event={"ID":"8049a9a5-5862-482d-b071-2787aa058943","Type":"ContainerDied","Data":"9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e"} Jul 14 00:56:47.979436 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.979053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" event={"ID":"8049a9a5-5862-482d-b071-2787aa058943","Type":"ContainerDied","Data":"95b59e763aa19e2755c878ce9195838c94de6ae191547b495e0cd55ce0c3a681"} Jul 14 00:56:47.979436 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.979019 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fb6c5ffb6-vlg4m" Jul 14 00:56:47.979436 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.979096 2575 scope.go:117] "RemoveContainer" containerID="9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e" Jul 14 00:56:47.988258 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.988238 2575 scope.go:117] "RemoveContainer" containerID="9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e" Jul 14 00:56:47.988515 ip-10-0-131-60 kubenswrapper[2575]: E0714 00:56:47.988495 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e\": container with ID starting with 9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e not found: ID does not exist" containerID="9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e" Jul 14 00:56:47.988579 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:47.988524 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e"} err="failed to get container status \"9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e\": rpc error: code = NotFound desc = could not find container \"9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e\": container with ID starting with 9146b4cc815b058f92c97ffe4921caf39950072c1fbbedb68cfa6b34eaf1861e not found: ID does not exist" Jul 14 00:56:48.000494 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:48.000469 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fb6c5ffb6-vlg4m"] Jul 14 00:56:48.004009 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:48.003987 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fb6c5ffb6-vlg4m"] Jul 14 00:56:48.975360 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:56:48.975326 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8049a9a5-5862-482d-b071-2787aa058943" path="/var/lib/kubelet/pods/8049a9a5-5862-482d-b071-2787aa058943/volumes" Jul 14 00:57:07.886247 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.886215 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq"] Jul 14 00:57:07.886629 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.886568 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8049a9a5-5862-482d-b071-2787aa058943" containerName="manager" Jul 14 00:57:07.886629 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.886579 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8049a9a5-5862-482d-b071-2787aa058943" containerName="manager" Jul 14 00:57:07.886704 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.886649 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8049a9a5-5862-482d-b071-2787aa058943" containerName="manager" Jul 14 00:57:07.892626 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.892606 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:07.896257 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.896236 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-d6r59\"" Jul 14 00:57:07.896257 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.896246 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 00:57:07.905902 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.905880 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq"] Jul 14 00:57:07.971242 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.971214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-maas-api-tls\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:07.971368 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.971249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-openshift-service-ca\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:07.971368 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:07.971271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6z8\" (UniqueName: \"kubernetes.io/projected/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-kube-api-access-6x6z8\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:08.072165 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.072134 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-maas-api-tls\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:08.072314 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.072174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-openshift-service-ca\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:08.072314 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.072196 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6z8\" (UniqueName: \"kubernetes.io/projected/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-kube-api-access-6x6z8\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:08.072869 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.072844 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-openshift-service-ca\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:08.074558 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.074537 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-maas-api-tls\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:08.080010 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.079992 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6z8\" (UniqueName: \"kubernetes.io/projected/040a8ca2-6c2c-42cd-80b3-be6496a54e2a-kube-api-access-6x6z8\") pod \"maas-api-67f66699d9-r6hvq\" (UID: \"040a8ca2-6c2c-42cd-80b3-be6496a54e2a\") " pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:08.203261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.203235 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:08.351424 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.351401 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq"] Jul 14 00:57:08.353219 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:57:08.353187 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040a8ca2_6c2c_42cd_80b3_be6496a54e2a.slice/crio-6c7f2a1944922219e05ba98ad33deaf0ce279d2e63a3472cb109d28ddbd80db2 WatchSource:0}: Error finding container 6c7f2a1944922219e05ba98ad33deaf0ce279d2e63a3472cb109d28ddbd80db2: Status 404 returned error can't find the container with id 6c7f2a1944922219e05ba98ad33deaf0ce279d2e63a3472cb109d28ddbd80db2 Jul 14 00:57:08.377195 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.377171 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb"] Jul 14 00:57:08.383166 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.383150 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:08.385575 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.385554 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ksgjh\"" Jul 14 00:57:08.385681 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.385664 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 00:57:08.392716 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.392688 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb"] Jul 14 00:57:08.476715 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.476637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qgmwb\" (UID: \"4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:08.476715 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.476669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrj9q\" (UniqueName: \"kubernetes.io/projected/4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8-kube-api-access-xrj9q\") pod \"payload-pre-processing-74584bb9f8-qgmwb\" (UID: \"4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:08.577261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.577231 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qgmwb\" (UID: \"4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:08.577261 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.577263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrj9q\" (UniqueName: \"kubernetes.io/projected/4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8-kube-api-access-xrj9q\") pod \"payload-pre-processing-74584bb9f8-qgmwb\" (UID: \"4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:08.577888 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.577868 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qgmwb\" (UID: \"4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:08.585223 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.585200 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrj9q\" (UniqueName: \"kubernetes.io/projected/4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8-kube-api-access-xrj9q\") pod \"payload-pre-processing-74584bb9f8-qgmwb\" (UID: \"4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:08.694478 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.694448 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:08.822684 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:08.822622 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb"] Jul 14 00:57:08.824772 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:57:08.824744 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee2ca44_87a1_4825_b0e6_d66b1b8bf4b8.slice/crio-892da95dd975642cfaf9ed5b3154e1d892dbb1975bf2c3eaa1008e8e2c542ec3 WatchSource:0}: Error finding container 892da95dd975642cfaf9ed5b3154e1d892dbb1975bf2c3eaa1008e8e2c542ec3: Status 404 returned error can't find the container with id 892da95dd975642cfaf9ed5b3154e1d892dbb1975bf2c3eaa1008e8e2c542ec3 Jul 14 00:57:09.091124 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:09.091021 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" event={"ID":"040a8ca2-6c2c-42cd-80b3-be6496a54e2a","Type":"ContainerStarted","Data":"6c7f2a1944922219e05ba98ad33deaf0ce279d2e63a3472cb109d28ddbd80db2"} Jul 14 00:57:09.092166 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:09.092140 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" event={"ID":"4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8","Type":"ContainerStarted","Data":"892da95dd975642cfaf9ed5b3154e1d892dbb1975bf2c3eaa1008e8e2c542ec3"} Jul 14 00:57:11.103260 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:11.103223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" event={"ID":"040a8ca2-6c2c-42cd-80b3-be6496a54e2a","Type":"ContainerStarted","Data":"60dd764709a8d5b4f46c3dbc5ad8750961962f762efe96b7f5e09e3b76092820"} Jul 14 00:57:11.103673 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:11.103305 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:11.104686 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:11.104667 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" event={"ID":"4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8","Type":"ContainerStarted","Data":"b707f01132acd5d3a37e824d708ce2195198fc21beda517a4e34881cf31eaf9e"} Jul 14 00:57:11.104785 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:11.104771 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:11.120033 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:11.119985 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" podStartSLOduration=2.073219867 podStartE2EDuration="4.119969623s" totalImagesPullingTime="2.046749756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:57:11.119345232 +0000 UTC m=+784.608682707" watchObservedRunningTime="2026-07-14 00:57:11.119969623 +0000 UTC m=+784.609307068" Jul 14 00:57:11.134573 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:11.134533 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" podStartSLOduration=1.5580276830000002 podStartE2EDuration="3.134521494s" totalImagesPullingTime="1.576493811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:57:11.132854824 +0000 UTC m=+784.622192264" watchObservedRunningTime="2026-07-14 00:57:11.134521494 +0000 UTC m=+784.623858934" Jul 14 00:57:17.114316 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:17.114281 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67f66699d9-r6hvq" Jul 14 00:57:22.111252 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:22.111224 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qgmwb" Jul 14 00:57:25.619994 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.619961 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8"] Jul 14 00:57:25.624681 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.624661 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.627988 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.627961 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 00:57:25.628128 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.627997 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 00:57:25.628348 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.628331 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-k75jk\"" Jul 14 00:57:25.628669 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.628653 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 00:57:25.647378 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.647354 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8"] Jul 14 00:57:25.726824 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.726789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.726824 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.726826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrhm5\" (UniqueName: \"kubernetes.io/projected/82f96216-249d-46da-bbe7-f11232d54063-kube-api-access-mrhm5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.727039 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.726856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.727039 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.726960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.727039 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.726992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f96216-249d-46da-bbe7-f11232d54063-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.727039 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.727039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.827769 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.827739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.827769 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.827774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f96216-249d-46da-bbe7-f11232d54063-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.827978 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.827837 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.827978 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.827867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.827978 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.827890 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrhm5\" (UniqueName: \"kubernetes.io/projected/82f96216-249d-46da-bbe7-f11232d54063-kube-api-access-mrhm5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.827978 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.827938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.828382 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.828357 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.828470 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.828405 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.828511 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.828474 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.830087 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.830044 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f96216-249d-46da-bbe7-f11232d54063-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.830411 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.830394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f96216-249d-46da-bbe7-f11232d54063-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.836200 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.836179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrhm5\" (UniqueName: \"kubernetes.io/projected/82f96216-249d-46da-bbe7-f11232d54063-kube-api-access-mrhm5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8\" (UID: \"82f96216-249d-46da-bbe7-f11232d54063\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:25.935269 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:25.935204 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:26.066959 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:26.066934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8"] Jul 14 00:57:26.071560 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:57:26.071529 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f96216_249d_46da_bbe7_f11232d54063.slice/crio-ce49d681f7745f2f52a18f43e5d9ccaf92a1f1d3aaf8d6442f166aaaabe9c29c WatchSource:0}: Error finding container ce49d681f7745f2f52a18f43e5d9ccaf92a1f1d3aaf8d6442f166aaaabe9c29c: Status 404 returned error can't find the container with id ce49d681f7745f2f52a18f43e5d9ccaf92a1f1d3aaf8d6442f166aaaabe9c29c Jul 14 00:57:26.172395 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:26.172364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" event={"ID":"82f96216-249d-46da-bbe7-f11232d54063","Type":"ContainerStarted","Data":"ce49d681f7745f2f52a18f43e5d9ccaf92a1f1d3aaf8d6442f166aaaabe9c29c"} Jul 14 00:57:28.183885 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:28.183848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" event={"ID":"82f96216-249d-46da-bbe7-f11232d54063","Type":"ContainerStarted","Data":"c919451ed489678a200a6f5f4f86110b161d362749ca0709e1cb5549453e13bf"} Jul 14 00:57:28.205844 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:28.205799 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" podStartSLOduration=2.069798712 podStartE2EDuration="3.205785622s" totalImagesPullingTime="1.13598691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:57:28.203602952 +0000 UTC m=+801.692940426" watchObservedRunningTime="2026-07-14 00:57:28.205785622 +0000 UTC m=+801.695123062" Jul 14 00:57:35.935732 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:35.935652 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:35.935732 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:35.935713 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:35.947941 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:35.947919 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:57:36.233041 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:57:36.233013 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8" Jul 14 00:58:13.224318 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.224284 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6"] Jul 14 00:58:13.227826 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.227805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.230338 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.230316 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 00:58:13.235168 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.235134 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6"] Jul 14 00:58:13.344969 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.344940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.345139 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.344986 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.345139 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.345121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8qh\" (UniqueName: \"kubernetes.io/projected/36fd1328-d12d-42af-b874-0ad1f33bbada-kube-api-access-hk8qh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.345219 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.345149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.345219 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.345179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36fd1328-d12d-42af-b874-0ad1f33bbada-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.345282 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.345225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.445780 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.445742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.445965 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.445793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36fd1328-d12d-42af-b874-0ad1f33bbada-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.445965 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.445827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.445965 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.445858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.445965 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.445905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.446210 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.445981 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8qh\" (UniqueName: \"kubernetes.io/projected/36fd1328-d12d-42af-b874-0ad1f33bbada-kube-api-access-hk8qh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.446269 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.446217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.446269 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.446255 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.446358 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.446290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.448057 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.448029 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36fd1328-d12d-42af-b874-0ad1f33bbada-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.448208 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.448192 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36fd1328-d12d-42af-b874-0ad1f33bbada-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.453786 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.453770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8qh\" (UniqueName: \"kubernetes.io/projected/36fd1328-d12d-42af-b874-0ad1f33bbada-kube-api-access-hk8qh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6\" (UID: \"36fd1328-d12d-42af-b874-0ad1f33bbada\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.538570 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.538490 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:13.670396 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:13.670343 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6"] Jul 14 00:58:13.672563 ip-10-0-131-60 kubenswrapper[2575]: W0714 00:58:13.672539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fd1328_d12d_42af_b874_0ad1f33bbada.slice/crio-1feffbd6bceb3a7f7bee7bfc624ecc1f6a86c94c6a3ad63728069cc5ca8a1b9b WatchSource:0}: Error finding container 1feffbd6bceb3a7f7bee7bfc624ecc1f6a86c94c6a3ad63728069cc5ca8a1b9b: Status 404 returned error can't find the container with id 1feffbd6bceb3a7f7bee7bfc624ecc1f6a86c94c6a3ad63728069cc5ca8a1b9b Jul 14 00:58:14.403359 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:14.403318 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" event={"ID":"36fd1328-d12d-42af-b874-0ad1f33bbada","Type":"ContainerStarted","Data":"110473bcbf58ff4251c8c0fddc895a925a979b7a6b3be3a8ad9dca92d2cc23f3"} Jul 14 00:58:14.403745 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:14.403396 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" event={"ID":"36fd1328-d12d-42af-b874-0ad1f33bbada","Type":"ContainerStarted","Data":"1feffbd6bceb3a7f7bee7bfc624ecc1f6a86c94c6a3ad63728069cc5ca8a1b9b"} Jul 14 00:58:14.420916 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:14.420856 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" podStartSLOduration=1.243391347 podStartE2EDuration="1.420839759s" totalImagesPullingTime="177.448412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:58:14.418881157 +0000 UTC m=+847.908218637" watchObservedRunningTime="2026-07-14 00:58:14.420839759 +0000 UTC m=+847.910177200" Jul 14 00:58:23.539445 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:23.539410 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:23.539894 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:23.539499 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:23.551995 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:23.551965 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:58:24.463166 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:58:24.463140 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6" Jul 14 00:59:06.894848 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:59:06.894819 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:59:06.898491 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:59:06.898464 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 00:59:06.901206 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:59:06.901189 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 00:59:06.904568 ip-10-0-131-60 kubenswrapper[2575]: I0714 00:59:06.904553 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:00:00.140148 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:00.140118 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6"] Jul 14 01:00:00.143522 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:00.143500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6" Jul 14 01:00:00.145917 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:00.145897 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kl2pl\"" Jul 14 01:00:00.151154 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:00.150974 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6"] Jul 14 01:00:00.155079 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:00.155052 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6" Jul 14 01:00:00.285123 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:00.285096 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6"] Jul 14 01:00:00.287501 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:00:00.287473 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc746a2ab_d87b_4a29_b439_3b3f570bb168.slice/crio-6f1949dc2fbf793259ae3c42fd6ce42d8f5f84a800e420bf8df60bae28e43450 WatchSource:0}: Error finding container 6f1949dc2fbf793259ae3c42fd6ce42d8f5f84a800e420bf8df60bae28e43450: Status 404 returned error can't find the container with id 6f1949dc2fbf793259ae3c42fd6ce42d8f5f84a800e420bf8df60bae28e43450 Jul 14 01:00:00.923479 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:00.923445 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6" event={"ID":"c746a2ab-d87b-4a29-b439-3b3f570bb168","Type":"ContainerStarted","Data":"6f1949dc2fbf793259ae3c42fd6ce42d8f5f84a800e420bf8df60bae28e43450"} Jul 14 01:00:04.954375 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:04.954339 2575 generic.go:356] "Generic (PLEG): container finished" podID="c746a2ab-d87b-4a29-b439-3b3f570bb168" containerID="fe5a41a5804e648627813ac828ad83536560b1adfa9cf0e2f5b721a638ad3778" exitCode=0 Jul 14 01:00:04.954772 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:04.954419 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6" event={"ID":"c746a2ab-d87b-4a29-b439-3b3f570bb168","Type":"ContainerDied","Data":"fe5a41a5804e648627813ac828ad83536560b1adfa9cf0e2f5b721a638ad3778"} Jul 14 01:00:06.089209 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:06.089185 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6" Jul 14 01:00:06.964539 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:06.964509 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6" Jul 14 01:00:06.964721 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:06.964546 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733180-grnz6" event={"ID":"c746a2ab-d87b-4a29-b439-3b3f570bb168","Type":"ContainerDied","Data":"6f1949dc2fbf793259ae3c42fd6ce42d8f5f84a800e420bf8df60bae28e43450"} Jul 14 01:00:06.964721 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:06.964594 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f1949dc2fbf793259ae3c42fd6ce42d8f5f84a800e420bf8df60bae28e43450" Jul 14 01:00:56.143576 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.143540 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fb5967cff-k52mr"] Jul 14 01:00:56.144137 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.143834 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fb5967cff-k52mr" podUID="2b1be361-2032-4d89-a2db-0d7e8c51a95d" containerName="manager" containerID="cri-o://d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4" gracePeriod=30 Jul 14 01:00:56.390363 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.390336 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 01:00:56.441692 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.441656 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1be361-2032-4d89-a2db-0d7e8c51a95d-webhook-cert\") pod \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\" (UID: \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\") " Jul 14 01:00:56.441692 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.441695 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjdt4\" (UniqueName: \"kubernetes.io/projected/2b1be361-2032-4d89-a2db-0d7e8c51a95d-kube-api-access-bjdt4\") pod \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\" (UID: \"2b1be361-2032-4d89-a2db-0d7e8c51a95d\") " Jul 14 01:00:56.443680 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.443646 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b1be361-2032-4d89-a2db-0d7e8c51a95d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2b1be361-2032-4d89-a2db-0d7e8c51a95d" (UID: "2b1be361-2032-4d89-a2db-0d7e8c51a95d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:00:56.443785 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.443761 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b1be361-2032-4d89-a2db-0d7e8c51a95d-kube-api-access-bjdt4" (OuterVolumeSpecName: "kube-api-access-bjdt4") pod "2b1be361-2032-4d89-a2db-0d7e8c51a95d" (UID: "2b1be361-2032-4d89-a2db-0d7e8c51a95d"). InnerVolumeSpecName "kube-api-access-bjdt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:00:56.542484 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.542452 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b1be361-2032-4d89-a2db-0d7e8c51a95d-webhook-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:00:56.542484 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:56.542479 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjdt4\" (UniqueName: \"kubernetes.io/projected/2b1be361-2032-4d89-a2db-0d7e8c51a95d-kube-api-access-bjdt4\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:00:57.218858 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.218827 2575 generic.go:356] "Generic (PLEG): container finished" podID="2b1be361-2032-4d89-a2db-0d7e8c51a95d" containerID="d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4" exitCode=0 Jul 14 01:00:57.219274 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.218874 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb5967cff-k52mr" Jul 14 01:00:57.219274 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.218878 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb5967cff-k52mr" event={"ID":"2b1be361-2032-4d89-a2db-0d7e8c51a95d","Type":"ContainerDied","Data":"d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4"} Jul 14 01:00:57.219274 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.218943 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb5967cff-k52mr" event={"ID":"2b1be361-2032-4d89-a2db-0d7e8c51a95d","Type":"ContainerDied","Data":"40bdc5702b1a98be7e6ee35383408aca80102cc4ba0becfcb919b1e2dca0bb2a"} Jul 14 01:00:57.219274 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.218974 2575 scope.go:117] "RemoveContainer" containerID="d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4" Jul 14 01:00:57.227535 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.227518 2575 scope.go:117] "RemoveContainer" containerID="d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4" Jul 14 01:00:57.227769 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:00:57.227752 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4\": container with ID starting with d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4 not found: ID does not exist" containerID="d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4" Jul 14 01:00:57.227817 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.227775 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4"} err="failed to get container status \"d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4\": rpc error: code = NotFound desc = could not find container \"d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4\": container with ID starting with d31201522450ec658f6d0f56dd359b2c8720dd176853ef5182ef00a0845059c4 not found: ID does not exist" Jul 14 01:00:57.237304 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.237254 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fb5967cff-k52mr"] Jul 14 01:00:57.241189 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:57.241171 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fb5967cff-k52mr"] Jul 14 01:00:58.038287 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.038254 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fb5967cff-cvbh7"] Jul 14 01:00:58.038612 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.038599 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c746a2ab-d87b-4a29-b439-3b3f570bb168" containerName="cleanup" Jul 14 01:00:58.038612 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.038613 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c746a2ab-d87b-4a29-b439-3b3f570bb168" containerName="cleanup" Jul 14 01:00:58.038702 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.038631 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b1be361-2032-4d89-a2db-0d7e8c51a95d" containerName="manager" Jul 14 01:00:58.038702 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.038638 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b1be361-2032-4d89-a2db-0d7e8c51a95d" containerName="manager" Jul 14 01:00:58.038702 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.038696 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c746a2ab-d87b-4a29-b439-3b3f570bb168" containerName="cleanup" Jul 14 01:00:58.038803 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.038705 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b1be361-2032-4d89-a2db-0d7e8c51a95d" containerName="manager" Jul 14 01:00:58.043238 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.043221 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:00:58.046787 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.046738 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 01:00:58.046787 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.046768 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d49g9\"" Jul 14 01:00:58.047225 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.046772 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 01:00:58.049455 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.049436 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb5967cff-cvbh7"] Jul 14 01:00:58.054724 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.054699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptgbm\" (UniqueName: \"kubernetes.io/projected/9abd3f67-5508-46fe-b188-32b5676f2b55-kube-api-access-ptgbm\") pod \"maas-controller-7fb5967cff-cvbh7\" (UID: \"9abd3f67-5508-46fe-b188-32b5676f2b55\") " pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:00:58.055088 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.055044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9abd3f67-5508-46fe-b188-32b5676f2b55-webhook-cert\") pod \"maas-controller-7fb5967cff-cvbh7\" (UID: \"9abd3f67-5508-46fe-b188-32b5676f2b55\") " pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:00:58.155868 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.155836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9abd3f67-5508-46fe-b188-32b5676f2b55-webhook-cert\") pod \"maas-controller-7fb5967cff-cvbh7\" (UID: \"9abd3f67-5508-46fe-b188-32b5676f2b55\") " pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:00:58.155990 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.155892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptgbm\" (UniqueName: \"kubernetes.io/projected/9abd3f67-5508-46fe-b188-32b5676f2b55-kube-api-access-ptgbm\") pod \"maas-controller-7fb5967cff-cvbh7\" (UID: \"9abd3f67-5508-46fe-b188-32b5676f2b55\") " pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:00:58.158294 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.158265 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9abd3f67-5508-46fe-b188-32b5676f2b55-webhook-cert\") pod \"maas-controller-7fb5967cff-cvbh7\" (UID: \"9abd3f67-5508-46fe-b188-32b5676f2b55\") " pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:00:58.164353 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.164332 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptgbm\" (UniqueName: \"kubernetes.io/projected/9abd3f67-5508-46fe-b188-32b5676f2b55-kube-api-access-ptgbm\") pod \"maas-controller-7fb5967cff-cvbh7\" (UID: \"9abd3f67-5508-46fe-b188-32b5676f2b55\") " pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:00:58.354940 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.354864 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:00:58.484819 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.484796 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb5967cff-cvbh7"] Jul 14 01:00:58.486611 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:00:58.486580 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9abd3f67_5508_46fe_b188_32b5676f2b55.slice/crio-6755cc2e480b91b4962d2be29e550141cdf00f92ccb7889d66d6341caa1a6304 WatchSource:0}: Error finding container 6755cc2e480b91b4962d2be29e550141cdf00f92ccb7889d66d6341caa1a6304: Status 404 returned error can't find the container with id 6755cc2e480b91b4962d2be29e550141cdf00f92ccb7889d66d6341caa1a6304 Jul 14 01:00:58.488275 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.488258 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 01:00:58.975394 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:58.975365 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b1be361-2032-4d89-a2db-0d7e8c51a95d" path="/var/lib/kubelet/pods/2b1be361-2032-4d89-a2db-0d7e8c51a95d/volumes" Jul 14 01:00:59.231995 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:00:59.231906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb5967cff-cvbh7" event={"ID":"9abd3f67-5508-46fe-b188-32b5676f2b55","Type":"ContainerStarted","Data":"6755cc2e480b91b4962d2be29e550141cdf00f92ccb7889d66d6341caa1a6304"} Jul 14 01:01:00.238404 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:01:00.238356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb5967cff-cvbh7" event={"ID":"9abd3f67-5508-46fe-b188-32b5676f2b55","Type":"ContainerStarted","Data":"672b55fa133a7ed240aa36b7ce7cd2af5a86d31f2c5ac5ce767ffda8750af880"} Jul 14 01:01:00.238817 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:01:00.238450 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:01:00.256671 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:01:00.256633 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fb5967cff-cvbh7" podStartSLOduration=1.208452528 podStartE2EDuration="2.256619107s" totalImagesPullingTime="1.048166579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:01:00.2556613 +0000 UTC m=+1013.744998763" watchObservedRunningTime="2026-07-14 01:01:00.256619107 +0000 UTC m=+1013.745956548" Jul 14 01:01:11.245694 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:01:11.245667 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fb5967cff-cvbh7" Jul 14 01:02:06.940767 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:02:06.940739 2575 scope.go:117] "RemoveContainer" containerID="13de0a0fb9ccec575cac80de49037e15a58b011ab7eafb413de3f961a92b0b35" Jul 14 01:02:06.948953 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:02:06.948936 2575 scope.go:117] "RemoveContainer" containerID="62ba7fce36b1b35c555c2a53c7181551dba18f844ff7cbb32a3fbd67d385d525" Jul 14 01:04:06.925649 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:04:06.925616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:04:06.930797 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:04:06.930770 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:04:06.932588 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:04:06.932568 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:04:06.937170 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:04:06.937152 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:09:06.956855 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:09:06.956824 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:09:06.963254 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:09:06.963225 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:09:06.963657 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:09:06.963637 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:09:06.970454 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:09:06.970436 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:14:06.994835 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:06.994803 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:14:07.004364 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:07.004341 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:14:07.006119 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:07.006098 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:14:07.012094 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:07.012058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:14:40.752509 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.752469 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm"] Jul 14 01:14:40.756670 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.756643 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.759310 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.759282 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-6969890f-gw-openshift-default-dockercfg-88l2b\"" Jul 14 01:14:40.770039 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.770015 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm"] Jul 14 01:14:40.854452 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-credential-socket\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.854619 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854459 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-token\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.854619 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-envoy\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.854619 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-data\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.854619 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-podinfo\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.854619 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-socket\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.854829 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istiod-ca-cert\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.854829 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-certs\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.854829 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.854760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6rpc\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-kube-api-access-m6rpc\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.955756 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.955714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-envoy\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.955756 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.955756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-data\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956019 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.955889 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-podinfo\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956019 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.955931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-socket\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956019 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.955962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istiod-ca-cert\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956248 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-certs\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956248 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6rpc\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-kube-api-access-m6rpc\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956248 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956143 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-data\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956248 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956153 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-credential-socket\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956248 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956205 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-token\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956508 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956348 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-socket\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956508 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956381 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-certs\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956615 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-credential-socket\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.956735 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.956714 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istiod-ca-cert\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.958208 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.958187 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-envoy\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.958359 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.958341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-podinfo\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.964571 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.964543 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-token\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:40.964973 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:40.964951 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6rpc\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-kube-api-access-m6rpc\") pod \"e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:41.071772 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:41.071686 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:41.214509 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:41.214482 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm"] Jul 14 01:14:41.216446 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:14:41.216409 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d1a822_6ed9_4cf7_b415_b178c0d292ce.slice/crio-300f5a2bbec22a8714f2180fcf196db3cb316bc07f480476819ece53d2ffe1f5 WatchSource:0}: Error finding container 300f5a2bbec22a8714f2180fcf196db3cb316bc07f480476819ece53d2ffe1f5: Status 404 returned error can't find the container with id 300f5a2bbec22a8714f2180fcf196db3cb316bc07f480476819ece53d2ffe1f5 Jul 14 01:14:41.218459 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:41.218442 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 01:14:41.233942 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:41.233913 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" event={"ID":"71d1a822-6ed9-4cf7-b415-b178c0d292ce","Type":"ContainerStarted","Data":"300f5a2bbec22a8714f2180fcf196db3cb316bc07f480476819ece53d2ffe1f5"} Jul 14 01:14:44.256161 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:44.256121 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:14:44.256408 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:44.256204 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:14:44.256408 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:44.256232 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:14:45.255865 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:45.255828 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" event={"ID":"71d1a822-6ed9-4cf7-b415-b178c0d292ce","Type":"ContainerStarted","Data":"93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b"} Jul 14 01:14:45.276468 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:45.276405 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" podStartSLOduration=2.239173807 podStartE2EDuration="5.276390704s" totalImagesPullingTime="3.037216897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:14:45.274249928 +0000 UTC m=+1838.763587410" watchObservedRunningTime="2026-07-14 01:14:45.276390704 +0000 UTC m=+1838.765728145" Jul 14 01:14:46.072756 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:46.072716 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:46.077564 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:46.077537 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:46.260864 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:46.260835 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:46.261737 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:46.261714 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:56.312837 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:56.312803 2575 generic.go:356] "Generic (PLEG): container finished" podID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerID="93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b" exitCode=0 Jul 14 01:14:56.313275 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:56.312876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" event={"ID":"71d1a822-6ed9-4cf7-b415-b178c0d292ce","Type":"ContainerDied","Data":"93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b"} Jul 14 01:14:56.313275 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:56.313230 2575 scope.go:117] "RemoveContainer" containerID="93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b" Jul 14 01:14:56.315165 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:56.315128 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:14:56.315249 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:56.315197 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:14:56.315249 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:56.315228 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:14:57.319300 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:57.319263 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" event={"ID":"71d1a822-6ed9-4cf7-b415-b178c0d292ce","Type":"ContainerStarted","Data":"49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3"} Jul 14 01:14:58.072634 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:58.072597 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:14:58.073758 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:58.073729 2575 patch_prober.go:28] interesting pod/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 14 01:14:58.073908 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:58.073798 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 14 01:14:59.072825 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:59.072788 2575 patch_prober.go:28] interesting pod/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 14 01:14:59.073240 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:14:59.072843 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 14 01:15:00.072572 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:00.072537 2575 patch_prober.go:28] interesting pod/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 14 01:15:00.072747 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:00.072596 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 14 01:15:01.072084 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:01.072043 2575 patch_prober.go:28] interesting pod/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 14 01:15:01.072494 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:01.072138 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 14 01:15:01.261468 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:01.261432 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:15:02.076496 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:02.076464 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:15:02.077303 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:02.077283 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:15:46.686397 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:46.686316 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm"] Jul 14 01:15:46.686831 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:46.686589 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" containerID="cri-o://49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3" gracePeriod=30 Jul 14 01:15:47.078867 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:47.078826 2575 patch_prober.go:28] interesting pod/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 01:15:47.079038 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:47.078887 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 01:15:51.949812 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:51.949751 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:15:52.018795 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.018761 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-credential-socket\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.018795 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.018797 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-data\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.019037 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.018812 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-certs\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.019037 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.018870 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6rpc\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-kube-api-access-m6rpc\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.019037 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.018941 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istiod-ca-cert\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.019037 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.018989 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-envoy\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.019037 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019020 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-podinfo\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.019329 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019048 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-token\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.019329 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019059 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:15:52.019329 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019201 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-socket\") pod \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\" (UID: \"71d1a822-6ed9-4cf7-b415-b178c0d292ce\") " Jul 14 01:15:52.019496 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019404 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:15:52.019554 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019511 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:15:52.019638 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019616 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:15:52.019806 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019641 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.019939 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.019927 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.020321 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.020301 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:15:52.021888 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.021859 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-kube-api-access-m6rpc" (OuterVolumeSpecName: "kube-api-access-m6rpc") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "kube-api-access-m6rpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:15:52.021981 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.021898 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 01:15:52.021981 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.021893 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:15:52.021981 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.021930 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71d1a822-6ed9-4cf7-b415-b178c0d292ce" (UID: "71d1a822-6ed9-4cf7-b415-b178c0d292ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:15:52.121121 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.121087 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.121121 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.121120 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.121121 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.121129 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.121365 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.121137 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.121365 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.121145 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.121365 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.121153 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71d1a822-6ed9-4cf7-b415-b178c0d292ce-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.121365 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.121161 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6rpc\" (UniqueName: \"kubernetes.io/projected/71d1a822-6ed9-4cf7-b415-b178c0d292ce-kube-api-access-m6rpc\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:15:52.594161 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.594122 2575 generic.go:356] "Generic (PLEG): container finished" podID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerID="49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3" exitCode=0 Jul 14 01:15:52.594411 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.594180 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" Jul 14 01:15:52.594411 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.594183 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" event={"ID":"71d1a822-6ed9-4cf7-b415-b178c0d292ce","Type":"ContainerDied","Data":"49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3"} Jul 14 01:15:52.594411 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.594237 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm" event={"ID":"71d1a822-6ed9-4cf7-b415-b178c0d292ce","Type":"ContainerDied","Data":"300f5a2bbec22a8714f2180fcf196db3cb316bc07f480476819ece53d2ffe1f5"} Jul 14 01:15:52.594411 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.594268 2575 scope.go:117] "RemoveContainer" containerID="49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3" Jul 14 01:15:52.603969 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.603948 2575 scope.go:117] "RemoveContainer" containerID="93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b" Jul 14 01:15:52.611999 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.611978 2575 scope.go:117] "RemoveContainer" containerID="49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3" Jul 14 01:15:52.612256 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:15:52.612235 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3\": container with ID starting with 49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3 not found: ID does not exist" containerID="49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3" Jul 14 01:15:52.612303 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.612271 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3"} err="failed to get container status \"49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3\": rpc error: code = NotFound desc = could not find container \"49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3\": container with ID starting with 49bab57544fd7865f0733ec949212dc12eaecc1195832fce67067904b4c0a5f3 not found: ID does not exist" Jul 14 01:15:52.612303 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.612293 2575 scope.go:117] "RemoveContainer" containerID="93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b" Jul 14 01:15:52.612492 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:15:52.612476 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b\": container with ID starting with 93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b not found: ID does not exist" containerID="93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b" Jul 14 01:15:52.612533 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.612496 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b"} err="failed to get container status \"93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b\": rpc error: code = NotFound desc = could not find container \"93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b\": container with ID starting with 93de63f4cf07daa083295275058e7635f5fdf7932a872d6bd081bccb4ec5fb6b not found: ID does not exist" Jul 14 01:15:52.615555 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.615533 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm"] Jul 14 01:15:52.619454 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.619434 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-6969890f-gw-openshift-default-65d845c747-b85wm"] Jul 14 01:15:52.977052 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:15:52.977021 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" path="/var/lib/kubelet/pods/71d1a822-6ed9-4cf7-b415-b178c0d292ce/volumes" Jul 14 01:17:21.244429 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.244394 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5"] Jul 14 01:17:21.244949 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.244768 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" Jul 14 01:17:21.244949 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.244782 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" Jul 14 01:17:21.244949 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.244852 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" Jul 14 01:17:21.244949 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.244863 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" Jul 14 01:17:21.247878 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.247856 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.250370 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.250347 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b3a22390-openshift-default-dockercfg-tql9d\"" Jul 14 01:17:21.259742 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.259718 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5"] Jul 14 01:17:21.268893 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.268871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-podinfo\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.268999 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.268908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-token\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.268999 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.268945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516593a8-6cf7-488a-a5da-a2a455716fb2-istiod-ca-cert\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.269130 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.269013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-envoy\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.269130 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.269058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf9zb\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-kube-api-access-hf9zb\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.269210 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.269133 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-certs\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.269210 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.269167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-socket\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.269210 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.269200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-credential-socket\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.269324 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.269215 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-data\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370255 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516593a8-6cf7-488a-a5da-a2a455716fb2-istiod-ca-cert\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370456 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-envoy\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370456 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf9zb\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-kube-api-access-hf9zb\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370456 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-certs\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370456 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-socket\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370456 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-credential-socket\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370723 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370478 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-data\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370723 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-podinfo\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370723 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370539 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-token\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370889 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370782 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-socket\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370889 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-certs\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.370998 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.370918 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-data\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.371057 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.371040 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516593a8-6cf7-488a-a5da-a2a455716fb2-istiod-ca-cert\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.371147 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.371059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-credential-socket\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.372542 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.372522 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-envoy\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.372920 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.372903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-podinfo\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.378813 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.378790 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-token\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.379060 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.379041 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf9zb\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-kube-api-access-hf9zb\") pod \"e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.559914 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.559841 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:21.697169 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.696984 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5"] Jul 14 01:17:21.700177 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.700132 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:17:21.700299 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.700264 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:17:21.700371 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:21.700344 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:17:22.022844 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:22.022802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" event={"ID":"516593a8-6cf7-488a-a5da-a2a455716fb2","Type":"ContainerStarted","Data":"c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120"} Jul 14 01:17:22.023032 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:22.022865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" event={"ID":"516593a8-6cf7-488a-a5da-a2a455716fb2","Type":"ContainerStarted","Data":"c2907e796f3882a2eb4376f23e629b3f9e4b52ebddc1e540f035e4f3c4ab3270"} Jul 14 01:17:22.045543 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:22.045491 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" podStartSLOduration=1.045471679 podStartE2EDuration="1.045471679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:17:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:17:22.041713344 +0000 UTC m=+1995.531050787" watchObservedRunningTime="2026-07-14 01:17:22.045471679 +0000 UTC m=+1995.534809121" Jul 14 01:17:22.560725 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:22.560689 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:22.565952 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:22.565930 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:23.027709 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:23.027677 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:23.028625 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:23.028605 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:34.094417 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:34.094379 2575 generic.go:356] "Generic (PLEG): container finished" podID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerID="c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120" exitCode=0 Jul 14 01:17:34.094845 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:34.094449 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" event={"ID":"516593a8-6cf7-488a-a5da-a2a455716fb2","Type":"ContainerDied","Data":"c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120"} Jul 14 01:17:34.094845 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:34.094791 2575 scope.go:117] "RemoveContainer" containerID="c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120" Jul 14 01:17:34.095869 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:34.095831 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:17:34.095955 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:34.095919 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:17:34.096002 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:34.095960 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:17:35.103242 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:35.103212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" event={"ID":"516593a8-6cf7-488a-a5da-a2a455716fb2","Type":"ContainerStarted","Data":"5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619"} Jul 14 01:17:35.561079 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:35.561020 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:35.562174 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:35.562148 2575 patch_prober.go:28] interesting pod/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 14 01:17:35.562331 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:35.562202 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 14 01:17:36.560989 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:36.560946 2575 patch_prober.go:28] interesting pod/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 14 01:17:36.561423 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:36.561039 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 14 01:17:37.560423 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:37.560381 2575 patch_prober.go:28] interesting pod/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 14 01:17:37.560594 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:37.560452 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 14 01:17:38.027837 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:38.027798 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:38.560791 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:38.560751 2575 patch_prober.go:28] interesting pod/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 14 01:17:38.560977 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:38.560810 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 14 01:17:39.563837 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:39.563807 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:17:39.564852 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:17:39.564832 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:18:42.155470 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:42.155358 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5"] Jul 14 01:18:42.155929 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:42.155577 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" containerID="cri-o://5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619" gracePeriod=30 Jul 14 01:18:47.424707 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.424642 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:18:47.454576 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.454535 2575 generic.go:356] "Generic (PLEG): container finished" podID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerID="5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619" exitCode=0 Jul 14 01:18:47.454730 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.454584 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" Jul 14 01:18:47.454730 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.454597 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" event={"ID":"516593a8-6cf7-488a-a5da-a2a455716fb2","Type":"ContainerDied","Data":"5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619"} Jul 14 01:18:47.454730 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.454653 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5" event={"ID":"516593a8-6cf7-488a-a5da-a2a455716fb2","Type":"ContainerDied","Data":"c2907e796f3882a2eb4376f23e629b3f9e4b52ebddc1e540f035e4f3c4ab3270"} Jul 14 01:18:47.454730 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.454685 2575 scope.go:117] "RemoveContainer" containerID="5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619" Jul 14 01:18:47.464146 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.463976 2575 scope.go:117] "RemoveContainer" containerID="c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120" Jul 14 01:18:47.473522 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.473499 2575 scope.go:117] "RemoveContainer" containerID="5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619" Jul 14 01:18:47.473855 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:18:47.473833 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619\": container with ID starting with 5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619 not found: ID does not exist" containerID="5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619" Jul 14 01:18:47.473941 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.473869 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619"} err="failed to get container status \"5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619\": rpc error: code = NotFound desc = could not find container \"5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619\": container with ID starting with 5e7199fefa5d1a83822165fac2eaf3ead56e094e49da6d69a66e07eb65c85619 not found: ID does not exist" Jul 14 01:18:47.473941 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.473896 2575 scope.go:117] "RemoveContainer" containerID="c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120" Jul 14 01:18:47.474146 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:18:47.474129 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120\": container with ID starting with c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120 not found: ID does not exist" containerID="c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120" Jul 14 01:18:47.474308 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.474153 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120"} err="failed to get container status \"c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120\": rpc error: code = NotFound desc = could not find container \"c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120\": container with ID starting with c5ea7c260257d628bae12f10da334040e2c4784fc5a29d073309835d1847c120 not found: ID does not exist" Jul 14 01:18:47.547698 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547655 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-certs\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.547698 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547701 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-socket\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.547954 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547733 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-podinfo\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.547954 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547793 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-data\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.547954 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547826 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-credential-socket\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.547954 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547859 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-token\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.547954 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547883 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-envoy\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.547954 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547919 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516593a8-6cf7-488a-a5da-a2a455716fb2-istiod-ca-cert\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.548297 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547988 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf9zb\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-kube-api-access-hf9zb\") pod \"516593a8-6cf7-488a-a5da-a2a455716fb2\" (UID: \"516593a8-6cf7-488a-a5da-a2a455716fb2\") " Jul 14 01:18:47.548297 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.547993 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:18:47.548297 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.548132 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:18:47.548297 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.548237 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:18:47.548467 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.548375 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.548467 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.548393 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.548467 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.548408 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.548467 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.548413 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/516593a8-6cf7-488a-a5da-a2a455716fb2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:18:47.549135 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.549100 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-data" (OuterVolumeSpecName: "istio-data") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:18:47.550157 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.550127 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 01:18:47.550346 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.550325 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-token" (OuterVolumeSpecName: "istio-token") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:18:47.550411 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.550386 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-kube-api-access-hf9zb" (OuterVolumeSpecName: "kube-api-access-hf9zb") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "kube-api-access-hf9zb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:18:47.550494 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.550471 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "516593a8-6cf7-488a-a5da-a2a455716fb2" (UID: "516593a8-6cf7-488a-a5da-a2a455716fb2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:18:47.649290 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.649253 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.649290 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.649284 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.649290 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.649292 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.649290 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.649300 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516593a8-6cf7-488a-a5da-a2a455716fb2-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.649560 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.649307 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516593a8-6cf7-488a-a5da-a2a455716fb2-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.649560 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.649315 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf9zb\" (UniqueName: \"kubernetes.io/projected/516593a8-6cf7-488a-a5da-a2a455716fb2-kube-api-access-hf9zb\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:18:47.777753 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.777722 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5"] Jul 14 01:18:47.784795 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:47.784766 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b3a22390-openshift-default-7fbc69b679-dqhv5"] Jul 14 01:18:48.975290 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:18:48.975257 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" path="/var/lib/kubelet/pods/516593a8-6cf7-488a-a5da-a2a455716fb2/volumes" Jul 14 01:19:07.029021 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:19:07.028995 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:19:07.035583 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:19:07.035555 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:19:07.037301 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:19:07.037280 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:19:07.043380 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:19:07.043360 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:24:07.059681 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:07.059647 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:24:07.066660 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:07.066628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:24:07.068964 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:07.068946 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:24:07.075216 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:07.075200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:24:32.902320 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.902226 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td"] Jul 14 01:24:32.902816 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.902795 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" Jul 14 01:24:32.902861 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.902820 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" Jul 14 01:24:32.902861 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.902845 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" Jul 14 01:24:32.902861 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.902855 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d1a822-6ed9-4cf7-b415-b178c0d292ce" containerName="istio-proxy" Jul 14 01:24:32.902957 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.902869 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" Jul 14 01:24:32.902957 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.902878 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" Jul 14 01:24:32.903019 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.902968 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" Jul 14 01:24:32.906877 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.906855 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:32.909826 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.909803 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cc490a-openshift-default-dockercfg-d6d4t\"" Jul 14 01:24:32.927115 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:32.927089 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td"] Jul 14 01:24:33.025910 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.025875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-envoy\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.025910 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.025914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-token\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.026189 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.025936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txx2\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-kube-api-access-8txx2\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.026189 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.026034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-data\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.026189 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.026102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-credential-socket\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.026189 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.026167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-certs\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.026319 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.026192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istiod-ca-cert\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.026319 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.026277 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-socket\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.026386 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.026321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-podinfo\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127574 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-certs\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127574 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istiod-ca-cert\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127801 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-socket\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127801 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-podinfo\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127801 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-envoy\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127801 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-token\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127801 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txx2\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-kube-api-access-8txx2\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127801 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127733 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-data\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.127801 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-credential-socket\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.128171 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.127983 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-certs\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.128171 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.128015 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-socket\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.128171 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.128158 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-credential-socket\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.128286 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.128224 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-data\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.128695 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.128672 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istiod-ca-cert\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.130002 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.129982 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-envoy\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.130142 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.130128 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-podinfo\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.135305 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.135279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txx2\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-kube-api-access-8txx2\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.135415 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.135364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-token\") pod \"e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.218316 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.218280 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:33.354888 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.354864 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td"] Jul 14 01:24:33.357013 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:24:33.356985 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e9d56c_ac83_4beb_aec9_3f45e38f8e00.slice/crio-7e35dbbcc79c761ab2a7e066c589a6b58dda22c956225e60832e4269e25ed077 WatchSource:0}: Error finding container 7e35dbbcc79c761ab2a7e066c589a6b58dda22c956225e60832e4269e25ed077: Status 404 returned error can't find the container with id 7e35dbbcc79c761ab2a7e066c589a6b58dda22c956225e60832e4269e25ed077 Jul 14 01:24:33.359078 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.359038 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:24:33.359194 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.359113 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:24:33.359194 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:33.359149 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:24:34.165649 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:34.165616 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" event={"ID":"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00","Type":"ContainerStarted","Data":"a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d"} Jul 14 01:24:34.166042 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:34.165666 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" event={"ID":"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00","Type":"ContainerStarted","Data":"7e35dbbcc79c761ab2a7e066c589a6b58dda22c956225e60832e4269e25ed077"} Jul 14 01:24:34.184930 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:34.184878 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" podStartSLOduration=2.184861233 podStartE2EDuration="2.184861233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:24:34.182881479 +0000 UTC m=+2427.672218919" watchObservedRunningTime="2026-07-14 01:24:34.184861233 +0000 UTC m=+2427.674198675" Jul 14 01:24:34.219342 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:34.219302 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:34.224007 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:34.223981 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:35.170804 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:35.170767 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:35.171806 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:35.171786 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:51.213251 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:51.213204 2575 patch_prober.go:28] interesting pod/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 01:24:51.213698 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:51.213276 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 01:24:52.259898 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:52.259867 2575 generic.go:356] "Generic (PLEG): container finished" podID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerID="a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d" exitCode=0 Jul 14 01:24:52.260366 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:52.259940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" event={"ID":"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00","Type":"ContainerDied","Data":"a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d"} Jul 14 01:24:52.260366 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:52.260350 2575 scope.go:117] "RemoveContainer" containerID="a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d" Jul 14 01:24:52.261337 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:52.261308 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:24:52.261403 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:52.261375 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:24:52.261449 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:52.261406 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 14 01:24:53.267047 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:53.267012 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" event={"ID":"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00","Type":"ContainerStarted","Data":"77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1"} Jul 14 01:24:54.218569 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:54.218530 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:54.218798 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:54.218775 2575 patch_prober.go:28] interesting pod/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 14 01:24:54.218888 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:54.218834 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 14 01:24:55.219334 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:55.219300 2575 patch_prober.go:28] interesting pod/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 14 01:24:55.219752 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:55.219360 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 14 01:24:56.219533 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:56.219494 2575 patch_prober.go:28] interesting pod/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 14 01:24:56.219940 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:56.219556 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 14 01:24:57.218869 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:57.218826 2575 patch_prober.go:28] interesting pod/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 14 01:24:57.219052 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:57.218884 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 14 01:24:58.222902 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:58.222869 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:58.223305 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:58.223104 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:24:58.223868 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:24:58.223852 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:25:34.809015 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.808978 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl"] Jul 14 01:25:34.809608 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.809429 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="516593a8-6cf7-488a-a5da-a2a455716fb2" containerName="istio-proxy" Jul 14 01:25:34.812696 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.812679 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:34.815285 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.815265 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cc490a\"/\"default-dockercfg-sl4cj\"" Jul 14 01:25:34.816684 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.816664 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cc490a\"/\"openshift-service-ca.crt\"" Jul 14 01:25:34.816772 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.816669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cc490a\"/\"test-model-cc490a-kserve-self-signed-certs\"" Jul 14 01:25:34.816772 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.816735 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cc490a\"/\"kube-root-ca.crt\"" Jul 14 01:25:34.820803 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.820783 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl"] Jul 14 01:25:34.902920 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.902884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-dshm\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:34.903061 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.902994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-home\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:34.903061 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.903020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-model-cache\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:34.903061 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.903039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rst6w\" (UniqueName: \"kubernetes.io/projected/44dc39b8-063e-4954-9a14-3e9d2cec3e41-kube-api-access-rst6w\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:34.903220 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.903125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tls-certs\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:34.903220 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:34.903147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tmp-dir\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.003861 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.003831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tls-certs\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.004038 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.003868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tmp-dir\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.004038 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.003892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-dshm\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.004038 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.003976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-home\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.004038 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.003997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-model-cache\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.004038 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.004022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rst6w\" (UniqueName: \"kubernetes.io/projected/44dc39b8-063e-4954-9a14-3e9d2cec3e41-kube-api-access-rst6w\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.004372 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.004349 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tmp-dir\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.004431 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.004384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-home\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.004473 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.004433 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-model-cache\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.006297 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.006267 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-dshm\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.006442 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.006425 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tls-certs\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.011357 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.011337 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rst6w\" (UniqueName: \"kubernetes.io/projected/44dc39b8-063e-4954-9a14-3e9d2cec3e41-kube-api-access-rst6w\") pod \"test-model-cc490a-kserve-6c86b9b945-nlpbl\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.122449 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.122373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:35.253082 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.253013 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl"] Jul 14 01:25:35.255925 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:25:35.255896 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44dc39b8_063e_4954_9a14_3e9d2cec3e41.slice/crio-7051948a20d4f719c2e1488115629d8ccb776507189298858ca0892707bf384b WatchSource:0}: Error finding container 7051948a20d4f719c2e1488115629d8ccb776507189298858ca0892707bf384b: Status 404 returned error can't find the container with id 7051948a20d4f719c2e1488115629d8ccb776507189298858ca0892707bf384b Jul 14 01:25:35.471975 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.471943 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" event={"ID":"44dc39b8-063e-4954-9a14-3e9d2cec3e41","Type":"ContainerStarted","Data":"70739a7d7e33e0ac208d28d41e943fe48ee4bbc6ecb4353039f9e64e39b0dcbb"} Jul 14 01:25:35.472166 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.471986 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" event={"ID":"44dc39b8-063e-4954-9a14-3e9d2cec3e41","Type":"ContainerStarted","Data":"7051948a20d4f719c2e1488115629d8ccb776507189298858ca0892707bf384b"} Jul 14 01:25:35.487867 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:35.487823 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" podStartSLOduration=1.487809279 podStartE2EDuration="1.487809279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:25:35.486565467 +0000 UTC m=+2488.975902929" watchObservedRunningTime="2026-07-14 01:25:35.487809279 +0000 UTC m=+2488.977146721" Jul 14 01:25:45.123156 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:45.123122 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:45.123838 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:45.123175 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:45.135731 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:45.135713 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:45.528127 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:45.528100 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:25:55.407122 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.407089 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl"] Jul 14 01:25:55.533459 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.533420 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l"] Jul 14 01:25:55.537538 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.537521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" Jul 14 01:25:55.540013 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.539988 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kl2pl\"" Jul 14 01:25:55.541972 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.541949 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l"] Jul 14 01:25:55.579956 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.579927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2461f0cb-7a71-4e02-acc5-cb6c0cf9d526-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l\" (UID: \"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" Jul 14 01:25:55.681460 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.681371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2461f0cb-7a71-4e02-acc5-cb6c0cf9d526-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l\" (UID: \"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" Jul 14 01:25:55.681974 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.681954 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2461f0cb-7a71-4e02-acc5-cb6c0cf9d526-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l\" (UID: \"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" Jul 14 01:25:55.851133 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.851091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" Jul 14 01:25:55.979829 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:55.979805 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l"] Jul 14 01:25:55.982287 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:25:55.982262 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2461f0cb_7a71_4e02_acc5_cb6c0cf9d526.slice/crio-dc366cd9c32c46ab7382961a4d31612ce6ca85dde865639a7e882ee54703b51a WatchSource:0}: Error finding container dc366cd9c32c46ab7382961a4d31612ce6ca85dde865639a7e882ee54703b51a: Status 404 returned error can't find the container with id dc366cd9c32c46ab7382961a4d31612ce6ca85dde865639a7e882ee54703b51a Jul 14 01:25:56.581747 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:56.581699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" event={"ID":"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526","Type":"ContainerStarted","Data":"9aa603cb6ea613cbb5291017fe99db09f20d50394719cd80963538513e33dfdd"} Jul 14 01:25:56.582287 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:56.581763 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" event={"ID":"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526","Type":"ContainerStarted","Data":"dc366cd9c32c46ab7382961a4d31612ce6ca85dde865639a7e882ee54703b51a"} Jul 14 01:25:56.597034 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:56.596972 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" podStartSLOduration=1.596957437 podStartE2EDuration="1.596957437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:25:56.594642007 +0000 UTC m=+2510.083979495" watchObservedRunningTime="2026-07-14 01:25:56.596957437 +0000 UTC m=+2510.086294877" Jul 14 01:25:57.588353 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:57.588319 2575 generic.go:356] "Generic (PLEG): container finished" podID="2461f0cb-7a71-4e02-acc5-cb6c0cf9d526" containerID="9aa603cb6ea613cbb5291017fe99db09f20d50394719cd80963538513e33dfdd" exitCode=0 Jul 14 01:25:57.588763 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:57.588405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" event={"ID":"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526","Type":"ContainerDied","Data":"9aa603cb6ea613cbb5291017fe99db09f20d50394719cd80963538513e33dfdd"} Jul 14 01:25:58.719165 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:58.719141 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" Jul 14 01:25:58.809226 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:58.809183 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2461f0cb-7a71-4e02-acc5-cb6c0cf9d526-maas-api-service-ca\") pod \"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526\" (UID: \"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526\") " Jul 14 01:25:58.809530 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:58.809508 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2461f0cb-7a71-4e02-acc5-cb6c0cf9d526-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2461f0cb-7a71-4e02-acc5-cb6c0cf9d526" (UID: "2461f0cb-7a71-4e02-acc5-cb6c0cf9d526"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:25:58.909885 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:58.909826 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2461f0cb-7a71-4e02-acc5-cb6c0cf9d526-maas-api-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:25:59.599114 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:59.599059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" event={"ID":"2461f0cb-7a71-4e02-acc5-cb6c0cf9d526","Type":"ContainerDied","Data":"dc366cd9c32c46ab7382961a4d31612ce6ca85dde865639a7e882ee54703b51a"} Jul 14 01:25:59.599114 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:59.599108 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l" Jul 14 01:25:59.599317 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:25:59.599164 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc366cd9c32c46ab7382961a4d31612ce6ca85dde865639a7e882ee54703b51a" Jul 14 01:26:10.427912 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.427842 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" podUID="44dc39b8-063e-4954-9a14-3e9d2cec3e41" containerName="main" containerID="cri-o://70739a7d7e33e0ac208d28d41e943fe48ee4bbc6ecb4353039f9e64e39b0dcbb" gracePeriod=45 Jul 14 01:26:10.659421 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.659387 2575 generic.go:356] "Generic (PLEG): container finished" podID="44dc39b8-063e-4954-9a14-3e9d2cec3e41" containerID="70739a7d7e33e0ac208d28d41e943fe48ee4bbc6ecb4353039f9e64e39b0dcbb" exitCode=0 Jul 14 01:26:10.659588 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.659458 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" event={"ID":"44dc39b8-063e-4954-9a14-3e9d2cec3e41","Type":"ContainerDied","Data":"70739a7d7e33e0ac208d28d41e943fe48ee4bbc6ecb4353039f9e64e39b0dcbb"} Jul 14 01:26:10.686710 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.686655 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:26:10.820431 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820398 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tls-certs\") pod \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " Jul 14 01:26:10.820431 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820431 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tmp-dir\") pod \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " Jul 14 01:26:10.820674 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820479 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-dshm\") pod \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " Jul 14 01:26:10.820674 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820494 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-home\") pod \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " Jul 14 01:26:10.820674 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820551 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rst6w\" (UniqueName: \"kubernetes.io/projected/44dc39b8-063e-4954-9a14-3e9d2cec3e41-kube-api-access-rst6w\") pod \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " Jul 14 01:26:10.820674 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820574 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-model-cache\") pod \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\" (UID: \"44dc39b8-063e-4954-9a14-3e9d2cec3e41\") " Jul 14 01:26:10.820879 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820789 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-home" (OuterVolumeSpecName: "home") pod "44dc39b8-063e-4954-9a14-3e9d2cec3e41" (UID: "44dc39b8-063e-4954-9a14-3e9d2cec3e41"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:10.820879 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820802 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "44dc39b8-063e-4954-9a14-3e9d2cec3e41" (UID: "44dc39b8-063e-4954-9a14-3e9d2cec3e41"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:10.820959 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.820889 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-model-cache" (OuterVolumeSpecName: "model-cache") pod "44dc39b8-063e-4954-9a14-3e9d2cec3e41" (UID: "44dc39b8-063e-4954-9a14-3e9d2cec3e41"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:10.822747 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.822719 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-dshm" (OuterVolumeSpecName: "dshm") pod "44dc39b8-063e-4954-9a14-3e9d2cec3e41" (UID: "44dc39b8-063e-4954-9a14-3e9d2cec3e41"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:10.822747 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.822728 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "44dc39b8-063e-4954-9a14-3e9d2cec3e41" (UID: "44dc39b8-063e-4954-9a14-3e9d2cec3e41"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:26:10.822890 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.822836 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44dc39b8-063e-4954-9a14-3e9d2cec3e41-kube-api-access-rst6w" (OuterVolumeSpecName: "kube-api-access-rst6w") pod "44dc39b8-063e-4954-9a14-3e9d2cec3e41" (UID: "44dc39b8-063e-4954-9a14-3e9d2cec3e41"). InnerVolumeSpecName "kube-api-access-rst6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:26:10.921798 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.921774 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-dshm\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:10.921798 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.921794 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-home\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:10.921952 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.921803 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rst6w\" (UniqueName: \"kubernetes.io/projected/44dc39b8-063e-4954-9a14-3e9d2cec3e41-kube-api-access-rst6w\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:10.921952 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.921814 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-model-cache\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:10.921952 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.921823 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tls-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:10.921952 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:10.921831 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44dc39b8-063e-4954-9a14-3e9d2cec3e41-tmp-dir\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:11.666779 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:11.666754 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" Jul 14 01:26:11.667231 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:11.666753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl" event={"ID":"44dc39b8-063e-4954-9a14-3e9d2cec3e41","Type":"ContainerDied","Data":"7051948a20d4f719c2e1488115629d8ccb776507189298858ca0892707bf384b"} Jul 14 01:26:11.667231 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:11.666878 2575 scope.go:117] "RemoveContainer" containerID="70739a7d7e33e0ac208d28d41e943fe48ee4bbc6ecb4353039f9e64e39b0dcbb" Jul 14 01:26:11.682895 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:11.682872 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl"] Jul 14 01:26:11.690049 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:11.690027 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cc490a/test-model-cc490a-kserve-6c86b9b945-nlpbl"] Jul 14 01:26:12.975273 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:12.975240 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44dc39b8-063e-4954-9a14-3e9d2cec3e41" path="/var/lib/kubelet/pods/44dc39b8-063e-4954-9a14-3e9d2cec3e41/volumes" Jul 14 01:26:47.438757 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:47.438723 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td"] Jul 14 01:26:47.439232 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:47.438948 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" containerID="cri-o://77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1" gracePeriod=30 Jul 14 01:26:52.694583 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.694561 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:26:52.784712 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784634 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-credential-socket\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784712 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784668 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-socket\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784712 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784693 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-podinfo\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784982 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784745 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8txx2\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-kube-api-access-8txx2\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784982 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-token\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784982 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784788 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-envoy\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784982 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784818 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istiod-ca-cert\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784982 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784880 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-data\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784982 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784902 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-certs\") pod \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\" (UID: \"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00\") " Jul 14 01:26:52.784982 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784949 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:52.784982 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.784972 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:52.785410 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.785222 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-credential-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.785410 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.785240 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:52.785410 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.785251 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-socket\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.785410 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.785351 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:26:52.785825 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.785800 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:52.786917 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.786895 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-kube-api-access-8txx2" (OuterVolumeSpecName: "kube-api-access-8txx2") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "kube-api-access-8txx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:26:52.787087 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.787057 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:26:52.787171 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.787102 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 01:26:52.787171 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.787127 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" (UID: "e8e9d56c-ac83-4beb-aec9-3f45e38f8e00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:26:52.871382 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.871351 2575 generic.go:356] "Generic (PLEG): container finished" podID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerID="77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1" exitCode=0 Jul 14 01:26:52.871531 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.871417 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" Jul 14 01:26:52.871531 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.871432 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" event={"ID":"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00","Type":"ContainerDied","Data":"77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1"} Jul 14 01:26:52.871531 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.871506 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td" event={"ID":"e8e9d56c-ac83-4beb-aec9-3f45e38f8e00","Type":"ContainerDied","Data":"7e35dbbcc79c761ab2a7e066c589a6b58dda22c956225e60832e4269e25ed077"} Jul 14 01:26:52.871531 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.871527 2575 scope.go:117] "RemoveContainer" containerID="77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1" Jul 14 01:26:52.880892 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.880877 2575 scope.go:117] "RemoveContainer" containerID="a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d" Jul 14 01:26:52.885941 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.885917 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-podinfo\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.886026 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.885950 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8txx2\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-kube-api-access-8txx2\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.886026 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.885967 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-token\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.886026 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.885982 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-envoy\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.886026 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.885995 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istiod-ca-cert\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.886026 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.886008 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-istio-data\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.886026 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.886021 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00-workload-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:26:52.888901 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.888885 2575 scope.go:117] "RemoveContainer" containerID="77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1" Jul 14 01:26:52.889246 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:26:52.889229 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1\": container with ID starting with 77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1 not found: ID does not exist" containerID="77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1" Jul 14 01:26:52.889292 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.889255 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1"} err="failed to get container status \"77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1\": rpc error: code = NotFound desc = could not find container \"77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1\": container with ID starting with 77e7e8596cb8d48876a7b9cda6203f768a5aa0ea28cbee029dfdbaaf40849fd1 not found: ID does not exist" Jul 14 01:26:52.889292 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.889270 2575 scope.go:117] "RemoveContainer" containerID="a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d" Jul 14 01:26:52.889510 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:26:52.889486 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d\": container with ID starting with a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d not found: ID does not exist" containerID="a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d" Jul 14 01:26:52.889557 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.889522 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d"} err="failed to get container status \"a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d\": rpc error: code = NotFound desc = could not find container \"a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d\": container with ID starting with a351bf12ba1f75b6221c649eaddff6498189dc6b59dcaea45a0ec5eef9b3e25d not found: ID does not exist" Jul 14 01:26:52.893961 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.893940 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td"] Jul 14 01:26:52.897719 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.897694 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cc490a-openshift-default-fc66f6495-2l8td"] Jul 14 01:26:52.975999 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:26:52.975970 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" path="/var/lib/kubelet/pods/e8e9d56c-ac83-4beb-aec9-3f45e38f8e00/volumes" Jul 14 01:27:12.081880 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.081838 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6"] Jul 14 01:27:12.082423 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082404 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" Jul 14 01:27:12.082469 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082426 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" Jul 14 01:27:12.082469 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082445 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dc39b8-063e-4954-9a14-3e9d2cec3e41" containerName="main" Jul 14 01:27:12.082469 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082454 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dc39b8-063e-4954-9a14-3e9d2cec3e41" containerName="main" Jul 14 01:27:12.082469 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082465 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2461f0cb-7a71-4e02-acc5-cb6c0cf9d526" containerName="revoke-keys" Jul 14 01:27:12.082590 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082476 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2461f0cb-7a71-4e02-acc5-cb6c0cf9d526" containerName="revoke-keys" Jul 14 01:27:12.082590 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082493 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" Jul 14 01:27:12.082590 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082501 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" Jul 14 01:27:12.082590 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082585 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="44dc39b8-063e-4954-9a14-3e9d2cec3e41" containerName="main" Jul 14 01:27:12.082704 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082598 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" Jul 14 01:27:12.082704 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082610 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2461f0cb-7a71-4e02-acc5-cb6c0cf9d526" containerName="revoke-keys" Jul 14 01:27:12.082704 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.082619 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e9d56c-ac83-4beb-aec9-3f45e38f8e00" containerName="istio-proxy" Jul 14 01:27:12.087482 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.087464 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" Jul 14 01:27:12.090421 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.090399 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kl2pl\"" Jul 14 01:27:12.091257 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.091231 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6"] Jul 14 01:27:12.160355 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.160321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da08686-5602-499f-a625-2002ef261a2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6\" (UID: \"6da08686-5602-499f-a625-2002ef261a2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" Jul 14 01:27:12.261419 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.261379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da08686-5602-499f-a625-2002ef261a2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6\" (UID: \"6da08686-5602-499f-a625-2002ef261a2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" Jul 14 01:27:12.262010 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.261991 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da08686-5602-499f-a625-2002ef261a2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6\" (UID: \"6da08686-5602-499f-a625-2002ef261a2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" Jul 14 01:27:12.399638 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.399561 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" Jul 14 01:27:12.530196 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.530168 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6"] Jul 14 01:27:12.532729 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:27:12.532705 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da08686_5602_499f_a625_2002ef261a2f.slice/crio-d936f3be2506688126c71cbe5fcd35f24dc075e7a9cdf4582de94ee58f9d0917 WatchSource:0}: Error finding container d936f3be2506688126c71cbe5fcd35f24dc075e7a9cdf4582de94ee58f9d0917: Status 404 returned error can't find the container with id d936f3be2506688126c71cbe5fcd35f24dc075e7a9cdf4582de94ee58f9d0917 Jul 14 01:27:12.967763 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.967730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" event={"ID":"6da08686-5602-499f-a625-2002ef261a2f","Type":"ContainerStarted","Data":"6aa48727b70121727fbb805f4c4a4c354de40e7e59f657f9e8362590f1b140b7"} Jul 14 01:27:12.967937 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.967790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" event={"ID":"6da08686-5602-499f-a625-2002ef261a2f","Type":"ContainerStarted","Data":"d936f3be2506688126c71cbe5fcd35f24dc075e7a9cdf4582de94ee58f9d0917"} Jul 14 01:27:12.984761 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:12.984705 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" podStartSLOduration=0.984683283 podStartE2EDuration="984.683283ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:27:12.984030932 +0000 UTC m=+2586.473368396" watchObservedRunningTime="2026-07-14 01:27:12.984683283 +0000 UTC m=+2586.474020723" Jul 14 01:27:13.973814 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:13.973780 2575 generic.go:356] "Generic (PLEG): container finished" podID="6da08686-5602-499f-a625-2002ef261a2f" containerID="6aa48727b70121727fbb805f4c4a4c354de40e7e59f657f9e8362590f1b140b7" exitCode=0 Jul 14 01:27:13.974212 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:13.973861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" event={"ID":"6da08686-5602-499f-a625-2002ef261a2f","Type":"ContainerDied","Data":"6aa48727b70121727fbb805f4c4a4c354de40e7e59f657f9e8362590f1b140b7"} Jul 14 01:27:15.100000 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:15.099975 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" Jul 14 01:27:15.186279 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:15.186249 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da08686-5602-499f-a625-2002ef261a2f-maas-api-service-ca\") pod \"6da08686-5602-499f-a625-2002ef261a2f\" (UID: \"6da08686-5602-499f-a625-2002ef261a2f\") " Jul 14 01:27:15.186560 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:15.186539 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6da08686-5602-499f-a625-2002ef261a2f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6da08686-5602-499f-a625-2002ef261a2f" (UID: "6da08686-5602-499f-a625-2002ef261a2f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:27:15.287763 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:15.287685 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da08686-5602-499f-a625-2002ef261a2f-maas-api-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:27:15.984410 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:15.984384 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" Jul 14 01:27:15.984620 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:15.984386 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6" event={"ID":"6da08686-5602-499f-a625-2002ef261a2f","Type":"ContainerDied","Data":"d936f3be2506688126c71cbe5fcd35f24dc075e7a9cdf4582de94ee58f9d0917"} Jul 14 01:27:15.984620 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:27:15.984512 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d936f3be2506688126c71cbe5fcd35f24dc075e7a9cdf4582de94ee58f9d0917" Jul 14 01:29:07.090289 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:29:07.090261 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:29:07.096926 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:29:07.096901 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:29:07.101422 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:29:07.101404 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:29:07.108046 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:29:07.108029 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:30:00.131056 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.131011 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx"] Jul 14 01:30:00.133558 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.131430 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da08686-5602-499f-a625-2002ef261a2f" containerName="revoke-keys" Jul 14 01:30:00.133558 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.131443 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da08686-5602-499f-a625-2002ef261a2f" containerName="revoke-keys" Jul 14 01:30:00.133558 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.131514 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6da08686-5602-499f-a625-2002ef261a2f" containerName="revoke-keys" Jul 14 01:30:00.134382 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.134363 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx"] Jul 14 01:30:00.134504 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.134486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" Jul 14 01:30:00.136839 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.136819 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kl2pl\"" Jul 14 01:30:00.137620 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.137603 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9"] Jul 14 01:30:00.137737 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.137722 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" Jul 14 01:30:00.141513 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.141488 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" Jul 14 01:30:00.143215 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.143187 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9"] Jul 14 01:30:00.145431 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.145404 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx"] Jul 14 01:30:00.147673 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.147654 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" Jul 14 01:30:00.148028 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.148003 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx"] Jul 14 01:30:00.156759 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.156740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" Jul 14 01:30:00.163586 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.163567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" Jul 14 01:30:00.318187 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.318157 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx"] Jul 14 01:30:00.320082 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:30:00.320039 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c5a0fa_c6c0_4fef_bdfb_61289d54f688.slice/crio-4913d1ab78cf0224a3706dfcc5f2f8da5a53d625bccada4990e3821c6fb5b0b5 WatchSource:0}: Error finding container 4913d1ab78cf0224a3706dfcc5f2f8da5a53d625bccada4990e3821c6fb5b0b5: Status 404 returned error can't find the container with id 4913d1ab78cf0224a3706dfcc5f2f8da5a53d625bccada4990e3821c6fb5b0b5 Jul 14 01:30:00.556752 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.556721 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx"] Jul 14 01:30:00.558642 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.558618 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9"] Jul 14 01:30:00.559019 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:30:00.558997 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffc2541_26e8_428e_8c24_e7666ce60c44.slice/crio-74d5c17312db98585e9b0f5c51609482c57dbd6be02c006e0757e2ca84c43624 WatchSource:0}: Error finding container 74d5c17312db98585e9b0f5c51609482c57dbd6be02c006e0757e2ca84c43624: Status 404 returned error can't find the container with id 74d5c17312db98585e9b0f5c51609482c57dbd6be02c006e0757e2ca84c43624 Jul 14 01:30:00.559440 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:30:00.559423 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba2694d_dccb_4482_9aed_917672770256.slice/crio-be0f9248ce57855b09dbed152ecc7fe67d3c45a6558c990e50c91cf5d84c9a5c WatchSource:0}: Error finding container be0f9248ce57855b09dbed152ecc7fe67d3c45a6558c990e50c91cf5d84c9a5c: Status 404 returned error can't find the container with id be0f9248ce57855b09dbed152ecc7fe67d3c45a6558c990e50c91cf5d84c9a5c Jul 14 01:30:00.798333 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.798258 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" event={"ID":"aba2694d-dccb-4482-9aed-917672770256","Type":"ContainerStarted","Data":"1db572eb86ed4edae0f004c680ef1839859bb9e531ee884839f8fabc704c2cb7"} Jul 14 01:30:00.798447 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.798354 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" event={"ID":"aba2694d-dccb-4482-9aed-917672770256","Type":"ContainerStarted","Data":"be0f9248ce57855b09dbed152ecc7fe67d3c45a6558c990e50c91cf5d84c9a5c"} Jul 14 01:30:00.799805 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.799774 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" event={"ID":"4ffc2541-26e8-428e-8c24-e7666ce60c44","Type":"ContainerStarted","Data":"fa73c65207be3502913492667a19b8e76aa1ab13665cbaf92197abbac518df84"} Jul 14 01:30:00.799911 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.799836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" event={"ID":"4ffc2541-26e8-428e-8c24-e7666ce60c44","Type":"ContainerStarted","Data":"74d5c17312db98585e9b0f5c51609482c57dbd6be02c006e0757e2ca84c43624"} Jul 14 01:30:00.801221 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.801199 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" event={"ID":"38c5a0fa-c6c0-4fef-bdfb-61289d54f688","Type":"ContainerStarted","Data":"c4c80b00b11fb452bda105e0f3f158833cca1e6aef6bb05ab4b63864fd299589"} Jul 14 01:30:00.801306 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.801238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" event={"ID":"38c5a0fa-c6c0-4fef-bdfb-61289d54f688","Type":"ContainerStarted","Data":"4913d1ab78cf0224a3706dfcc5f2f8da5a53d625bccada4990e3821c6fb5b0b5"} Jul 14 01:30:00.815129 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.815086 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" podStartSLOduration=0.815055382 podStartE2EDuration="815.055382ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:30:00.813974542 +0000 UTC m=+2754.303312009" watchObservedRunningTime="2026-07-14 01:30:00.815055382 +0000 UTC m=+2754.304392822" Jul 14 01:30:00.829939 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.829900 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" podStartSLOduration=0.829886703 podStartE2EDuration="829.886703ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:30:00.828243926 +0000 UTC m=+2754.317581367" watchObservedRunningTime="2026-07-14 01:30:00.829886703 +0000 UTC m=+2754.319224144" Jul 14 01:30:00.843614 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:00.843577 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" podStartSLOduration=0.843565564 podStartE2EDuration="843.565564ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:30:00.841707676 +0000 UTC m=+2754.331045144" watchObservedRunningTime="2026-07-14 01:30:00.843565564 +0000 UTC m=+2754.332903025" Jul 14 01:30:01.807837 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:01.807746 2575 generic.go:356] "Generic (PLEG): container finished" podID="aba2694d-dccb-4482-9aed-917672770256" containerID="1db572eb86ed4edae0f004c680ef1839859bb9e531ee884839f8fabc704c2cb7" exitCode=0 Jul 14 01:30:01.808232 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:01.807828 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" event={"ID":"aba2694d-dccb-4482-9aed-917672770256","Type":"ContainerDied","Data":"1db572eb86ed4edae0f004c680ef1839859bb9e531ee884839f8fabc704c2cb7"} Jul 14 01:30:01.809405 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:01.809382 2575 generic.go:356] "Generic (PLEG): container finished" podID="4ffc2541-26e8-428e-8c24-e7666ce60c44" containerID="fa73c65207be3502913492667a19b8e76aa1ab13665cbaf92197abbac518df84" exitCode=0 Jul 14 01:30:01.809537 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:01.809460 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" event={"ID":"4ffc2541-26e8-428e-8c24-e7666ce60c44","Type":"ContainerDied","Data":"fa73c65207be3502913492667a19b8e76aa1ab13665cbaf92197abbac518df84"} Jul 14 01:30:01.810951 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:01.810926 2575 generic.go:356] "Generic (PLEG): container finished" podID="38c5a0fa-c6c0-4fef-bdfb-61289d54f688" containerID="c4c80b00b11fb452bda105e0f3f158833cca1e6aef6bb05ab4b63864fd299589" exitCode=0 Jul 14 01:30:01.811056 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:01.810984 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" event={"ID":"38c5a0fa-c6c0-4fef-bdfb-61289d54f688","Type":"ContainerDied","Data":"c4c80b00b11fb452bda105e0f3f158833cca1e6aef6bb05ab4b63864fd299589"} Jul 14 01:30:02.974089 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:02.974045 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" Jul 14 01:30:02.977386 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:02.977355 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" Jul 14 01:30:03.008457 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.008434 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" Jul 14 01:30:03.822482 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.822447 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" Jul 14 01:30:03.822663 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.822481 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733210-dp5t9" event={"ID":"4ffc2541-26e8-428e-8c24-e7666ce60c44","Type":"ContainerDied","Data":"74d5c17312db98585e9b0f5c51609482c57dbd6be02c006e0757e2ca84c43624"} Jul 14 01:30:03.822663 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.822532 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74d5c17312db98585e9b0f5c51609482c57dbd6be02c006e0757e2ca84c43624" Jul 14 01:30:03.823706 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.823686 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" Jul 14 01:30:03.823816 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.823720 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx" event={"ID":"38c5a0fa-c6c0-4fef-bdfb-61289d54f688","Type":"ContainerDied","Data":"4913d1ab78cf0224a3706dfcc5f2f8da5a53d625bccada4990e3821c6fb5b0b5"} Jul 14 01:30:03.823816 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.823761 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4913d1ab78cf0224a3706dfcc5f2f8da5a53d625bccada4990e3821c6fb5b0b5" Jul 14 01:30:03.824896 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.824872 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" event={"ID":"aba2694d-dccb-4482-9aed-917672770256","Type":"ContainerDied","Data":"be0f9248ce57855b09dbed152ecc7fe67d3c45a6558c990e50c91cf5d84c9a5c"} Jul 14 01:30:03.824896 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.824895 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx" Jul 14 01:30:03.825030 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:30:03.824917 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be0f9248ce57855b09dbed152ecc7fe67d3c45a6558c990e50c91cf5d84c9a5c" Jul 14 01:31:13.525365 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525332 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf"] Jul 14 01:31:13.525905 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525803 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c5a0fa-c6c0-4fef-bdfb-61289d54f688" containerName="cleanup" Jul 14 01:31:13.525905 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525818 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c5a0fa-c6c0-4fef-bdfb-61289d54f688" containerName="cleanup" Jul 14 01:31:13.525905 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525830 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ffc2541-26e8-428e-8c24-e7666ce60c44" containerName="cleanup" Jul 14 01:31:13.525905 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525836 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ffc2541-26e8-428e-8c24-e7666ce60c44" containerName="cleanup" Jul 14 01:31:13.525905 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525856 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba2694d-dccb-4482-9aed-917672770256" containerName="cleanup" Jul 14 01:31:13.525905 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525865 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba2694d-dccb-4482-9aed-917672770256" containerName="cleanup" Jul 14 01:31:13.526251 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525956 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ffc2541-26e8-428e-8c24-e7666ce60c44" containerName="cleanup" Jul 14 01:31:13.526251 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525967 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="38c5a0fa-c6c0-4fef-bdfb-61289d54f688" containerName="cleanup" Jul 14 01:31:13.526251 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.525981 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba2694d-dccb-4482-9aed-917672770256" containerName="cleanup" Jul 14 01:31:13.528943 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.528927 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.531260 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.531237 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-99f60e\"/\"kube-root-ca.crt\"" Jul 14 01:31:13.532458 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.532441 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-99f60e\"/\"openshift-service-ca.crt\"" Jul 14 01:31:13.532562 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.532447 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-99f60e\"/\"sub-test-model-99f60e-kserve-self-signed-certs\"" Jul 14 01:31:13.532562 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.532457 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-99f60e\"/\"default-dockercfg-s64g7\"" Jul 14 01:31:13.536316 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.536157 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf"] Jul 14 01:31:13.588408 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.588375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-home\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.588408 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.588417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jl8v\" (UniqueName: \"kubernetes.io/projected/a295587b-6deb-4a03-ab9d-d3762c935bcc-kube-api-access-5jl8v\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.588650 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.588494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-tmp-dir\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.588650 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.588549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-dshm\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.588650 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.588595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-model-cache\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.588776 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.588673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a295587b-6deb-4a03-ab9d-d3762c935bcc-tls-certs\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690184 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a295587b-6deb-4a03-ab9d-d3762c935bcc-tls-certs\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690391 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690229 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-home\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690391 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690255 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jl8v\" (UniqueName: \"kubernetes.io/projected/a295587b-6deb-4a03-ab9d-d3762c935bcc-kube-api-access-5jl8v\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690509 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-tmp-dir\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690566 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-dshm\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690566 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-model-cache\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690702 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690672 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-home\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690842 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690817 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-tmp-dir\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.690986 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.690877 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-model-cache\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.692592 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.692564 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-dshm\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.692698 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.692664 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a295587b-6deb-4a03-ab9d-d3762c935bcc-tls-certs\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.697210 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.697188 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jl8v\" (UniqueName: \"kubernetes.io/projected/a295587b-6deb-4a03-ab9d-d3762c935bcc-kube-api-access-5jl8v\") pod \"sub-test-model-99f60e-kserve-799c95bd97-x7swf\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.839574 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.839484 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:13.975233 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:13.975208 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf"] Jul 14 01:31:13.977258 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:31:13.977231 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda295587b_6deb_4a03_ab9d_d3762c935bcc.slice/crio-4eeb813f7046ce042447f94f5ba8c41e4be3630c0f5fa3e28bdb21f3577b5d46 WatchSource:0}: Error finding container 4eeb813f7046ce042447f94f5ba8c41e4be3630c0f5fa3e28bdb21f3577b5d46: Status 404 returned error can't find the container with id 4eeb813f7046ce042447f94f5ba8c41e4be3630c0f5fa3e28bdb21f3577b5d46 Jul 14 01:31:14.188324 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:14.188292 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" event={"ID":"a295587b-6deb-4a03-ab9d-d3762c935bcc","Type":"ContainerStarted","Data":"54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a"} Jul 14 01:31:14.188492 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:14.188341 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" event={"ID":"a295587b-6deb-4a03-ab9d-d3762c935bcc","Type":"ContainerStarted","Data":"4eeb813f7046ce042447f94f5ba8c41e4be3630c0f5fa3e28bdb21f3577b5d46"} Jul 14 01:31:14.205536 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:14.205485 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" podStartSLOduration=1.2054673089999999 podStartE2EDuration="1.205467309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:31:14.202790114 +0000 UTC m=+2827.692127549" watchObservedRunningTime="2026-07-14 01:31:14.205467309 +0000 UTC m=+2827.694804769" Jul 14 01:31:23.840141 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:23.840097 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:23.840141 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:23.840150 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:23.852641 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:23.852607 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:31:24.252891 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:31:24.252857 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:32:17.010487 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:17.010454 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf"] Jul 14 01:32:32.030797 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.030741 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" podUID="a295587b-6deb-4a03-ab9d-d3762c935bcc" containerName="main" containerID="cri-o://54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a" gracePeriod=45 Jul 14 01:32:32.280647 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.280624 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:32:32.306365 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.306282 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-model-cache\") pod \"a295587b-6deb-4a03-ab9d-d3762c935bcc\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " Jul 14 01:32:32.306513 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.306407 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a295587b-6deb-4a03-ab9d-d3762c935bcc-tls-certs\") pod \"a295587b-6deb-4a03-ab9d-d3762c935bcc\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " Jul 14 01:32:32.306752 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.306728 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-model-cache" (OuterVolumeSpecName: "model-cache") pod "a295587b-6deb-4a03-ab9d-d3762c935bcc" (UID: "a295587b-6deb-4a03-ab9d-d3762c935bcc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:32:32.306827 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.306735 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jl8v\" (UniqueName: \"kubernetes.io/projected/a295587b-6deb-4a03-ab9d-d3762c935bcc-kube-api-access-5jl8v\") pod \"a295587b-6deb-4a03-ab9d-d3762c935bcc\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " Jul 14 01:32:32.306919 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.306900 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-dshm\") pod \"a295587b-6deb-4a03-ab9d-d3762c935bcc\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " Jul 14 01:32:32.306994 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.306981 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-home\") pod \"a295587b-6deb-4a03-ab9d-d3762c935bcc\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " Jul 14 01:32:32.307053 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.307020 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-tmp-dir\") pod \"a295587b-6deb-4a03-ab9d-d3762c935bcc\" (UID: \"a295587b-6deb-4a03-ab9d-d3762c935bcc\") " Jul 14 01:32:32.307334 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.307309 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-home" (OuterVolumeSpecName: "home") pod "a295587b-6deb-4a03-ab9d-d3762c935bcc" (UID: "a295587b-6deb-4a03-ab9d-d3762c935bcc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:32:32.307502 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.307475 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a295587b-6deb-4a03-ab9d-d3762c935bcc" (UID: "a295587b-6deb-4a03-ab9d-d3762c935bcc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:32:32.307585 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.307344 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-model-cache\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:32:32.309159 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.309135 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a295587b-6deb-4a03-ab9d-d3762c935bcc-kube-api-access-5jl8v" (OuterVolumeSpecName: "kube-api-access-5jl8v") pod "a295587b-6deb-4a03-ab9d-d3762c935bcc" (UID: "a295587b-6deb-4a03-ab9d-d3762c935bcc"). InnerVolumeSpecName "kube-api-access-5jl8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:32:32.309159 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.309152 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-dshm" (OuterVolumeSpecName: "dshm") pod "a295587b-6deb-4a03-ab9d-d3762c935bcc" (UID: "a295587b-6deb-4a03-ab9d-d3762c935bcc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:32:32.309298 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.309268 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a295587b-6deb-4a03-ab9d-d3762c935bcc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a295587b-6deb-4a03-ab9d-d3762c935bcc" (UID: "a295587b-6deb-4a03-ab9d-d3762c935bcc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:32:32.408288 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.408248 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-home\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:32:32.408288 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.408281 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-tmp-dir\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:32:32.408288 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.408290 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a295587b-6deb-4a03-ab9d-d3762c935bcc-tls-certs\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:32:32.408288 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.408301 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jl8v\" (UniqueName: \"kubernetes.io/projected/a295587b-6deb-4a03-ab9d-d3762c935bcc-kube-api-access-5jl8v\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:32:32.408552 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.408309 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a295587b-6deb-4a03-ab9d-d3762c935bcc-dshm\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:32:32.596321 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.596213 2575 generic.go:356] "Generic (PLEG): container finished" podID="a295587b-6deb-4a03-ab9d-d3762c935bcc" containerID="54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a" exitCode=0 Jul 14 01:32:32.596321 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.596270 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" Jul 14 01:32:32.596321 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.596298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" event={"ID":"a295587b-6deb-4a03-ab9d-d3762c935bcc","Type":"ContainerDied","Data":"54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a"} Jul 14 01:32:32.596554 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.596345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf" event={"ID":"a295587b-6deb-4a03-ab9d-d3762c935bcc","Type":"ContainerDied","Data":"4eeb813f7046ce042447f94f5ba8c41e4be3630c0f5fa3e28bdb21f3577b5d46"} Jul 14 01:32:32.596554 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.596362 2575 scope.go:117] "RemoveContainer" containerID="54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a" Jul 14 01:32:32.605297 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.605275 2575 scope.go:117] "RemoveContainer" containerID="54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a" Jul 14 01:32:32.605561 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:32:32.605544 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a\": container with ID starting with 54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a not found: ID does not exist" containerID="54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a" Jul 14 01:32:32.605612 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.605569 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a"} err="failed to get container status \"54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a\": rpc error: code = NotFound desc = could not find container \"54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a\": container with ID starting with 54735664166a85aa6a0659c25746c6f5fce919b5cb425cb1cdd9a26b416ef57a not found: ID does not exist" Jul 14 01:32:32.616797 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.616776 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf"] Jul 14 01:32:32.620335 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.620314 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-99f60e/sub-test-model-99f60e-kserve-799c95bd97-x7swf"] Jul 14 01:32:32.975843 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:32:32.975808 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a295587b-6deb-4a03-ab9d-d3762c935bcc" path="/var/lib/kubelet/pods/a295587b-6deb-4a03-ab9d-d3762c935bcc/volumes" Jul 14 01:33:59.403191 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.403099 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7710-140225656855856"] Jul 14 01:33:59.403780 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.403633 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a295587b-6deb-4a03-ab9d-d3762c935bcc" containerName="main" Jul 14 01:33:59.403780 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.403652 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a295587b-6deb-4a03-ab9d-d3762c935bcc" containerName="main" Jul 14 01:33:59.403911 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.403782 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a295587b-6deb-4a03-ab9d-d3762c935bcc" containerName="main" Jul 14 01:33:59.406862 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.406841 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656855856" Jul 14 01:33:59.409174 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.409156 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-jw4fv\"" Jul 14 01:33:59.412659 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.412638 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656855856"] Jul 14 01:33:59.552210 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.552176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk4z6\" (UniqueName: \"kubernetes.io/projected/984ff211-68ac-4517-bed8-5f4961f7a91e-kube-api-access-dk4z6\") pod \"test-curl-7710-140225656855856\" (UID: \"984ff211-68ac-4517-bed8-5f4961f7a91e\") " pod="openshift-ingress/test-curl-7710-140225656855856" Jul 14 01:33:59.652906 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.652879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk4z6\" (UniqueName: \"kubernetes.io/projected/984ff211-68ac-4517-bed8-5f4961f7a91e-kube-api-access-dk4z6\") pod \"test-curl-7710-140225656855856\" (UID: \"984ff211-68ac-4517-bed8-5f4961f7a91e\") " pod="openshift-ingress/test-curl-7710-140225656855856" Jul 14 01:33:59.660285 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.660224 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk4z6\" (UniqueName: \"kubernetes.io/projected/984ff211-68ac-4517-bed8-5f4961f7a91e-kube-api-access-dk4z6\") pod \"test-curl-7710-140225656855856\" (UID: \"984ff211-68ac-4517-bed8-5f4961f7a91e\") " pod="openshift-ingress/test-curl-7710-140225656855856" Jul 14 01:33:59.716971 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.716948 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656855856" Jul 14 01:33:59.845762 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.845732 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656855856"] Jul 14 01:33:59.848761 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:33:59.848736 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod984ff211_68ac_4517_bed8_5f4961f7a91e.slice/crio-669d8b46143ec6c0c2bfdfd05703924d20614e3053f6c3ffbc9b11ac7a052bf2 WatchSource:0}: Error finding container 669d8b46143ec6c0c2bfdfd05703924d20614e3053f6c3ffbc9b11ac7a052bf2: Status 404 returned error can't find the container with id 669d8b46143ec6c0c2bfdfd05703924d20614e3053f6c3ffbc9b11ac7a052bf2 Jul 14 01:33:59.850649 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:33:59.850626 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 01:34:00.034821 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:00.034789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656855856" event={"ID":"984ff211-68ac-4517-bed8-5f4961f7a91e","Type":"ContainerStarted","Data":"669d8b46143ec6c0c2bfdfd05703924d20614e3053f6c3ffbc9b11ac7a052bf2"} Jul 14 01:34:01.041226 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:01.041190 2575 generic.go:356] "Generic (PLEG): container finished" podID="984ff211-68ac-4517-bed8-5f4961f7a91e" containerID="a8c47fafe0ae7ac27a55297ba168a393080fe3e2d04c4da7f40b929f68a8245d" exitCode=0 Jul 14 01:34:01.041604 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:01.041232 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656855856" event={"ID":"984ff211-68ac-4517-bed8-5f4961f7a91e","Type":"ContainerDied","Data":"a8c47fafe0ae7ac27a55297ba168a393080fe3e2d04c4da7f40b929f68a8245d"} Jul 14 01:34:02.175604 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.175579 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656855856" Jul 14 01:34:02.207004 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.206970 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7710-140225656855856_984ff211-68ac-4517-bed8-5f4961f7a91e/test-curl-7710-140225656855856/0.log" Jul 14 01:34:02.231845 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.231812 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7710-140225656855856"] Jul 14 01:34:02.233849 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.233826 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7710-140225656855856"] Jul 14 01:34:02.277814 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.277765 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk4z6\" (UniqueName: \"kubernetes.io/projected/984ff211-68ac-4517-bed8-5f4961f7a91e-kube-api-access-dk4z6\") pod \"984ff211-68ac-4517-bed8-5f4961f7a91e\" (UID: \"984ff211-68ac-4517-bed8-5f4961f7a91e\") " Jul 14 01:34:02.279862 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.279835 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/984ff211-68ac-4517-bed8-5f4961f7a91e-kube-api-access-dk4z6" (OuterVolumeSpecName: "kube-api-access-dk4z6") pod "984ff211-68ac-4517-bed8-5f4961f7a91e" (UID: "984ff211-68ac-4517-bed8-5f4961f7a91e"). InnerVolumeSpecName "kube-api-access-dk4z6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:34:02.357272 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.357188 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7710-140225656759728"] Jul 14 01:34:02.357580 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.357568 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984ff211-68ac-4517-bed8-5f4961f7a91e" containerName="test-curl-7710-140225656855856" Jul 14 01:34:02.357624 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.357582 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="984ff211-68ac-4517-bed8-5f4961f7a91e" containerName="test-curl-7710-140225656855856" Jul 14 01:34:02.357656 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.357646 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="984ff211-68ac-4517-bed8-5f4961f7a91e" containerName="test-curl-7710-140225656855856" Jul 14 01:34:02.360733 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.360715 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:02.366368 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.366341 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656759728"] Jul 14 01:34:02.379289 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.379262 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk4z6\" (UniqueName: \"kubernetes.io/projected/984ff211-68ac-4517-bed8-5f4961f7a91e-kube-api-access-dk4z6\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:34:02.480571 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.480531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m75bg\" (UniqueName: \"kubernetes.io/projected/e3dcd92d-aac9-411b-9224-514d65ebed58-kube-api-access-m75bg\") pod \"test-curl-7710-140225656759728\" (UID: \"e3dcd92d-aac9-411b-9224-514d65ebed58\") " pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:02.581671 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.581631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m75bg\" (UniqueName: \"kubernetes.io/projected/e3dcd92d-aac9-411b-9224-514d65ebed58-kube-api-access-m75bg\") pod \"test-curl-7710-140225656759728\" (UID: \"e3dcd92d-aac9-411b-9224-514d65ebed58\") " pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:02.589399 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.589371 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m75bg\" (UniqueName: \"kubernetes.io/projected/e3dcd92d-aac9-411b-9224-514d65ebed58-kube-api-access-m75bg\") pod \"test-curl-7710-140225656759728\" (UID: \"e3dcd92d-aac9-411b-9224-514d65ebed58\") " pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:02.670610 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.670525 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:02.799525 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.799497 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656759728"] Jul 14 01:34:02.801390 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:34:02.801364 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3dcd92d_aac9_411b_9224_514d65ebed58.slice/crio-9bb66d8bc1109aef3d7bec20d42b84af9194b088f3620719a5a42dce8af761ad WatchSource:0}: Error finding container 9bb66d8bc1109aef3d7bec20d42b84af9194b088f3620719a5a42dce8af761ad: Status 404 returned error can't find the container with id 9bb66d8bc1109aef3d7bec20d42b84af9194b088f3620719a5a42dce8af761ad Jul 14 01:34:02.978753 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:02.978721 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="984ff211-68ac-4517-bed8-5f4961f7a91e" path="/var/lib/kubelet/pods/984ff211-68ac-4517-bed8-5f4961f7a91e/volumes" Jul 14 01:34:03.052613 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:03.052585 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656855856" Jul 14 01:34:03.052784 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:03.052631 2575 scope.go:117] "RemoveContainer" containerID="a8c47fafe0ae7ac27a55297ba168a393080fe3e2d04c4da7f40b929f68a8245d" Jul 14 01:34:03.053929 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:03.053829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656759728" event={"ID":"e3dcd92d-aac9-411b-9224-514d65ebed58","Type":"ContainerStarted","Data":"9bb66d8bc1109aef3d7bec20d42b84af9194b088f3620719a5a42dce8af761ad"} Jul 14 01:34:04.060977 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:04.060941 2575 generic.go:356] "Generic (PLEG): container finished" podID="e3dcd92d-aac9-411b-9224-514d65ebed58" containerID="4dcd9b517ae1c37e753f90547d0782bdd18931e25e8975a4800c129947118f02" exitCode=0 Jul 14 01:34:04.060977 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:04.060978 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656759728" event={"ID":"e3dcd92d-aac9-411b-9224-514d65ebed58","Type":"ContainerDied","Data":"4dcd9b517ae1c37e753f90547d0782bdd18931e25e8975a4800c129947118f02"} Jul 14 01:34:05.203758 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.203733 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:05.220704 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.220652 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7710-140225656759728_e3dcd92d-aac9-411b-9224-514d65ebed58/test-curl-7710-140225656759728/0.log" Jul 14 01:34:05.241977 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.241946 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7710-140225656759728"] Jul 14 01:34:05.247893 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.247867 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7710-140225656759728"] Jul 14 01:34:05.305576 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.305543 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m75bg\" (UniqueName: \"kubernetes.io/projected/e3dcd92d-aac9-411b-9224-514d65ebed58-kube-api-access-m75bg\") pod \"e3dcd92d-aac9-411b-9224-514d65ebed58\" (UID: \"e3dcd92d-aac9-411b-9224-514d65ebed58\") " Jul 14 01:34:05.307600 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.307575 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3dcd92d-aac9-411b-9224-514d65ebed58-kube-api-access-m75bg" (OuterVolumeSpecName: "kube-api-access-m75bg") pod "e3dcd92d-aac9-411b-9224-514d65ebed58" (UID: "e3dcd92d-aac9-411b-9224-514d65ebed58"). InnerVolumeSpecName "kube-api-access-m75bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:34:05.406477 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.406402 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m75bg\" (UniqueName: \"kubernetes.io/projected/e3dcd92d-aac9-411b-9224-514d65ebed58-kube-api-access-m75bg\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:34:05.413243 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.413209 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:05.413633 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.413615 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dcd92d-aac9-411b-9224-514d65ebed58" containerName="test-curl-7710-140225656759728" Jul 14 01:34:05.413725 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.413635 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dcd92d-aac9-411b-9224-514d65ebed58" containerName="test-curl-7710-140225656759728" Jul 14 01:34:05.413781 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.413749 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dcd92d-aac9-411b-9224-514d65ebed58" containerName="test-curl-7710-140225656759728" Jul 14 01:34:05.416778 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.416758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:05.422573 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.422540 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:05.507513 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.507483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tnxr\" (UniqueName: \"kubernetes.io/projected/fa0bd84c-2dea-4aea-b09e-9f1960f3bbee-kube-api-access-7tnxr\") pod \"test-curl-7710-140225656770608\" (UID: \"fa0bd84c-2dea-4aea-b09e-9f1960f3bbee\") " pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:05.608958 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.608908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tnxr\" (UniqueName: \"kubernetes.io/projected/fa0bd84c-2dea-4aea-b09e-9f1960f3bbee-kube-api-access-7tnxr\") pod \"test-curl-7710-140225656770608\" (UID: \"fa0bd84c-2dea-4aea-b09e-9f1960f3bbee\") " pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:05.617159 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.617127 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tnxr\" (UniqueName: \"kubernetes.io/projected/fa0bd84c-2dea-4aea-b09e-9f1960f3bbee-kube-api-access-7tnxr\") pod \"test-curl-7710-140225656770608\" (UID: \"fa0bd84c-2dea-4aea-b09e-9f1960f3bbee\") " pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:05.727235 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.727204 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:05.855628 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:05.855598 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:05.857415 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:34:05.857389 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa0bd84c_2dea_4aea_b09e_9f1960f3bbee.slice/crio-367aca8f0cf79aa66747f97e343c2a46c18556ccfa9e7e9fa89d5259260cbd82 WatchSource:0}: Error finding container 367aca8f0cf79aa66747f97e343c2a46c18556ccfa9e7e9fa89d5259260cbd82: Status 404 returned error can't find the container with id 367aca8f0cf79aa66747f97e343c2a46c18556ccfa9e7e9fa89d5259260cbd82 Jul 14 01:34:06.071825 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:06.071749 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:06.071974 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:06.071748 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bb66d8bc1109aef3d7bec20d42b84af9194b088f3620719a5a42dce8af761ad" Jul 14 01:34:06.073042 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:06.073019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656770608" event={"ID":"fa0bd84c-2dea-4aea-b09e-9f1960f3bbee","Type":"ContainerStarted","Data":"367aca8f0cf79aa66747f97e343c2a46c18556ccfa9e7e9fa89d5259260cbd82"} Jul 14 01:34:06.082019 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:34:06.081998 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7710-140225656759728\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="e3dcd92d-aac9-411b-9224-514d65ebed58" pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:06.975043 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:34:06.975002 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7710-140225656759728\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="e3dcd92d-aac9-411b-9224-514d65ebed58" pod="openshift-ingress/test-curl-7710-140225656759728" Jul 14 01:34:06.976036 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:06.976013 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3dcd92d-aac9-411b-9224-514d65ebed58" path="/var/lib/kubelet/pods/e3dcd92d-aac9-411b-9224-514d65ebed58/volumes" Jul 14 01:34:07.079515 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:07.079479 2575 generic.go:356] "Generic (PLEG): container finished" podID="fa0bd84c-2dea-4aea-b09e-9f1960f3bbee" containerID="0bfdd2655e81e375678f4074ae553dcf093a0b42ce4657a602e902755e4e590a" exitCode=0 Jul 14 01:34:07.079702 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:07.079568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656770608" event={"ID":"fa0bd84c-2dea-4aea-b09e-9f1960f3bbee","Type":"ContainerDied","Data":"0bfdd2655e81e375678f4074ae553dcf093a0b42ce4657a602e902755e4e590a"} Jul 14 01:34:07.129456 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:07.129429 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:34:07.135746 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:07.135721 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:34:07.136971 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:07.136942 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:34:07.145896 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:07.145878 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:34:08.219099 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.219056 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:08.238226 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.238198 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7710-140225656770608_fa0bd84c-2dea-4aea-b09e-9f1960f3bbee/test-curl-7710-140225656770608/0.log" Jul 14 01:34:08.261390 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.261348 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:08.263552 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.263529 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:08.334497 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.334459 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tnxr\" (UniqueName: \"kubernetes.io/projected/fa0bd84c-2dea-4aea-b09e-9f1960f3bbee-kube-api-access-7tnxr\") pod \"fa0bd84c-2dea-4aea-b09e-9f1960f3bbee\" (UID: \"fa0bd84c-2dea-4aea-b09e-9f1960f3bbee\") " Jul 14 01:34:08.336460 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.336411 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa0bd84c-2dea-4aea-b09e-9f1960f3bbee-kube-api-access-7tnxr" (OuterVolumeSpecName: "kube-api-access-7tnxr") pod "fa0bd84c-2dea-4aea-b09e-9f1960f3bbee" (UID: "fa0bd84c-2dea-4aea-b09e-9f1960f3bbee"). InnerVolumeSpecName "kube-api-access-7tnxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:34:08.406217 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.406190 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:08.406584 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.406570 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0bd84c-2dea-4aea-b09e-9f1960f3bbee" containerName="test-curl-7710-140225656770608" Jul 14 01:34:08.406645 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.406586 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0bd84c-2dea-4aea-b09e-9f1960f3bbee" containerName="test-curl-7710-140225656770608" Jul 14 01:34:08.406682 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.406669 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa0bd84c-2dea-4aea-b09e-9f1960f3bbee" containerName="test-curl-7710-140225656770608" Jul 14 01:34:08.409801 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.409786 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:08.416777 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.414349 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:08.435334 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.435312 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tnxr\" (UniqueName: \"kubernetes.io/projected/fa0bd84c-2dea-4aea-b09e-9f1960f3bbee-kube-api-access-7tnxr\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:34:08.536137 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.536109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvqjd\" (UniqueName: \"kubernetes.io/projected/c327d031-1b68-470e-83a0-4e8bfc3b8bc3-kube-api-access-dvqjd\") pod \"test-curl-7710-140225656770608\" (UID: \"c327d031-1b68-470e-83a0-4e8bfc3b8bc3\") " pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:08.637274 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.637197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvqjd\" (UniqueName: \"kubernetes.io/projected/c327d031-1b68-470e-83a0-4e8bfc3b8bc3-kube-api-access-dvqjd\") pod \"test-curl-7710-140225656770608\" (UID: \"c327d031-1b68-470e-83a0-4e8bfc3b8bc3\") " pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:08.645053 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.645025 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvqjd\" (UniqueName: \"kubernetes.io/projected/c327d031-1b68-470e-83a0-4e8bfc3b8bc3-kube-api-access-dvqjd\") pod \"test-curl-7710-140225656770608\" (UID: \"c327d031-1b68-470e-83a0-4e8bfc3b8bc3\") " pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:08.721483 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.721456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:08.848710 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.848686 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:08.850678 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:34:08.850650 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc327d031_1b68_470e_83a0_4e8bfc3b8bc3.slice/crio-fb1f5bb6d224c5731bd629564d72916fd319867f2182f3e6f84bf2d63177c835 WatchSource:0}: Error finding container fb1f5bb6d224c5731bd629564d72916fd319867f2182f3e6f84bf2d63177c835: Status 404 returned error can't find the container with id fb1f5bb6d224c5731bd629564d72916fd319867f2182f3e6f84bf2d63177c835 Jul 14 01:34:08.975967 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:08.975934 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa0bd84c-2dea-4aea-b09e-9f1960f3bbee" path="/var/lib/kubelet/pods/fa0bd84c-2dea-4aea-b09e-9f1960f3bbee/volumes" Jul 14 01:34:09.090247 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:09.090213 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:09.090488 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:09.090218 2575 scope.go:117] "RemoveContainer" containerID="0bfdd2655e81e375678f4074ae553dcf093a0b42ce4657a602e902755e4e590a" Jul 14 01:34:09.091605 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:09.091583 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656770608" event={"ID":"c327d031-1b68-470e-83a0-4e8bfc3b8bc3","Type":"ContainerStarted","Data":"fb1f5bb6d224c5731bd629564d72916fd319867f2182f3e6f84bf2d63177c835"} Jul 14 01:34:10.098498 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:10.098458 2575 generic.go:356] "Generic (PLEG): container finished" podID="c327d031-1b68-470e-83a0-4e8bfc3b8bc3" containerID="7a1ec0165dbf177d64387efca57ff367bd4f145bef0d8d6320d356d975505e43" exitCode=0 Jul 14 01:34:10.098498 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:10.098500 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656770608" event={"ID":"c327d031-1b68-470e-83a0-4e8bfc3b8bc3","Type":"ContainerDied","Data":"7a1ec0165dbf177d64387efca57ff367bd4f145bef0d8d6320d356d975505e43"} Jul 14 01:34:11.254501 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.254477 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:11.271765 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.271738 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7710-140225656770608_c327d031-1b68-470e-83a0-4e8bfc3b8bc3/test-curl-7710-140225656770608/0.log" Jul 14 01:34:11.293714 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.293682 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:11.302309 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.298024 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7710-140225656770608"] Jul 14 01:34:11.358604 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.358532 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvqjd\" (UniqueName: \"kubernetes.io/projected/c327d031-1b68-470e-83a0-4e8bfc3b8bc3-kube-api-access-dvqjd\") pod \"c327d031-1b68-470e-83a0-4e8bfc3b8bc3\" (UID: \"c327d031-1b68-470e-83a0-4e8bfc3b8bc3\") " Jul 14 01:34:11.360560 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.360535 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c327d031-1b68-470e-83a0-4e8bfc3b8bc3-kube-api-access-dvqjd" (OuterVolumeSpecName: "kube-api-access-dvqjd") pod "c327d031-1b68-470e-83a0-4e8bfc3b8bc3" (UID: "c327d031-1b68-470e-83a0-4e8bfc3b8bc3"). InnerVolumeSpecName "kube-api-access-dvqjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:34:11.418703 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.418672 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7710-140225656771616"] Jul 14 01:34:11.419088 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.419053 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c327d031-1b68-470e-83a0-4e8bfc3b8bc3" containerName="test-curl-7710-140225656770608" Jul 14 01:34:11.419088 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.419079 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c327d031-1b68-470e-83a0-4e8bfc3b8bc3" containerName="test-curl-7710-140225656770608" Jul 14 01:34:11.419160 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.419145 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c327d031-1b68-470e-83a0-4e8bfc3b8bc3" containerName="test-curl-7710-140225656770608" Jul 14 01:34:11.422180 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.422164 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656771616" Jul 14 01:34:11.429812 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.429793 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656771616"] Jul 14 01:34:11.459836 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.459813 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvqjd\" (UniqueName: \"kubernetes.io/projected/c327d031-1b68-470e-83a0-4e8bfc3b8bc3-kube-api-access-dvqjd\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:34:11.560227 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.560205 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5fm5\" (UniqueName: \"kubernetes.io/projected/a2a38554-bc6c-470b-aa8b-dba7d47abdd5-kube-api-access-f5fm5\") pod \"test-curl-7710-140225656771616\" (UID: \"a2a38554-bc6c-470b-aa8b-dba7d47abdd5\") " pod="openshift-ingress/test-curl-7710-140225656771616" Jul 14 01:34:11.661597 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.661504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5fm5\" (UniqueName: \"kubernetes.io/projected/a2a38554-bc6c-470b-aa8b-dba7d47abdd5-kube-api-access-f5fm5\") pod \"test-curl-7710-140225656771616\" (UID: \"a2a38554-bc6c-470b-aa8b-dba7d47abdd5\") " pod="openshift-ingress/test-curl-7710-140225656771616" Jul 14 01:34:11.669306 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.669276 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5fm5\" (UniqueName: \"kubernetes.io/projected/a2a38554-bc6c-470b-aa8b-dba7d47abdd5-kube-api-access-f5fm5\") pod \"test-curl-7710-140225656771616\" (UID: \"a2a38554-bc6c-470b-aa8b-dba7d47abdd5\") " pod="openshift-ingress/test-curl-7710-140225656771616" Jul 14 01:34:11.732167 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.732137 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656771616" Jul 14 01:34:11.862789 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:11.862759 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7710-140225656771616"] Jul 14 01:34:11.864479 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:34:11.864454 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2a38554_bc6c_470b_aa8b_dba7d47abdd5.slice/crio-90b4eaef22391706e3a68ea1414626eba02a2ed0ecaf45246cfef14ee29ec0d7 WatchSource:0}: Error finding container 90b4eaef22391706e3a68ea1414626eba02a2ed0ecaf45246cfef14ee29ec0d7: Status 404 returned error can't find the container with id 90b4eaef22391706e3a68ea1414626eba02a2ed0ecaf45246cfef14ee29ec0d7 Jul 14 01:34:12.108656 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:12.108621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656771616" event={"ID":"a2a38554-bc6c-470b-aa8b-dba7d47abdd5","Type":"ContainerStarted","Data":"90b4eaef22391706e3a68ea1414626eba02a2ed0ecaf45246cfef14ee29ec0d7"} Jul 14 01:34:12.109984 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:12.109961 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb1f5bb6d224c5731bd629564d72916fd319867f2182f3e6f84bf2d63177c835" Jul 14 01:34:12.109984 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:12.109970 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:12.120979 ip-10-0-131-60 kubenswrapper[2575]: E0714 01:34:12.120954 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7710-140225656770608\" is forbidden: User \"system:node:ip-10-0-131-60.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-131-60.ec2.internal' and this object" podUID="c327d031-1b68-470e-83a0-4e8bfc3b8bc3" pod="openshift-ingress/test-curl-7710-140225656770608" Jul 14 01:34:12.975055 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:12.975021 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c327d031-1b68-470e-83a0-4e8bfc3b8bc3" path="/var/lib/kubelet/pods/c327d031-1b68-470e-83a0-4e8bfc3b8bc3/volumes" Jul 14 01:34:13.116428 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:13.116392 2575 generic.go:356] "Generic (PLEG): container finished" podID="a2a38554-bc6c-470b-aa8b-dba7d47abdd5" containerID="aa18518856631db85dab520f7aa7a6047faefa7164a5352b8441859a46853eb8" exitCode=0 Jul 14 01:34:13.116592 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:13.116476 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7710-140225656771616" event={"ID":"a2a38554-bc6c-470b-aa8b-dba7d47abdd5","Type":"ContainerDied","Data":"aa18518856631db85dab520f7aa7a6047faefa7164a5352b8441859a46853eb8"} Jul 14 01:34:14.265594 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:14.265568 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656771616" Jul 14 01:34:14.282863 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:14.282836 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7710-140225656771616_a2a38554-bc6c-470b-aa8b-dba7d47abdd5/test-curl-7710-140225656771616/0.log" Jul 14 01:34:14.283005 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:14.282921 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5fm5\" (UniqueName: \"kubernetes.io/projected/a2a38554-bc6c-470b-aa8b-dba7d47abdd5-kube-api-access-f5fm5\") pod \"a2a38554-bc6c-470b-aa8b-dba7d47abdd5\" (UID: \"a2a38554-bc6c-470b-aa8b-dba7d47abdd5\") " Jul 14 01:34:14.285048 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:14.285025 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a38554-bc6c-470b-aa8b-dba7d47abdd5-kube-api-access-f5fm5" (OuterVolumeSpecName: "kube-api-access-f5fm5") pod "a2a38554-bc6c-470b-aa8b-dba7d47abdd5" (UID: "a2a38554-bc6c-470b-aa8b-dba7d47abdd5"). InnerVolumeSpecName "kube-api-access-f5fm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:34:14.306154 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:14.306127 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7710-140225656771616"] Jul 14 01:34:14.310129 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:14.310107 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7710-140225656771616"] Jul 14 01:34:14.383889 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:14.383819 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5fm5\" (UniqueName: \"kubernetes.io/projected/a2a38554-bc6c-470b-aa8b-dba7d47abdd5-kube-api-access-f5fm5\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:34:14.975606 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:14.975576 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a38554-bc6c-470b-aa8b-dba7d47abdd5" path="/var/lib/kubelet/pods/a2a38554-bc6c-470b-aa8b-dba7d47abdd5/volumes" Jul 14 01:34:15.127704 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:15.127673 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7710-140225656771616" Jul 14 01:34:15.127888 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:15.127717 2575 scope.go:117] "RemoveContainer" containerID="aa18518856631db85dab520f7aa7a6047faefa7164a5352b8441859a46853eb8" Jul 14 01:34:17.237028 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.236993 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2"] Jul 14 01:34:17.237447 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.237432 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a38554-bc6c-470b-aa8b-dba7d47abdd5" containerName="test-curl-7710-140225656771616" Jul 14 01:34:17.237447 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.237447 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a38554-bc6c-470b-aa8b-dba7d47abdd5" containerName="test-curl-7710-140225656771616" Jul 14 01:34:17.237540 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.237521 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a38554-bc6c-470b-aa8b-dba7d47abdd5" containerName="test-curl-7710-140225656771616" Jul 14 01:34:17.241991 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.241973 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" Jul 14 01:34:17.244606 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.244580 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kl2pl\"" Jul 14 01:34:17.246611 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.246587 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2"] Jul 14 01:34:17.310574 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.310544 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1722c8c9-0036-49e4-8358-a3fe45b23804-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2\" (UID: \"1722c8c9-0036-49e4-8358-a3fe45b23804\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" Jul 14 01:34:17.411853 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.411822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1722c8c9-0036-49e4-8358-a3fe45b23804-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2\" (UID: \"1722c8c9-0036-49e4-8358-a3fe45b23804\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" Jul 14 01:34:17.412489 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.412469 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1722c8c9-0036-49e4-8358-a3fe45b23804-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2\" (UID: \"1722c8c9-0036-49e4-8358-a3fe45b23804\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" Jul 14 01:34:17.554469 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.554376 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" Jul 14 01:34:17.692731 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:17.692700 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2"] Jul 14 01:34:17.694782 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:34:17.694757 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1722c8c9_0036_49e4_8358_a3fe45b23804.slice/crio-f26d9d8d0e8add744d960353c7ae75a12925c2bece2867d156654ce5626834f2 WatchSource:0}: Error finding container f26d9d8d0e8add744d960353c7ae75a12925c2bece2867d156654ce5626834f2: Status 404 returned error can't find the container with id f26d9d8d0e8add744d960353c7ae75a12925c2bece2867d156654ce5626834f2 Jul 14 01:34:18.145692 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:18.145657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" event={"ID":"1722c8c9-0036-49e4-8358-a3fe45b23804","Type":"ContainerStarted","Data":"f41887011524e9a76f64b68ffc6147441ae302101316c1fe99712b2efa4097df"} Jul 14 01:34:18.145859 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:18.145709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" event={"ID":"1722c8c9-0036-49e4-8358-a3fe45b23804","Type":"ContainerStarted","Data":"f26d9d8d0e8add744d960353c7ae75a12925c2bece2867d156654ce5626834f2"} Jul 14 01:34:19.151937 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:19.151906 2575 generic.go:356] "Generic (PLEG): container finished" podID="1722c8c9-0036-49e4-8358-a3fe45b23804" containerID="f41887011524e9a76f64b68ffc6147441ae302101316c1fe99712b2efa4097df" exitCode=0 Jul 14 01:34:19.152367 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:19.151975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" event={"ID":"1722c8c9-0036-49e4-8358-a3fe45b23804","Type":"ContainerDied","Data":"f41887011524e9a76f64b68ffc6147441ae302101316c1fe99712b2efa4097df"} Jul 14 01:34:20.293361 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:20.293330 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" Jul 14 01:34:20.339092 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:20.339041 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1722c8c9-0036-49e4-8358-a3fe45b23804-maas-api-service-ca\") pod \"1722c8c9-0036-49e4-8358-a3fe45b23804\" (UID: \"1722c8c9-0036-49e4-8358-a3fe45b23804\") " Jul 14 01:34:20.339387 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:20.339365 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1722c8c9-0036-49e4-8358-a3fe45b23804-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1722c8c9-0036-49e4-8358-a3fe45b23804" (UID: "1722c8c9-0036-49e4-8358-a3fe45b23804"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:34:20.440431 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:20.440408 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1722c8c9-0036-49e4-8358-a3fe45b23804-maas-api-service-ca\") on node \"ip-10-0-131-60.ec2.internal\" DevicePath \"\"" Jul 14 01:34:21.163082 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:21.163031 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" event={"ID":"1722c8c9-0036-49e4-8358-a3fe45b23804","Type":"ContainerDied","Data":"f26d9d8d0e8add744d960353c7ae75a12925c2bece2867d156654ce5626834f2"} Jul 14 01:34:21.163230 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:21.163098 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f26d9d8d0e8add744d960353c7ae75a12925c2bece2867d156654ce5626834f2" Jul 14 01:34:21.163230 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:21.163045 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2" Jul 14 01:34:27.656188 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:27.656148 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx"] Jul 14 01:34:27.658397 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:27.658371 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-99f60e-29733210-d6qqx"] Jul 14 01:34:28.982566 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:28.982533 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38c5a0fa-c6c0-4fef-bdfb-61289d54f688" path="/var/lib/kubelet/pods/38c5a0fa-c6c0-4fef-bdfb-61289d54f688/volumes" Jul 14 01:34:53.798023 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:53.797988 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx"] Jul 14 01:34:53.803114 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:53.803089 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8fd48b-29733210-zxqwx"] Jul 14 01:34:54.975290 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:34:54.975261 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba2694d-dccb-4482-9aed-917672770256" path="/var/lib/kubelet/pods/aba2694d-dccb-4482-9aed-917672770256/volumes" Jul 14 01:35:15.024009 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:15.023975 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fb5967cff-cvbh7_9abd3f67-5508-46fe-b188-32b5676f2b55/manager/0.log" Jul 14 01:35:15.521837 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:15.521803 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7d6985f7-d9s7f_2abf2233-e2e4-4127-be00-6ed70701797d/copy-manifests/0.log" Jul 14 01:35:15.527664 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:15.527638 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7d6985f7-d9s7f_2abf2233-e2e4-4127-be00-6ed70701797d/manager/0.log" Jul 14 01:35:16.062667 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:16.062620 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67f66699d9-r6hvq_040a8ca2-6c2c-42cd-80b3-be6496a54e2a/maas-api/0.log" Jul 14 01:35:16.182902 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:16.182873 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733180-grnz6_c746a2ab-d87b-4a29-b439-3b3f570bb168/cleanup/0.log" Jul 14 01:35:16.407491 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:16.407411 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733210-dp5t9_4ffc2541-26e8-428e-8c24-e7666ce60c44/cleanup/0.log" Jul 14 01:35:16.742871 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:16.742841 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-cb7605-9ngn6_6da08686-5602-499f-a625-2002ef261a2f/revoke-keys/0.log" Jul 14 01:35:17.111202 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:17.111116 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-da3fe6-v646l_2461f0cb-7a71-4e02-acc5-cb6c0cf9d526/revoke-keys/0.log" Jul 14 01:35:17.689499 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:17.689467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-99f60e-kp8l2_1722c8c9-0036-49e4-8358-a3fe45b23804/revoke-keys/0.log" Jul 14 01:35:17.913640 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:17.913613 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qqhnd_07921f12-805e-4420-bf47-9e8966eb7511/postgres/0.log" Jul 14 01:35:20.543262 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:20.543227 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-66dg2_aca9de1b-7d73-4bcd-b7c2-a73dcae92a10/discovery/0.log" Jul 14 01:35:21.004305 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:21.004263 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qgmwb_4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8/payload-pre-processing/0.log" Jul 14 01:35:21.252976 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:21.252944 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-757c6b86f6-f4szp_2219064b-6999-40ed-a34a-a744da807a9f/router/0.log" Jul 14 01:35:21.609847 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:21.609812 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ljqk8_82f96216-249d-46da-bbe7-f11232d54063/main/0.log" Jul 14 01:35:21.960698 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:21.960667 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbqvl6_36fd1328-d12d-42af-b874-0ad1f33bbada/main/0.log" Jul 14 01:35:28.990189 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:28.990162 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rq4ld_92683eb7-9da4-407b-ac51-ac53b3400ad2/global-pull-secret-syncer/0.log" Jul 14 01:35:29.108929 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:29.108895 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w79xj_f49d33c9-9fb7-43b9-8cce-58352c29b55a/konnectivity-agent/0.log" Jul 14 01:35:29.190321 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:29.190271 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-60.ec2.internal_b858f6dbf512009ca5a9e4eaae700794/haproxy/0.log" Jul 14 01:35:36.872310 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:36.872273 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-57lpc_b03cb98a-7a6c-4760-ae4c-fe70aa0e5c17/cluster-monitoring-operator/0.log" Jul 14 01:35:36.961243 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:36.961217 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79d98d6f9b-pzdp5_b4eca78a-710a-4588-8976-b9b808bafd0f/metrics-server/0.log" Jul 14 01:35:36.980732 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:36.980703 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-2pkpv_b1c715ff-ca61-4366-b10e-d879e4e9eb2a/monitoring-plugin/0.log" Jul 14 01:35:37.067499 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.067468 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m76n9_7fe240fd-f86e-4aa7-adcd-c832d6a53dec/node-exporter/0.log" Jul 14 01:35:37.086366 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.086343 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m76n9_7fe240fd-f86e-4aa7-adcd-c832d6a53dec/kube-rbac-proxy/0.log" Jul 14 01:35:37.103775 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.103755 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m76n9_7fe240fd-f86e-4aa7-adcd-c832d6a53dec/init-textfile/0.log" Jul 14 01:35:37.191526 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.191493 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-sl8bg_25540b44-b2de-4a18-8f90-8f00cde41f9a/kube-rbac-proxy-main/0.log" Jul 14 01:35:37.210551 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.210517 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-sl8bg_25540b44-b2de-4a18-8f90-8f00cde41f9a/kube-rbac-proxy-self/0.log" Jul 14 01:35:37.228923 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.228905 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-sl8bg_25540b44-b2de-4a18-8f90-8f00cde41f9a/openshift-state-metrics/0.log" Jul 14 01:35:37.472207 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.472123 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fbffb985b-8rqxq_21be1a0d-511d-4191-815c-0001d6d7fff3/telemeter-client/0.log" Jul 14 01:35:37.489617 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.489581 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fbffb985b-8rqxq_21be1a0d-511d-4191-815c-0001d6d7fff3/reload/0.log" Jul 14 01:35:37.506419 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.506396 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fbffb985b-8rqxq_21be1a0d-511d-4191-815c-0001d6d7fff3/kube-rbac-proxy/0.log" Jul 14 01:35:37.527601 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.527580 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cdb58fd8-h8xzp_a053893b-41d3-4a81-a56d-089546b00d24/thanos-query/0.log" Jul 14 01:35:37.546872 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.546843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cdb58fd8-h8xzp_a053893b-41d3-4a81-a56d-089546b00d24/kube-rbac-proxy-web/0.log" Jul 14 01:35:37.567262 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.567234 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cdb58fd8-h8xzp_a053893b-41d3-4a81-a56d-089546b00d24/kube-rbac-proxy/0.log" Jul 14 01:35:37.584680 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.584662 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cdb58fd8-h8xzp_a053893b-41d3-4a81-a56d-089546b00d24/prom-label-proxy/0.log" Jul 14 01:35:37.601886 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.601862 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cdb58fd8-h8xzp_a053893b-41d3-4a81-a56d-089546b00d24/kube-rbac-proxy-rules/0.log" Jul 14 01:35:37.618509 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:37.618456 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cdb58fd8-h8xzp_a053893b-41d3-4a81-a56d-089546b00d24/kube-rbac-proxy-metrics/0.log" Jul 14 01:35:38.650530 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.650496 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-fb9mw_0c780bc8-8b4d-4996-8ed6-512ec2c36698/networking-console-plugin/0.log" Jul 14 01:35:38.763544 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.763513 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9"] Jul 14 01:35:38.763991 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.763961 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1722c8c9-0036-49e4-8358-a3fe45b23804" containerName="revoke-keys" Jul 14 01:35:38.763991 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.763981 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1722c8c9-0036-49e4-8358-a3fe45b23804" containerName="revoke-keys" Jul 14 01:35:38.764189 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.764103 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1722c8c9-0036-49e4-8358-a3fe45b23804" containerName="revoke-keys" Jul 14 01:35:38.767399 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.767379 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:38.770903 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.770877 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nwk5x\"/\"kube-root-ca.crt\"" Jul 14 01:35:38.770903 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.770902 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nwk5x\"/\"openshift-service-ca.crt\"" Jul 14 01:35:38.772206 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.772189 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nwk5x\"/\"default-dockercfg-zsgk7\"" Jul 14 01:35:38.776814 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.776793 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9"] Jul 14 01:35:38.938870 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.938844 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-lib-modules\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:38.939015 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.938882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkxbm\" (UniqueName: \"kubernetes.io/projected/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-kube-api-access-lkxbm\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:38.939015 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.938906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-sys\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:38.939015 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.938987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-proc\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:38.939151 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:38.939054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-podres\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039569 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-proc\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039766 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-podres\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039766 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-proc\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039766 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-lib-modules\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039766 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039708 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkxbm\" (UniqueName: \"kubernetes.io/projected/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-kube-api-access-lkxbm\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039766 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-sys\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039977 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039778 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-podres\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039977 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039833 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-sys\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.039977 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.039862 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-lib-modules\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.046753 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.046728 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkxbm\" (UniqueName: \"kubernetes.io/projected/bea02e5f-4947-4d79-a8be-df6ceadb7d5d-kube-api-access-lkxbm\") pod \"perf-node-gather-daemonset-sz4h9\" (UID: \"bea02e5f-4947-4d79-a8be-df6ceadb7d5d\") " pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.077344 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.077321 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.208488 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.208463 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9"] Jul 14 01:35:39.210433 ip-10-0-131-60 kubenswrapper[2575]: W0714 01:35:39.210404 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbea02e5f_4947_4d79_a8be_df6ceadb7d5d.slice/crio-eb09e00dc1fdc1f0665cf13d92a3a5a3ee8bec5c23a037cbd79bb4c5d9af8073 WatchSource:0}: Error finding container eb09e00dc1fdc1f0665cf13d92a3a5a3ee8bec5c23a037cbd79bb4c5d9af8073: Status 404 returned error can't find the container with id eb09e00dc1fdc1f0665cf13d92a3a5a3ee8bec5c23a037cbd79bb4c5d9af8073 Jul 14 01:35:39.297868 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.297822 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/1.log" Jul 14 01:35:39.307606 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.307586 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6t5n5_77c239e6-26c2-4640-80e8-b8bc742c4d52/console-operator/2.log" Jul 14 01:35:39.577126 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.577019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" event={"ID":"bea02e5f-4947-4d79-a8be-df6ceadb7d5d","Type":"ContainerStarted","Data":"49aa4f43b68fa224131b219160834b32047fcacc3f11090b347fcbc0b4a4bb8b"} Jul 14 01:35:39.577126 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.577105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" event={"ID":"bea02e5f-4947-4d79-a8be-df6ceadb7d5d","Type":"ContainerStarted","Data":"eb09e00dc1fdc1f0665cf13d92a3a5a3ee8bec5c23a037cbd79bb4c5d9af8073"} Jul 14 01:35:39.577308 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.577139 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:39.593586 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:39.593539 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" podStartSLOduration=1.593525109 podStartE2EDuration="1.593525109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:35:39.591272187 +0000 UTC m=+3093.080609651" watchObservedRunningTime="2026-07-14 01:35:39.593525109 +0000 UTC m=+3093.082862549" Jul 14 01:35:41.367387 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:41.367352 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hcppl_42f902ed-ba3a-44cf-9a44-298fddd4ad7c/dns/0.log" Jul 14 01:35:41.384596 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:41.384562 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hcppl_42f902ed-ba3a-44cf-9a44-298fddd4ad7c/kube-rbac-proxy/0.log" Jul 14 01:35:41.490218 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:41.490190 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qtt9x_89e8396f-097a-429e-a698-a91fee24f257/dns-node-resolver/0.log" Jul 14 01:35:42.006024 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:42.005992 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d5kjk_d09dae08-02ae-44c2-8f9b-95fc9c1913fc/node-ca/0.log" Jul 14 01:35:43.161297 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:43.161259 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-66dg2_aca9de1b-7d73-4bcd-b7c2-a73dcae92a10/discovery/0.log" Jul 14 01:35:43.319130 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:43.319099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qgmwb_4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8/payload-pre-processing/0.log" Jul 14 01:35:43.376327 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:43.376289 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-757c6b86f6-f4szp_2219064b-6999-40ed-a34a-a744da807a9f/router/0.log" Jul 14 01:35:44.077116 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:44.077084 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-skxgn_f47310b6-7f79-428b-87a8-178d10caaf14/serve-healthcheck-canary/0.log" Jul 14 01:35:44.653340 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:44.653311 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-srnkw_643592c5-8987-41f5-bdaf-1f54af580371/kube-rbac-proxy/0.log" Jul 14 01:35:44.669774 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:44.669733 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-srnkw_643592c5-8987-41f5-bdaf-1f54af580371/exporter/0.log" Jul 14 01:35:44.690719 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:44.690699 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-srnkw_643592c5-8987-41f5-bdaf-1f54af580371/extractor/0.log" Jul 14 01:35:45.592468 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:45.592438 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nwk5x/perf-node-gather-daemonset-sz4h9" Jul 14 01:35:47.072628 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:47.072572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fb5967cff-cvbh7_9abd3f67-5508-46fe-b188-32b5676f2b55/manager/0.log" Jul 14 01:35:47.268482 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:47.268440 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7d6985f7-d9s7f_2abf2233-e2e4-4127-be00-6ed70701797d/manager/0.log" Jul 14 01:35:47.284008 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:47.283980 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7d6985f7-d9s7f_2abf2233-e2e4-4127-be00-6ed70701797d/copy-manifests/0.log" Jul 14 01:35:48.610697 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:48.610662 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bd544bbf-45jv7_85109528-bcb8-435a-9b3b-5c042022d1aa/manager/0.log" Jul 14 01:35:48.663542 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:48.663510 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xf2hl_32a67848-b77b-40f0-9ec0-484ac624a3a6/openshift-lws-operator/0.log" Jul 14 01:35:49.576486 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:49.576453 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-66dg2_aca9de1b-7d73-4bcd-b7c2-a73dcae92a10/discovery/0.log" Jul 14 01:35:49.726204 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:49.726173 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qgmwb_4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8/payload-pre-processing/0.log" Jul 14 01:35:49.769186 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:49.769156 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-757c6b86f6-f4szp_2219064b-6999-40ed-a34a-a744da807a9f/router/0.log" Jul 14 01:35:51.208736 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:51.208700 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-66dg2_aca9de1b-7d73-4bcd-b7c2-a73dcae92a10/discovery/0.log" Jul 14 01:35:51.352287 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:51.352190 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qgmwb_4ee2ca44-87a1-4825-b0e6-d66b1b8bf4b8/payload-pre-processing/0.log" Jul 14 01:35:51.397855 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:51.397828 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-757c6b86f6-f4szp_2219064b-6999-40ed-a34a-a744da807a9f/router/0.log" Jul 14 01:35:54.085828 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:54.085781 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-2nptz_3167bf47-5320-458a-be2e-e2258f27c826/kube-storage-version-migrator-operator/1.log" Jul 14 01:35:54.087593 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:54.087569 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-2nptz_3167bf47-5320-458a-be2e-e2258f27c826/kube-storage-version-migrator-operator/0.log" Jul 14 01:35:55.126670 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.126644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdssk_5d569466-c10f-4c9a-a991-2738b0372661/kube-multus-additional-cni-plugins/0.log" Jul 14 01:35:55.145790 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.145757 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdssk_5d569466-c10f-4c9a-a991-2738b0372661/egress-router-binary-copy/0.log" Jul 14 01:35:55.162942 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.162917 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdssk_5d569466-c10f-4c9a-a991-2738b0372661/cni-plugins/0.log" Jul 14 01:35:55.179959 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.179937 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdssk_5d569466-c10f-4c9a-a991-2738b0372661/bond-cni-plugin/0.log" Jul 14 01:35:55.197441 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.197416 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdssk_5d569466-c10f-4c9a-a991-2738b0372661/routeoverride-cni/0.log" Jul 14 01:35:55.214374 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.214340 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdssk_5d569466-c10f-4c9a-a991-2738b0372661/whereabouts-cni-bincopy/0.log" Jul 14 01:35:55.231493 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.231464 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdssk_5d569466-c10f-4c9a-a991-2738b0372661/whereabouts-cni/0.log" Jul 14 01:35:55.466478 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.466448 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lsts4_735aef64-0568-4dc5-b40e-51a0d91c4cfe/kube-multus/0.log" Jul 14 01:35:55.566609 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.566572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vbw62_d505356c-4ab9-4d74-a411-be8467553bf6/network-metrics-daemon/0.log" Jul 14 01:35:55.579898 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:55.579864 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vbw62_d505356c-4ab9-4d74-a411-be8467553bf6/kube-rbac-proxy/0.log" Jul 14 01:35:56.359035 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.359000 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-controller/0.log" Jul 14 01:35:56.372881 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.372834 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/0.log" Jul 14 01:35:56.373056 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.372984 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovn-acl-logging/1.log" Jul 14 01:35:56.394512 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.394482 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/kube-rbac-proxy-node/0.log" Jul 14 01:35:56.415854 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.415827 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/kube-rbac-proxy-ovn-metrics/0.log" Jul 14 01:35:56.431686 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.431660 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/northd/0.log" Jul 14 01:35:56.449672 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.449644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/nbdb/0.log" Jul 14 01:35:56.466112 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.466079 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/sbdb/0.log" Jul 14 01:35:56.546987 ip-10-0-131-60 kubenswrapper[2575]: I0714 01:35:56.546956 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhh7_0d1da8d6-2211-46ae-b7dd-fd5ca380dfda/ovnkube-controller/0.log"